2023-12-03T11:10:48.881 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-03T11:10:48.881 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132 --name alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} --verbose --owner scheduled_alimasa@teuthology -- /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132/orig.config.yaml 2023-12-03T11:10:48.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-03T11:10:48.995 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132 branch: wip-alimasa-multi-pubsub-etag description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7476132' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-alimasa-multi-pubsub-etag ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 rgw: compression type: random ec-data-pool: false frontend: beast storage classes: LUKEWARM, FROZEN s3tests: force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-alimasa-multi-pubsub-etag sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 owner: scheduled_alimasa@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 sleep_before_teardown: 0 suite: rgw suite_branch: wip-alimasa-multi-pubsub-etag suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 targets: smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIGLLW5lEyD0TqrX0qfEz3d7YenSQguKT7RX2V4Cd/HtIAFDdBRn/bpxGTkfdJyYd38ELFEvaftd5NYZdYM044A= smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJHR3bUn7kJuWNVa0JRRD0ch+Afsiy1VnVp8T2hvJIth26m2xDoKxdhmbZ4lfk5vkD+hkQifXIIl0tzjS8Trhzw= tasks: - install: extra_system_packages: deb: - s3cmd rpm: - s3cmd - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-03_11:04:43 tube: smithi user: alimasa verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-03T11:10:48.995 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa; will attempt to use it 2023-12-03T11:10:48.995 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks 2023-12-03T11:10:48.996 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-03T11:10:48.997 INFO:teuthology.task.internal:Checking packages... 2023-12-03T11:10:49.017 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bcbf278cf395873c2a482f5a7b2345faf2160319' 2023-12-03T11:10:49.018 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-03T11:10:49.018 INFO:teuthology.packaging:ref: None 2023-12-03T11:10:49.018 INFO:teuthology.packaging:tag: None 2023-12-03T11:10:49.018 INFO:teuthology.packaging:branch: wip-alimasa-multi-pubsub-etag 2023-12-03T11:10:49.018 INFO:teuthology.packaging:sha1: bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:10:49.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-alimasa-multi-pubsub-etag 2023-12-03T11:10:49.152 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7537.gbcbf278c 2023-12-03T11:10:49.152 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-03T11:10:49.159 INFO:teuthology.task.internal:no buildpackages task found 2023-12-03T11:10:49.159 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-03T11:10:49.171 INFO:teuthology.task.internal:Saving configuration 2023-12-03T11:10:49.186 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-03T11:10:49.193 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-03T11:10:49.216 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:05:57.938681', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIGLLW5lEyD0TqrX0qfEz3d7YenSQguKT7RX2V4Cd/HtIAFDdBRn/bpxGTkfdJyYd38ELFEvaftd5NYZdYM044A='} 2023-12-03T11:10:49.238 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:05:57.937608', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJHR3bUn7kJuWNVa0JRRD0ch+Afsiy1VnVp8T2hvJIth26m2xDoKxdhmbZ4lfk5vkD+hkQifXIIl0tzjS8Trhzw='} 2023-12-03T11:10:49.238 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-03T11:10:49.245 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-12-03T11:10:49.245 INFO:teuthology.task.internal:roles: ubuntu@smithi148.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-12-03T11:10:49.245 INFO:teuthology.run_tasks:Running task console_log... 2023-12-03T11:10:49.314 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f27e0a6ef70>, signals=[15]) 2023-12-03T11:10:49.314 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-03T11:10:49.321 INFO:teuthology.task.internal:Opening connections... 2023-12-03T11:10:49.321 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T11:10:49.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:10:49.404 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T11:10:49.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:10:49.486 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-03T11:10:49.493 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-12-03T11:10:49.510 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-12-03T11:10:49.510 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-12-03T11:10:49.565 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-12-03T11:10:49.565 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2023-12-03T11:10:49.565 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-12-03T11:10:49.565 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-12-03T11:10:49.566 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2023-12-03T11:10:49.566 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2023-12-03T11:10:49.566 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-03T11:10:49.566 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-12-03T11:10:49.566 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2023-12-03T11:10:49.566 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-03T11:10:49.566 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-12-03T11:10:49.566 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-03T11:10:49.566 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-03T11:10:49.566 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-03T11:10:49.567 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-12-03T11:10:49.602 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-12-03T11:10:49.619 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-12-03T11:10:49.619 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-12-03T11:10:49.676 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="CentOS Stream" 2023-12-03T11:10:49.676 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="9" 2023-12-03T11:10:49.676 INFO:teuthology.orchestra.run.smithi148.stdout:ID="centos" 2023-12-03T11:10:49.677 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="rhel fedora" 2023-12-03T11:10:49.677 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="9" 2023-12-03T11:10:49.677 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el9" 2023-12-03T11:10:49.677 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-03T11:10:49.677 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31" 2023-12-03T11:10:49.677 INFO:teuthology.orchestra.run.smithi148.stdout:LOGO="fedora-logo-icon" 2023-12-03T11:10:49.677 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-03T11:10:49.677 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://centos.org/" 2023-12-03T11:10:49.677 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-03T11:10:49.677 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-03T11:10:49.677 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-03T11:10:49.677 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-12-03T11:10:49.701 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-03T11:10:49.711 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-03T11:10:49.719 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-03T11:10:49.719 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2023-12-03T11:10:49.721 DEBUG:teuthology.orchestra.run.smithi148:> test '!' -e /home/ubuntu/cephtest 2023-12-03T11:10:49.737 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-03T11:10:49.745 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-03T11:10:49.745 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2023-12-03T11:10:49.778 DEBUG:teuthology.orchestra.run.smithi148:> test -z $(ls -A /var/lib/ceph) 2023-12-03T11:10:49.830 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-03T11:10:49.892 INFO:teuthology.run_tasks:Running task kernel... 2023-12-03T11:10:49.908 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-03T11:10:49.908 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-03T11:10:49.908 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-03T11:10:49.909 DEBUG:teuthology.orchestra.run.smithi148:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-03T11:10:49.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:10:49.924 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2023-12-03T11:10:49.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:10:49.925 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-12-03T11:10:49.981 INFO:teuthology.orchestra.run.smithi131.stdout:5.14.0-361.el9.x86_64 2023-12-03T11:10:49.981 INFO:teuthology.task.kernel:Running kernel on smithi131: 5.14.0-361.el9.x86_64 2023-12-03T11:10:49.982 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum install -y kernel 2023-12-03T11:10:49.982 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-361.el9.x86_64 2023-12-03T11:10:49.983 INFO:teuthology.task.kernel:Running kernel on smithi148: 5.14.0-361.el9.x86_64 2023-12-03T11:10:49.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum install -y kernel 2023-12-03T11:10:52.349 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - AppStream 9.0 MB/s | 6.4 MB 00:00 2023-12-03T11:10:52.538 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS-9 - AppStream 7.2 MB/s | 6.4 MB 00:00 2023-12-03T11:10:53.974 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2023-12-03T11:10:54.189 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2023-12-03T11:10:55.288 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-12-03T11:10:56.256 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 7.9 MB 00:01 2023-12-03T11:10:58.214 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-12-03T11:10:59.274 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 18 MB 00:02 2023-12-03T11:11:03.340 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 5.8 MB 00:01 2023-12-03T11:11:03.616 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 5.8 MB 00:01 2023-12-03T11:11:04.891 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2023-12-03T11:11:05.092 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 15 kB 00:00 2023-12-03T11:11:07.029 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-03T11:11:09.636 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 20 MB 00:04 2023-12-03T11:11:11.868 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2023-12-03T11:11:14.191 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-03T11:11:14.191 INFO:teuthology.orchestra.run.smithi148.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-03T11:11:14.282 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2023-12-03T11:11:14.291 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2023-12-03T11:11:14.291 INFO:teuthology.orchestra.run.smithi148.stdout: Package Architecture Version Repository Size 2023-12-03T11:11:14.291 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2023-12-03T11:11:14.291 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2023-12-03T11:11:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-12-03T11:11:14.292 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2023-12-03T11:11:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-12-03T11:11:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-12-03T11:11:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-12-03T11:11:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:11:14.292 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2023-12-03T11:11:14.292 INFO:teuthology.orchestra.run.smithi148.stdout:================================================================================ 2023-12-03T11:11:14.292 INFO:teuthology.orchestra.run.smithi148.stdout:Install 4 Packages 2023-12-03T11:11:14.292 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:11:14.293 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 96 M 2023-12-03T11:11:14.293 INFO:teuthology.orchestra.run.smithi148.stdout:Installed size: 121 M 2023-12-03T11:11:14.293 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2023-12-03T11:11:14.333 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2023-12-03T11:11:14.769 INFO:teuthology.orchestra.run.smithi148.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 20 MB/s | 5.6 MB 00:00 2023-12-03T11:11:15.095 INFO:teuthology.orchestra.run.smithi148.stdout:(2/4): kernel-core-5.14.0-388.el9.x86_64.rpm 34 MB/s | 20 MB 00:00 2023-12-03T11:11:15.603 INFO:teuthology.orchestra.run.smithi148.stdout:(3/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 34 MB/s | 38 MB 00:01 2023-12-03T11:11:15.912 INFO:teuthology.orchestra.run.smithi148.stdout:(4/4): kernel-modules-core-5.14.0-388.el9.x86_6 28 MB/s | 32 MB 00:01 2023-12-03T11:11:15.912 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:11:15.912 INFO:teuthology.orchestra.run.smithi148.stdout:Total 59 MB/s | 96 MB 00:01 2023-12-03T11:11:16.623 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-03T11:11:16.624 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-03T11:11:16.705 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-12-03T11:11:16.715 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-12-03T11:11:16.715 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2023-12-03T11:11:16.715 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-12-03T11:11:16.715 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2023-12-03T11:11:16.715 INFO:teuthology.orchestra.run.smithi131.stdout: kernel x86_64 5.14.0-388.el9 baseos 5.6 M 2023-12-03T11:11:16.715 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2023-12-03T11:11:16.715 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-core x86_64 5.14.0-388.el9 baseos 20 M 2023-12-03T11:11:16.715 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules x86_64 5.14.0-388.el9 baseos 38 M 2023-12-03T11:11:16.715 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-core x86_64 5.14.0-388.el9 baseos 32 M 2023-12-03T11:11:16.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:11:16.716 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-12-03T11:11:16.716 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-12-03T11:11:16.716 INFO:teuthology.orchestra.run.smithi131.stdout:Install 4 Packages 2023-12-03T11:11:16.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:11:16.716 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 96 M 2023-12-03T11:11:16.717 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 121 M 2023-12-03T11:11:16.717 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-12-03T11:11:16.769 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2023-12-03T11:11:17.147 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2023-12-03T11:11:17.147 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2023-12-03T11:11:17.376 INFO:teuthology.orchestra.run.smithi131.stdout:(1/4): kernel-5.14.0-388.el9.x86_64.rpm 9.8 MB/s | 5.6 MB 00:00 2023-12-03T11:11:17.969 INFO:teuthology.orchestra.run.smithi131.stdout:(2/4): kernel-core-5.14.0-388.el9.x86_64.rpm 18 MB/s | 20 MB 00:01 2023-12-03T11:11:18.426 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2023-12-03T11:11:18.427 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2023-12-03T11:11:18.810 INFO:teuthology.orchestra.run.smithi131.stdout:(3/4): kernel-modules-5.14.0-388.el9.x86_64.rpm 19 MB/s | 38 MB 00:02 2023-12-03T11:11:19.269 INFO:teuthology.orchestra.run.smithi131.stdout:(4/4): kernel-modules-core-5.14.0-388.el9.x86_6 17 MB/s | 32 MB 00:01 2023-12-03T11:11:19.269 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:11:19.269 INFO:teuthology.orchestra.run.smithi131.stdout:Total 38 MB/s | 96 MB 00:02 2023-12-03T11:11:20.120 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-12-03T11:11:20.508 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-12-03T11:11:20.508 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-12-03T11:11:21.325 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2023-12-03T11:11:21.784 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-12-03T11:11:21.785 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-12-03T11:11:21.966 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:11:22.094 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:11:24.716 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-12-03T11:11:24.905 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:11:25.079 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:11:25.370 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-modules-core-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:11:25.498 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:11:28.267 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:11:28.435 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:11:29.693 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:11:29.803 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:11:33.066 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:11:33.294 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:11:34.429 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:11:37.933 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:12:03.363 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:12:03.406 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:12:03.844 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:12:03.844 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:12:03.844 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:12:03.844 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:12:04.262 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:12:04.262 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:12:04.262 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2023-12-03T11:12:04.262 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-5.14.0-388.el9.x86_64 2023-12-03T11:12:04.263 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-12-03T11:12:04.263 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-12-03T11:12:04.263 INFO:teuthology.orchestra.run.smithi148.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-12-03T11:12:04.263 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:12:04.263 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2023-12-03T11:12:04.814 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:12:04.972 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:12:04.972 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:12:04.972 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-12-03T11:12:04.972 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-03T11:12:04.972 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-03T11:12:04.972 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-03T11:12:04.973 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi148.front.sepia.ceph.com, path=None, version=distro) 2023-12-03T11:12:04.973 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:12:05.090 INFO:teuthology.orchestra.run.smithi148.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:12:05.090 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:12:05.091 DEBUG:teuthology.orchestra.run.smithi148:> sudo rpm -qi grub2-tools 2023-12-03T11:12:05.134 INFO:teuthology.orchestra.run.smithi148.stdout:Name : grub2-tools 2023-12-03T11:12:05.134 INFO:teuthology.orchestra.run.smithi148.stdout:Epoch : 1 2023-12-03T11:12:05.134 INFO:teuthology.orchestra.run.smithi148.stdout:Version : 2.06 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Release : 68.el9 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Architecture: x86_64 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Group : Unspecified 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Size : 8264254 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:License : GPLv3+ 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Packager : builder@centos.org 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Vendor : CentOS 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Summary : Support tools for GRUB. 2023-12-03T11:12:05.135 INFO:teuthology.orchestra.run.smithi148.stdout:Description : 2023-12-03T11:12:05.136 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:12:05.136 INFO:teuthology.orchestra.run.smithi148.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-03T11:12:05.136 INFO:teuthology.orchestra.run.smithi148.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-03T11:12:05.136 INFO:teuthology.orchestra.run.smithi148.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-03T11:12:05.136 INFO:teuthology.orchestra.run.smithi148.stdout:hardware devices. 2023-12-03T11:12:05.136 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:12:05.136 INFO:teuthology.orchestra.run.smithi148.stdout:This subpackage provides tools for support of all platforms. 2023-12-03T11:12:05.137 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-03T11:12:05.137 INFO:teuthology.task.kernel:Updating grub on smithi148 to boot 5.14.0-388.el9.x86_64 2023-12-03T11:12:05.137 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-03T11:12:05.758 INFO:teuthology.orchestra.run.smithi148.stderr:Generating grub configuration file ... 2023-12-03T11:12:06.698 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:12:06.741 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:12:07.108 INFO:teuthology.orchestra.run.smithi148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-03T11:12:07.142 INFO:teuthology.orchestra.run.smithi148.stderr:done 2023-12-03T11:12:07.145 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-12-03T11:12:07.159 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.LTCTEhGhXe 2023-12-03T11:12:07.160 DEBUG:teuthology.orchestra.run.smithi148:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LTCTEhGhXe 2023-12-03T11:12:07.177 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:12:07.177 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-5.14.0-388.el9.x86_64 1/4 2023-12-03T11:12:07.177 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-core-5.14.0-388.el9.x86_64 2/4 2023-12-03T11:12:07.177 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-modules-5.14.0-388.el9.x86_64 3/4 2023-12-03T11:12:07.228 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.LTCTEhGhXe 2023-12-03T11:12:07.364 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.LTCTEhGhXe is 6KB 2023-12-03T11:12:07.412 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.LTCTEhGhXe 2023-12-03T11:12:07.426 DEBUG:teuthology.orchestra.run.smithi148:> sudo /bin/ls /boot/loader/entries || true 2023-12-03T11:12:07.491 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-03T11:12:07.491 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-03T11:12:07.491 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-03T11:12:07.491 INFO:teuthology.orchestra.run.smithi148.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-12-03T11:12:07.493 DEBUG:teuthology.orchestra.run.smithi148:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-12-03T11:12:07.579 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-modules-core-5.14.0-388.el9.x86_64 4/4 2023-12-03T11:12:07.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:12:07.579 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2023-12-03T11:12:07.579 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-5.14.0-388.el9.x86_64 2023-12-03T11:12:07.579 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-core-5.14.0-388.el9.x86_64 2023-12-03T11:12:07.579 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-5.14.0-388.el9.x86_64 2023-12-03T11:12:07.579 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-core-5.14.0-388.el9.x86_64 2023-12-03T11:12:07.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:12:07.579 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-12-03T11:12:07.644 DEBUG:teuthology.orchestra.run.smithi148:> sudo shutdown -r now 2023-12-03T11:12:08.111 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:12:08.243 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:12:08.243 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:12:08.243 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-388.el9.x86_64 2023-12-03T11:12:08.243 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-03T11:12:08.243 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-03T11:12:08.243 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-03T11:12:08.244 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=None, version=distro) 2023-12-03T11:12:08.244 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2023-12-03T11:12:08.360 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-5.14.0-388.el9.x86_64 2023-12-03T11:12:08.361 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-388.el9.x86_64 2023-12-03T11:12:08.361 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -qi grub2-tools 2023-12-03T11:12:08.395 INFO:teuthology.orchestra.run.smithi131.stdout:Name : grub2-tools 2023-12-03T11:12:08.395 INFO:teuthology.orchestra.run.smithi131.stdout:Epoch : 1 2023-12-03T11:12:08.395 INFO:teuthology.orchestra.run.smithi131.stdout:Version : 2.06 2023-12-03T11:12:08.395 INFO:teuthology.orchestra.run.smithi131.stdout:Release : 68.el9 2023-12-03T11:12:08.395 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: x86_64 2023-12-03T11:12:08.395 INFO:teuthology.orchestra.run.smithi131.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-03T11:12:08.395 INFO:teuthology.orchestra.run.smithi131.stdout:Group : Unspecified 2023-12-03T11:12:08.395 INFO:teuthology.orchestra.run.smithi131.stdout:Size : 8264254 2023-12-03T11:12:08.395 INFO:teuthology.orchestra.run.smithi131.stdout:License : GPLv3+ 2023-12-03T11:12:08.395 INFO:teuthology.orchestra.run.smithi131.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-03T11:12:08.395 INFO:teuthology.orchestra.run.smithi131.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:Packager : builder@centos.org 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:Vendor : CentOS 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:Summary : Support tools for GRUB. 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:Description : 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:hardware devices. 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:12:08.396 INFO:teuthology.orchestra.run.smithi131.stdout:This subpackage provides tools for support of all platforms. 2023-12-03T11:12:08.397 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-03T11:12:08.397 INFO:teuthology.task.kernel:Updating grub on smithi131 to boot 5.14.0-388.el9.x86_64 2023-12-03T11:12:08.397 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-03T11:12:09.009 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2023-12-03T11:12:10.374 INFO:teuthology.orchestra.run.smithi131.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-03T11:12:10.416 INFO:teuthology.orchestra.run.smithi131.stderr:done 2023-12-03T11:12:10.419 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2023-12-03T11:12:10.433 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.0TBxkuWVNN 2023-12-03T11:12:10.434 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0TBxkuWVNN 2023-12-03T11:12:10.502 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.0TBxkuWVNN 2023-12-03T11:12:10.635 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.0TBxkuWVNN is 6KB 2023-12-03T11:12:10.683 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.0TBxkuWVNN 2023-12-03T11:12:10.696 DEBUG:teuthology.orchestra.run.smithi131:> sudo /bin/ls /boot/loader/entries || true 2023-12-03T11:12:10.784 INFO:teuthology.orchestra.run.smithi131.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-03T11:12:10.784 INFO:teuthology.orchestra.run.smithi131.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-03T11:12:10.784 INFO:teuthology.orchestra.run.smithi131.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-03T11:12:10.784 INFO:teuthology.orchestra.run.smithi131.stdout:15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64.conf 2023-12-03T11:12:10.785 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-388.el9.x86_64 2023-12-03T11:12:10.887 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2023-12-03T11:12:37.667 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-03T11:12:37.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-03T11:12:37.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:12:40.890 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-03T11:12:40.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-12-03T11:12:40.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:12:56.162 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-03T11:12:59.234 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-12-03T11:13:05.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-03T11:13:05.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:13:08.226 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-03T11:13:08.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-12-03T11:13:08.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:13:11.298 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-12-03T11:13:20.234 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-03T11:13:20.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:13:23.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-12-03T11:13:23.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:13:38.658 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-12-03T11:13:53.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-03T11:13:53.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:13:53.990 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-12-03T11:13:54.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-03T11:13:54.383 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-388.el9.x86_64"... 2023-12-03T11:13:54.384 DEBUG:teuthology.orchestra.run.smithi148:> uname -r 2023-12-03T11:13:54.397 INFO:teuthology.orchestra.run.smithi148.stdout:5.14.0-388.el9.x86_64 2023-12-03T11:13:54.398 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-12-03T11:13:54.398 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-03T11:13:54.398 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-03T11:13:55.133 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-12-03T11:13:55.398 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-03T11:13:55.398 DEBUG:teuthology.orchestra.run.smithi148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-03T11:13:55.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-12-03T11:13:55.498 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-388.el9.x86_64"... 2023-12-03T11:13:55.498 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2023-12-03T11:13:55.500 INFO:teuthology.orchestra.run.smithi148.stdout:ttyS1 2023-12-03T11:13:55.511 INFO:teuthology.orchestra.run.smithi131.stdout:5.14.0-388.el9.x86_64 2023-12-03T11:13:55.512 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-388.el9.x86_64 vs 5.14.0-388.el9.x86_64 2023-12-03T11:13:55.512 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-03T11:13:55.512 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-03T11:13:55.536 DEBUG:teuthology.parallel:result is None 2023-12-03T11:13:56.512 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-03T11:13:56.513 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-03T11:13:56.585 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2023-12-03T11:13:56.652 DEBUG:teuthology.parallel:result is None 2023-12-03T11:13:56.652 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-03T11:13:56.659 INFO:teuthology.task.internal:Creating test directory... 2023-12-03T11:13:56.660 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-03T11:13:56.662 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-03T11:13:56.676 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-03T11:13:56.683 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-03T11:13:56.690 INFO:teuthology.task.internal:Creating archive directory... 2023-12-03T11:13:56.690 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-03T11:13:56.715 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-03T11:13:56.777 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-03T11:13:56.784 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-03T11:13:56.784 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-03T11:13:56.794 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-03T11:13:56.966 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:13:56.979 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:13:57.044 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:13:57.069 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-03T11:13:57.071 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-03T11:13:57.079 INFO:teuthology.task.internal:Configuring sudo... 2023-12-03T11:13:57.079 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-03T11:13:57.081 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-03T11:13:57.129 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-03T11:13:57.138 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-03T11:13:57.138 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-03T11:13:57.146 DEBUG:teuthology.orchestra.run.smithi148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-03T11:13:57.176 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:13:57.253 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:13:57.322 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:13:57.375 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:13:57.429 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:13:57.429 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-03T11:13:57.475 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:13:57.527 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-03T11:13:57.596 DEBUG:teuthology.orchestra.run.smithi148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:13:57.646 DEBUG:teuthology.orchestra.run.smithi148:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-03T11:13:57.706 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:13:57.706 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-03T11:13:57.777 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2023-12-03T11:13:57.780 DEBUG:teuthology.orchestra.run.smithi148:> sudo service rsyslog restart 2023-12-03T11:13:57.849 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T11:13:57.862 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T11:13:58.337 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-03T11:13:58.345 INFO:teuthology.task.internal:Starting timer... 2023-12-03T11:13:58.345 INFO:teuthology.run_tasks:Running task pcp... 2023-12-03T11:13:58.359 INFO:teuthology.run_tasks:Running task selinux... 2023-12-03T11:13:58.367 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2023-12-03T11:13:58.420 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2023-12-03T11:13:58.422 DEBUG:teuthology.orchestra.run.smithi148:> sudo service auditd rotate 2023-12-03T11:13:58.529 INFO:teuthology.orchestra.run.smithi148.stdout:Rotating logs: 2023-12-03T11:13:58.531 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-03T11:13:58.531 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2023-12-03T11:13:58.612 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2023-12-03T11:13:58.613 DEBUG:teuthology.orchestra.run.smithi148:> /usr/sbin/getenforce 2023-12-03T11:13:58.636 INFO:teuthology.orchestra.run.smithi148.stdout:Permissive 2023-12-03T11:13:58.636 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi131.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi148.front.sepia.ceph.com': 'permissive'} 2023-12-03T11:13:58.636 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T11:13:58.665 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:13:58.666 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T11:13:58.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:13:58.703 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-03T11:13:58.703 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2023-12-03T11:13:58.764 DEBUG:teuthology.orchestra.run.smithi148:> sudo /usr/sbin/setenforce permissive 2023-12-03T11:13:58.796 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-03T11:13:58.806 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-03T11:13:58.807 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-03T11:13:58.821 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-03T11:13:58.822 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi131.front.sepia.ceph.com,smithi148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-03T11:19:50.884 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi131.front.sepia.ceph.com'), Remote(name='ubuntu@smithi148.front.sepia.ceph.com')] 2023-12-03T11:19:50.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-12-03T11:19:50.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:19:50.970 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-12-03T11:19:51.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-12-03T11:19:51.036 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-03T11:19:51.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-03T11:19:51.159 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-12-03T11:19:51.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-12-03T11:19:51.235 INFO:teuthology.run_tasks:Running task clock... 2023-12-03T11:19:51.255 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-03T11:19:51.255 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-03T11:19:51.255 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T11:19:51.258 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-03T11:19:51.258 DEBUG:teuthology.orchestra.run.smithi148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T11:19:51.287 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-03T11:19:51.303 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-03T11:19:51.309 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-03T11:19:51.326 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-03T11:19:51.332 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2023-12-03T11:19:51.346 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2023-12-03T11:19:51.357 INFO:teuthology.orchestra.run.smithi148.stderr:sudo: ntpd: command not found 2023-12-03T11:19:51.363 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-03T11:19:51.371 INFO:teuthology.orchestra.run.smithi148.stdout:506 Cannot talk to daemon 2023-12-03T11:19:51.379 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-03T11:19:51.387 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-03T11:19:51.403 INFO:teuthology.orchestra.run.smithi148.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-03T11:19:51.422 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2023-12-03T11:19:51.424 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T11:19:51.425 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2023-12-03T11:19:51.425 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:19:51.425 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:19:51.425 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:19:51.425 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:19:51.446 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2023-12-03T11:19:51.448 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T11:19:51.448 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2023-12-03T11:19:51.448 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:19:51.449 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:19:51.449 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:19:51.449 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T11:19:51.450 INFO:teuthology.run_tasks:Running task install... 2023-12-03T11:19:51.465 DEBUG:teuthology.task.install:project ceph 2023-12-03T11:19:51.465 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}} 2023-12-03T11:19:51.465 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'} 2023-12-03T11:19:51.465 INFO:teuthology.task.install:Using flavor: default 2023-12-03T11:19:51.486 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-03T11:19:51.486 INFO:teuthology.task.install:extra packages: [] 2023-12-03T11:19:51.487 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'tag': None, 'wait_for_package': False} 2023-12-03T11:19:51.488 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:19:51.492 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'tag': None, 'wait_for_package': False} 2023-12-03T11:19:51.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:19:51.636 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/ 2023-12-03T11:19:51.636 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7537.gbcbf278c 2023-12-03T11:19:51.641 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/ 2023-12-03T11:19:51.641 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7537.gbcbf278c 2023-12-03T11:19:51.745 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-03T11:19:51.745 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:19:51.746 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-03T11:19:51.774 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, s3cmd, s3cmd on remote rpm x86_64 2023-12-03T11:19:51.774 DEBUG:teuthology.orchestra.run.smithi148:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bcbf278cf395873c2a482f5a7b2345faf2160319/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-03T11:19:51.825 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-alimasa-multi-pubsub-etag/bcbf278cf395873c2a482f5a7b2345faf2160319/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-03T11:19:51.825 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:19:51.825 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-03T11:19:51.841 DEBUG:teuthology.orchestra.run.smithi148:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-03T11:19:51.852 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, s3cmd, s3cmd, s3cmd on remote rpm x86_64 2023-12-03T11:19:51.853 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bcbf278cf395873c2a482f5a7b2345faf2160319/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-03T11:19:51.922 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-03T11:19:51.923 DEBUG:teuthology.orchestra.run.smithi148:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-03T11:19:51.988 INFO:teuthology.orchestra.run.smithi148.stdout:check_obsoletes = 1 2023-12-03T11:19:51.990 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum clean all 2023-12-03T11:19:52.002 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-03T11:19:52.070 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2023-12-03T11:19:52.072 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2023-12-03T11:19:52.240 INFO:teuthology.orchestra.run.smithi148.stdout:73 files removed 2023-12-03T11:19:52.267 DEBUG:teuthology.orchestra.run.smithi148:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd s3cmd s3cmd s3cmd 2023-12-03T11:19:52.312 INFO:teuthology.orchestra.run.smithi131.stdout:73 files removed 2023-12-03T11:19:52.339 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd s3cmd s3cmd s3cmd 2023-12-03T11:19:53.295 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 122 kB/s | 78 kB 00:00 2023-12-03T11:19:53.304 INFO:teuthology.orchestra.run.smithi148.stdout:ceph packages for x86_64 109 kB/s | 78 kB 00:00 2023-12-03T11:19:53.663 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 30 kB/s | 9.5 kB 00:00 2023-12-03T11:19:53.755 INFO:teuthology.orchestra.run.smithi148.stdout:ceph noarch packages 24 kB/s | 9.5 kB 00:00 2023-12-03T11:19:54.030 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2023-12-03T11:19:54.163 INFO:teuthology.orchestra.run.smithi148.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2023-12-03T11:19:54.457 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-12-03T11:19:54.574 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-12-03T11:19:55.799 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2023-12-03T11:19:56.116 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2023-12-03T11:19:56.590 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 7.9 MB 00:00 2023-12-03T11:19:58.068 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 7.9 MB 00:01 2023-12-03T11:19:58.316 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 28 MB/s | 18 MB 00:00 2023-12-03T11:20:01.925 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - AppStream 6.6 MB/s | 18 MB 00:02 2023-12-03T11:20:02.692 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 5.9 MB/s | 5.8 MB 00:00 2023-12-03T11:20:04.101 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 15 kB 00:00 2023-12-03T11:20:06.038 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-03T11:20:06.425 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 5.8 MB 00:01 2023-12-03T11:20:08.334 INFO:teuthology.orchestra.run.smithi148.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 15 kB 00:00 2023-12-03T11:20:09.752 INFO:teuthology.orchestra.run.smithi148.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2023-12-03T11:20:10.772 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2023-12-03T11:20:13.477 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:20:13.478 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:20:13.547 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-12-03T11:20:13.565 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================ 2023-12-03T11:20:13.565 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2023-12-03T11:20:13.565 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================ 2023-12-03T11:20:13.565 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2023-12-03T11:20:13.565 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 6.6 k 2023-12-03T11:20:13.565 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 5.2 M 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 860 k 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 141 k 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 1.5 M 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 133 k 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 1.8 M 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 7.4 M 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 50 k 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 8.6 M 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 41 M 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 262 k 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 774 k 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 31 k 2023-12-03T11:20:13.566 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 718 k 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 126 k 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 162 k 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 320 k 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 298 k 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 99 k 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 85 k 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 170 k 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: s3cmd noarch 2.3.0-4.el9 epel 197 k 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.3 M 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-03T11:20:13.567 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 19 M 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 28 k 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 2.1 M 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 243 k 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.4 M 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 18 M 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 15 k 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 24 k 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-03T11:20:13.568 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 164 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 475 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.8 M 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-03T11:20:13.569 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 45 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 129 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-03T11:20:13.570 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-03T11:20:13.571 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-03T11:20:13.571 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-03T11:20:13.571 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-03T11:20:13.571 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-03T11:20:13.571 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-03T11:20:13.571 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-03T11:20:13.571 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-03T11:20:13.571 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-03T11:20:13.571 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-03T11:20:13.571 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-03T11:20:13.571 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-03T11:20:13.572 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-03T11:20:13.573 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================ 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout:Install 118 Packages 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 2 Packages 2023-12-03T11:20:13.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:20:13.575 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 181 M 2023-12-03T11:20:13.575 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-12-03T11:20:14.315 INFO:teuthology.orchestra.run.smithi131.stdout:(1/120): ceph-18.0.0-7537.gbcbf278c.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2023-12-03T11:20:14.394 INFO:teuthology.orchestra.run.smithi148.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2023-12-03T11:20:14.607 INFO:teuthology.orchestra.run.smithi131.stdout:(2/120): ceph-fuse-18.0.0-7537.gbcbf278c.el9.x8 2.9 MB/s | 860 kB 00:00 2023-12-03T11:20:14.749 INFO:teuthology.orchestra.run.smithi131.stdout:(3/120): ceph-base-18.0.0-7537.gbcbf278c.el9.x8 8.6 MB/s | 5.2 MB 00:00 2023-12-03T11:20:14.774 INFO:teuthology.orchestra.run.smithi131.stdout:(4/120): ceph-immutable-object-cache-18.0.0-753 846 kB/s | 141 kB 00:00 2023-12-03T11:20:14.933 INFO:teuthology.orchestra.run.smithi131.stdout:(5/120): ceph-mds-18.0.0-7537.gbcbf278c.el9.x86 11 MB/s | 2.1 MB 00:00 2023-12-03T11:20:15.258 INFO:teuthology.orchestra.run.smithi131.stdout:(6/120): ceph-mon-18.0.0-7537.gbcbf278c.el9.x86 13 MB/s | 4.4 MB 00:00 2023-12-03T11:20:15.300 INFO:teuthology.orchestra.run.smithi131.stdout:(7/120): ceph-mgr-18.0.0-7537.gbcbf278c.el9.x86 2.8 MB/s | 1.5 MB 00:00 2023-12-03T11:20:16.442 INFO:teuthology.orchestra.run.smithi131.stdout:(8/120): ceph-osd-18.0.0-7537.gbcbf278c.el9.x86 15 MB/s | 18 MB 00:01 2023-12-03T11:20:16.492 INFO:teuthology.orchestra.run.smithi131.stdout:(9/120): ceph-selinux-18.0.0-7537.gbcbf278c.el9 484 kB/s | 24 kB 00:00 2023-12-03T11:20:16.700 INFO:teuthology.orchestra.run.smithi131.stdout:(10/120): ceph-common-18.0.0-7537.gbcbf278c.el9 7.4 MB/s | 19 MB 00:02 2023-12-03T11:20:16.753 INFO:teuthology.orchestra.run.smithi131.stdout:(11/120): libcephfs-devel-18.0.0-7537.gbcbf278c 623 kB/s | 31 kB 00:00 2023-12-03T11:20:16.918 INFO:teuthology.orchestra.run.smithi131.stdout:(12/120): libcephfs2-18.0.0-7537.gbcbf278c.el9. 4.2 MB/s | 718 kB 00:00 2023-12-03T11:20:17.010 INFO:teuthology.orchestra.run.smithi131.stdout:(13/120): libcephsqlite-18.0.0-7537.gbcbf278c.e 1.7 MB/s | 164 kB 00:00 2023-12-03T11:20:17.081 INFO:teuthology.orchestra.run.smithi148.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:20:17.082 INFO:teuthology.orchestra.run.smithi148.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-03T11:20:17.111 INFO:teuthology.orchestra.run.smithi131.stdout:(14/120): ceph-radosgw-18.0.0-7537.gbcbf278c.el 4.8 MB/s | 8.6 MB 00:01 2023-12-03T11:20:17.135 INFO:teuthology.orchestra.run.smithi131.stdout:(15/120): librados-devel-18.0.0-7537.gbcbf278c. 1.0 MB/s | 126 kB 00:00 2023-12-03T11:20:17.151 INFO:teuthology.orchestra.run.smithi148.stdout:Dependencies resolved. 2023-12-03T11:20:17.169 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================================ 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout: Package Arch Version Repository Size 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================================ 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout:Installing: 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout: ceph x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 6.6 k 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 5.2 M 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 860 k 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 141 k 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 1.5 M 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 133 k 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 1.8 M 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 7.4 M 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 50 k 2023-12-03T11:20:17.170 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 8.6 M 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 41 M 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 262 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 774 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 31 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 718 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 126 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 162 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 320 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 298 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 99 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 85 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 170 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout: s3cmd noarch 2.3.0-4.el9 epel 197 k 2023-12-03T11:20:17.171 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrading: 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: librados2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.3 M 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 3.0 M 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout:Installing dependencies: 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 19 M 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 28 k 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 2.1 M 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 243 k 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.4 M 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 18 M 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7537.gbcbf278c.el9 ceph-noarch 15 k 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 24 k 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-03T11:20:17.172 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 164 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 475 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-03T11:20:17.173 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2 x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 4.8 M 2023-12-03T11:20:17.174 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-03T11:20:17.174 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-03T11:20:17.174 INFO:teuthology.orchestra.run.smithi148.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-03T11:20:17.174 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-03T11:20:17.174 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-03T11:20:17.174 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-03T11:20:17.174 INFO:teuthology.orchestra.run.smithi148.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-03T11:20:17.174 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-03T11:20:17.174 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-03T11:20:17.174 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 45 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common x86_64 2:18.0.0-7537.gbcbf278c.el9 ceph 129 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-03T11:20:17.175 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-03T11:20:17.176 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-03T11:20:17.177 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-03T11:20:17.177 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-03T11:20:17.177 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-03T11:20:17.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-03T11:20:17.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-03T11:20:17.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-03T11:20:17.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-03T11:20:17.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-03T11:20:17.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-03T11:20:17.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-03T11:20:17.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-03T11:20:17.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-03T11:20:17.178 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-03T11:20:17.179 INFO:teuthology.orchestra.run.smithi148.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-03T11:20:17.180 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-03T11:20:17.180 INFO:teuthology.orchestra.run.smithi148.stdout:Installing weak dependencies: 2023-12-03T11:20:17.180 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-03T11:20:17.180 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:20:17.180 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction Summary 2023-12-03T11:20:17.180 INFO:teuthology.orchestra.run.smithi148.stdout:============================================================================================ 2023-12-03T11:20:17.180 INFO:teuthology.orchestra.run.smithi148.stdout:Install 118 Packages 2023-12-03T11:20:17.180 INFO:teuthology.orchestra.run.smithi148.stdout:Upgrade 2 Packages 2023-12-03T11:20:17.180 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:20:17.181 INFO:teuthology.orchestra.run.smithi148.stdout:Total download size: 181 M 2023-12-03T11:20:17.181 INFO:teuthology.orchestra.run.smithi148.stdout:Downloading Packages: 2023-12-03T11:20:17.261 INFO:teuthology.orchestra.run.smithi131.stdout:(16/120): libradosstriper1-18.0.0-7537.gbcbf278 3.1 MB/s | 475 kB 00:00 2023-12-03T11:20:17.336 INFO:teuthology.orchestra.run.smithi131.stdout:(17/120): python3-ceph-argparse-18.0.0-7537.gbc 602 kB/s | 45 kB 00:00 2023-12-03T11:20:17.437 INFO:teuthology.orchestra.run.smithi131.stdout:(18/120): python3-ceph-common-18.0.0-7537.gbcbf 1.3 MB/s | 129 kB 00:00 2023-12-03T11:20:17.528 INFO:teuthology.orchestra.run.smithi131.stdout:(19/120): python3-cephfs-18.0.0-7537.gbcbf278c. 1.7 MB/s | 162 kB 00:00 2023-12-03T11:20:17.637 INFO:teuthology.orchestra.run.smithi131.stdout:(20/120): python3-rados-18.0.0-7537.gbcbf278c.e 2.9 MB/s | 320 kB 00:00 2023-12-03T11:20:17.737 INFO:teuthology.orchestra.run.smithi131.stdout:(21/120): python3-rbd-18.0.0-7537.gbcbf278c.el9 2.9 MB/s | 298 kB 00:00 2023-12-03T11:20:17.837 INFO:teuthology.orchestra.run.smithi131.stdout:(22/120): librgw2-18.0.0-7537.gbcbf278c.el9.x86 6.8 MB/s | 4.8 MB 00:00 2023-12-03T11:20:17.863 INFO:teuthology.orchestra.run.smithi131.stdout:(23/120): python3-rgw-18.0.0-7537.gbcbf278c.el9 793 kB/s | 99 kB 00:00 2023-12-03T11:20:17.878 INFO:teuthology.orchestra.run.smithi148.stdout:(1/120): ceph-18.0.0-7537.gbcbf278c.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2023-12-03T11:20:17.913 INFO:teuthology.orchestra.run.smithi131.stdout:(24/120): rbd-fuse-18.0.0-7537.gbcbf278c.el9.x8 1.1 MB/s | 85 kB 00:00 2023-12-03T11:20:18.130 INFO:teuthology.orchestra.run.smithi131.stdout:(25/120): rbd-nbd-18.0.0-7537.gbcbf278c.el9.x86 786 kB/s | 170 kB 00:00 2023-12-03T11:20:18.230 INFO:teuthology.orchestra.run.smithi131.stdout:(26/120): ceph-grafana-dashboards-18.0.0-7537.g 281 kB/s | 28 kB 00:00 2023-12-03T11:20:18.352 INFO:teuthology.orchestra.run.smithi131.stdout:(27/120): ceph-mgr-cephadm-18.0.0-7537.gbcbf278 1.1 MB/s | 133 kB 00:00 2023-12-03T11:20:18.472 INFO:teuthology.orchestra.run.smithi131.stdout:(28/120): rbd-mirror-18.0.0-7537.gbcbf278c.el9. 4.9 MB/s | 3.0 MB 00:00 2023-12-03T11:20:18.912 INFO:teuthology.orchestra.run.smithi148.stdout:(2/120): ceph-fuse-18.0.0-7537.gbcbf278c.el9.x8 832 kB/s | 860 kB 00:01 2023-12-03T11:20:18.979 INFO:teuthology.orchestra.run.smithi148.stdout:(3/120): ceph-immutable-object-cache-18.0.0-753 2.1 MB/s | 141 kB 00:00 2023-12-03T11:20:19.148 INFO:teuthology.orchestra.run.smithi131.stdout:(29/120): ceph-test-18.0.0-7537.gbcbf278c.el9.x 16 MB/s | 41 MB 00:02 2023-12-03T11:20:19.198 INFO:teuthology.orchestra.run.smithi131.stdout:(30/120): ceph-mgr-dashboard-18.0.0-7537.gbcbf2 2.1 MB/s | 1.8 MB 00:00 2023-12-03T11:20:19.223 INFO:teuthology.orchestra.run.smithi131.stdout:(31/120): ceph-mgr-modules-core-18.0.0-7537.gbc 3.2 MB/s | 243 kB 00:00 2023-12-03T11:20:19.257 INFO:teuthology.orchestra.run.smithi131.stdout:(32/120): ceph-mgr-rook-18.0.0-7537.gbcbf278c.e 861 kB/s | 50 kB 00:00 2023-12-03T11:20:19.290 INFO:teuthology.orchestra.run.smithi131.stdout:(33/120): ceph-prometheus-alerts-18.0.0-7537.gb 226 kB/s | 15 kB 00:00 2023-12-03T11:20:19.349 INFO:teuthology.orchestra.run.smithi131.stdout:(34/120): ceph-volume-18.0.0-7537.gbcbf278c.el9 2.8 MB/s | 262 kB 00:00 2023-12-03T11:20:19.424 INFO:teuthology.orchestra.run.smithi131.stdout:(35/120): cephadm-18.0.0-7537.gbcbf278c.el9.noa 5.7 MB/s | 774 kB 00:00 2023-12-03T11:20:19.429 INFO:teuthology.orchestra.run.smithi148.stdout:(4/120): ceph-mds-18.0.0-7537.gbcbf278c.el9.x86 4.6 MB/s | 2.1 MB 00:00 2023-12-03T11:20:19.491 INFO:teuthology.orchestra.run.smithi131.stdout:(36/120): flexiblas-3.0.4-8.el9.x86_64.rpm 484 kB/s | 32 kB 00:00 2023-12-03T11:20:19.516 INFO:teuthology.orchestra.run.smithi131.stdout:(37/120): boost-program-options-1.75.0-8.el9.x8 634 kB/s | 106 kB 00:00 2023-12-03T11:20:19.583 INFO:teuthology.orchestra.run.smithi131.stdout:(38/120): flexiblas-openblas-openmp-3.0.4-8.el9 259 kB/s | 17 kB 00:00 2023-12-03T11:20:19.643 INFO:teuthology.orchestra.run.smithi131.stdout:(39/120): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2023-12-03T11:20:19.663 INFO:teuthology.orchestra.run.smithi148.stdout:(5/120): ceph-base-18.0.0-7537.gbcbf278c.el9.x8 2.5 MB/s | 5.2 MB 00:02 2023-12-03T11:20:19.671 INFO:teuthology.orchestra.run.smithi131.stdout:(40/120): jq-1.6-16.el9.x86_64.rpm 2.1 MB/s | 186 kB 00:00 2023-12-03T11:20:19.696 INFO:teuthology.orchestra.run.smithi148.stdout:(6/120): ceph-mgr-18.0.0-7537.gbcbf278c.el9.x86 5.5 MB/s | 1.5 MB 00:00 2023-12-03T11:20:19.696 INFO:teuthology.orchestra.run.smithi131.stdout:(41/120): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.9 MB/s | 159 kB 00:00 2023-12-03T11:20:19.713 INFO:teuthology.orchestra.run.smithi131.stdout:(42/120): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-12-03T11:20:19.739 INFO:teuthology.orchestra.run.smithi131.stdout:(43/120): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 661 kB 00:00 2023-12-03T11:20:19.764 INFO:teuthology.orchestra.run.smithi131.stdout:(44/120): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2023-12-03T11:20:19.789 INFO:teuthology.orchestra.run.smithi131.stdout:(45/120): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-12-03T11:20:19.823 INFO:teuthology.orchestra.run.smithi131.stdout:(46/120): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2023-12-03T11:20:19.848 INFO:teuthology.orchestra.run.smithi131.stdout:(47/120): openblas-0.3.21-2.el9.x86_64.rpm 589 kB/s | 34 kB 00:00 2023-12-03T11:20:19.949 INFO:teuthology.orchestra.run.smithi131.stdout:(48/120): ceph-mgr-diskprediction-local-18.0.0- 5.0 MB/s | 7.4 MB 00:01 2023-12-03T11:20:20.024 INFO:teuthology.orchestra.run.smithi131.stdout:(49/120): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2023-12-03T11:20:20.080 INFO:teuthology.orchestra.run.smithi148.stdout:(7/120): ceph-mon-18.0.0-7537.gbcbf278c.el9.x86 11 MB/s | 4.4 MB 00:00 2023-12-03T11:20:20.116 INFO:teuthology.orchestra.run.smithi131.stdout:(50/120): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-12-03T11:20:20.141 INFO:teuthology.orchestra.run.smithi131.stdout:(51/120): python3-jinja2-2.11.3-4.el9.noarch.rp 1.2 MB/s | 228 kB 00:00 2023-12-03T11:20:20.166 INFO:teuthology.orchestra.run.smithi131.stdout:(52/120): python3-jsonpatch-1.21-16.el9.noarch. 175 kB/s | 24 kB 00:00 2023-12-03T11:20:20.192 INFO:teuthology.orchestra.run.smithi131.stdout:(53/120): python3-jsonpointer-2.0-4.el9.noarch. 242 kB/s | 18 kB 00:00 2023-12-03T11:20:20.217 INFO:teuthology.orchestra.run.smithi131.stdout:(54/120): python3-markupsafe-1.1.1-12.el9.x86_6 633 kB/s | 32 kB 00:00 2023-12-03T11:20:20.242 INFO:teuthology.orchestra.run.smithi131.stdout:(55/120): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-12-03T11:20:20.326 INFO:teuthology.orchestra.run.smithi131.stdout:(56/120): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-12-03T11:20:20.359 INFO:teuthology.orchestra.run.smithi131.stdout:(57/120): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2023-12-03T11:20:20.386 INFO:teuthology.orchestra.run.smithi131.stdout:(58/120): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2023-12-03T11:20:20.410 INFO:teuthology.orchestra.run.smithi131.stdout:(59/120): python3-prettytable-0.7.2-27.el9.noar 496 kB/s | 41 kB 00:00 2023-12-03T11:20:20.437 INFO:teuthology.orchestra.run.smithi131.stdout:(60/120): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-03T11:20:20.469 INFO:teuthology.orchestra.run.smithi131.stdout:(61/120): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 132 kB 00:00 2023-12-03T11:20:20.494 INFO:teuthology.orchestra.run.smithi131.stdout:(62/120): python3-pytz-2021.1-5.el9.noarch.rpm 569 kB/s | 47 kB 00:00 2023-12-03T11:20:20.519 INFO:teuthology.orchestra.run.smithi131.stdout:(63/120): python3-requests-oauthlib-1.3.0-12.el 514 kB/s | 43 kB 00:00 2023-12-03T11:20:20.544 INFO:teuthology.orchestra.run.smithi131.stdout:(64/120): python3-toml-0.10.2-6.el9.noarch.rpm 775 kB/s | 39 kB 00:00 2023-12-03T11:20:20.620 INFO:teuthology.orchestra.run.smithi131.stdout:(65/120): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 300 kB 00:00 2023-12-03T11:20:20.853 INFO:teuthology.orchestra.run.smithi131.stdout:(66/120): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2023-12-03T11:20:20.887 INFO:teuthology.orchestra.run.smithi131.stdout:(67/120): xmlstarlet-1.6.1-20.el9.x86_64.rpm 184 kB/s | 63 kB 00:00 2023-12-03T11:20:20.907 INFO:teuthology.orchestra.run.smithi148.stdout:(8/120): ceph-radosgw-18.0.0-7537.gbcbf278c.el9 10 MB/s | 8.6 MB 00:00 2023-12-03T11:20:20.913 INFO:teuthology.orchestra.run.smithi131.stdout:(68/120): fuse-2.9.9-15.el9.x86_64.rpm 271 kB/s | 79 kB 00:00 2023-12-03T11:20:20.946 INFO:teuthology.orchestra.run.smithi131.stdout:(69/120): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.5 MB/s | 803 kB 00:00 2023-12-03T11:20:20.971 INFO:teuthology.orchestra.run.smithi131.stdout:(70/120): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2023-12-03T11:20:20.988 INFO:teuthology.orchestra.run.smithi148.stdout:(9/120): ceph-selinux-18.0.0-7537.gbcbf278c.el9 289 kB/s | 24 kB 00:00 2023-12-03T11:20:20.997 INFO:teuthology.orchestra.run.smithi131.stdout:(71/120): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-12-03T11:20:21.030 INFO:teuthology.orchestra.run.smithi131.stdout:(72/120): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-12-03T11:20:21.055 INFO:teuthology.orchestra.run.smithi131.stdout:(73/120): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-12-03T11:20:21.081 INFO:teuthology.orchestra.run.smithi131.stdout:(74/120): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2023-12-03T11:20:21.106 INFO:teuthology.orchestra.run.smithi131.stdout:(75/120): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-12-03T11:20:21.132 INFO:teuthology.orchestra.run.smithi131.stdout:(76/120): python3-urllib3-1.26.5-4.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2023-12-03T11:20:21.232 INFO:teuthology.orchestra.run.smithi131.stdout:(77/120): lua-devel-5.4.4-4.el9.x86_64.rpm 223 kB/s | 22 kB 00:00 2023-12-03T11:20:21.330 INFO:teuthology.orchestra.run.smithi148.stdout:(10/120): ceph-osd-18.0.0-7537.gbcbf278c.el9.x8 11 MB/s | 18 MB 00:01 2023-12-03T11:20:21.348 INFO:teuthology.orchestra.run.smithi131.stdout:(78/120): python3-devel-3.9.17-2.el9.x86_64.rpm 918 kB/s | 245 kB 00:00 2023-12-03T11:20:21.381 INFO:teuthology.orchestra.run.smithi148.stdout:(11/120): libcephfs-devel-18.0.0-7537.gbcbf278c 626 kB/s | 31 kB 00:00 2023-12-03T11:20:21.481 INFO:teuthology.orchestra.run.smithi148.stdout:(12/120): libcephfs2-18.0.0-7537.gbcbf278c.el9. 7.0 MB/s | 718 kB 00:00 2023-12-03T11:20:21.482 INFO:teuthology.orchestra.run.smithi131.stdout:(79/120): gperftools-libs-2.9.1-2.el9.x86_64.rp 882 kB/s | 309 kB 00:00 2023-12-03T11:20:21.539 INFO:teuthology.orchestra.run.smithi148.stdout:(13/120): libcephsqlite-18.0.0-7537.gbcbf278c.e 2.8 MB/s | 164 kB 00:00 2023-12-03T11:20:21.541 INFO:teuthology.orchestra.run.smithi131.stdout:(80/120): liboath-2.6.7-2.el9.x86_64.rpm 829 kB/s | 49 kB 00:00 2023-12-03T11:20:21.566 INFO:teuthology.orchestra.run.smithi131.stdout:(81/120): libarrow-doc-9.0.0-9.el9.noarch.rpm 113 kB/s | 24 kB 00:00 2023-12-03T11:20:21.581 INFO:teuthology.orchestra.run.smithi148.stdout:(14/120): librados-devel-18.0.0-7537.gbcbf278c. 3.0 MB/s | 126 kB 00:00 2023-12-03T11:20:21.608 INFO:teuthology.orchestra.run.smithi131.stdout:(82/120): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2023-12-03T11:20:21.665 INFO:teuthology.orchestra.run.smithi148.stdout:(15/120): libradosstriper1-18.0.0-7537.gbcbf278 5.6 MB/s | 475 kB 00:00 2023-12-03T11:20:21.708 INFO:teuthology.orchestra.run.smithi131.stdout:(83/120): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2023-12-03T11:20:21.783 INFO:teuthology.orchestra.run.smithi131.stdout:(84/120): parquet-libs-9.0.0-9.el9.x86_64.rpm 4.7 MB/s | 837 kB 00:00 2023-12-03T11:20:21.850 INFO:teuthology.orchestra.run.smithi131.stdout:(85/120): libarrow-9.0.0-9.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2023-12-03T11:20:21.876 INFO:teuthology.orchestra.run.smithi131.stdout:(86/120): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 472 kB/s | 43 kB 00:00 2023-12-03T11:20:21.910 INFO:teuthology.orchestra.run.smithi131.stdout:(87/120): python3-asyncssh-2.13.2-3.el9.noarch. 2.7 MB/s | 548 kB 00:00 2023-12-03T11:20:21.935 INFO:teuthology.orchestra.run.smithi131.stdout:(88/120): python3-cachetools-4.2.4-1.el9.noarch 384 kB/s | 32 kB 00:00 2023-12-03T11:20:21.960 INFO:teuthology.orchestra.run.smithi131.stdout:(89/120): python3-certifi-2021.10.8-2.el9.noarc 178 kB/s | 15 kB 00:00 2023-12-03T11:20:21.985 INFO:teuthology.orchestra.run.smithi131.stdout:(90/120): python3-cheroot-8.6.0-4.el9.noarch.rp 2.2 MB/s | 172 kB 00:00 2023-12-03T11:20:22.019 INFO:teuthology.orchestra.run.smithi131.stdout:(91/120): python3-google-auth-2.23.4-1.el9.noar 3.3 MB/s | 197 kB 00:00 2023-12-03T11:20:22.069 INFO:teuthology.orchestra.run.smithi131.stdout:(92/120): python3-cherrypy-18.6.1-2.el9.noarch. 2.6 MB/s | 358 kB 00:00 2023-12-03T11:20:22.095 INFO:teuthology.orchestra.run.smithi131.stdout:(93/120): python3-jaraco-8.2.1-3.el9.noarch.rpm 98 kB/s | 11 kB 00:00 2023-12-03T11:20:22.120 INFO:teuthology.orchestra.run.smithi131.stdout:(94/120): python3-jaraco-classes-3.2.1-5.el9.no 175 kB/s | 18 kB 00:00 2023-12-03T11:20:22.145 INFO:teuthology.orchestra.run.smithi131.stdout:(95/120): python3-jaraco-collections-3.0.0-8.el 306 kB/s | 23 kB 00:00 2023-12-03T11:20:22.170 INFO:teuthology.orchestra.run.smithi131.stdout:(96/120): python3-jaraco-functools-3.5.0-2.el9. 258 kB/s | 19 kB 00:00 2023-12-03T11:20:22.204 INFO:teuthology.orchestra.run.smithi131.stdout:(97/120): python3-jaraco-text-3.2.0-6.el9.noarc 234 kB/s | 20 kB 00:00 2023-12-03T11:20:22.230 INFO:teuthology.orchestra.run.smithi131.stdout:(98/120): python3-jwt+crypto-2.4.0-1.el9.noarch 107 kB/s | 9.0 kB 00:00 2023-12-03T11:20:22.240 INFO:teuthology.orchestra.run.smithi148.stdout:(16/120): ceph-common-18.0.0-7537.gbcbf278c.el9 4.1 MB/s | 19 MB 00:04 2023-12-03T11:20:22.255 INFO:teuthology.orchestra.run.smithi131.stdout:(99/120): python3-jwt-2.4.0-1.el9.noarch.rpm 486 kB/s | 41 kB 00:00 2023-12-03T11:20:22.297 INFO:teuthology.orchestra.run.smithi131.stdout:(100/120): python3-logutils-0.3.5-21.el9.noarch 693 kB/s | 46 kB 00:00 2023-12-03T11:20:22.310 INFO:teuthology.orchestra.run.smithi148.stdout:(17/120): librgw2-18.0.0-7537.gbcbf278c.el9.x86 7.4 MB/s | 4.8 MB 00:00 2023-12-03T11:20:22.322 INFO:teuthology.orchestra.run.smithi131.stdout:(101/120): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2023-12-03T11:20:22.324 INFO:teuthology.orchestra.run.smithi148.stdout:(18/120): python3-ceph-argparse-18.0.0-7537.gbc 540 kB/s | 45 kB 00:00 2023-12-03T11:20:22.356 INFO:teuthology.orchestra.run.smithi131.stdout:(102/120): python3-natsort-7.1.1-5.el9.noarch.r 988 kB/s | 58 kB 00:00 2023-12-03T11:20:22.358 INFO:teuthology.orchestra.run.smithi148.stdout:(19/120): python3-ceph-common-18.0.0-7537.gbcbf 2.5 MB/s | 129 kB 00:00 2023-12-03T11:20:22.383 INFO:teuthology.orchestra.run.smithi148.stdout:(20/120): python3-cephfs-18.0.0-7537.gbcbf278c. 2.7 MB/s | 162 kB 00:00 2023-12-03T11:20:22.389 INFO:teuthology.orchestra.run.smithi131.stdout:(103/120): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2023-12-03T11:20:22.408 INFO:teuthology.orchestra.run.smithi148.stdout:(21/120): python3-rados-18.0.0-7537.gbcbf278c.e 6.2 MB/s | 320 kB 00:00 2023-12-03T11:20:22.415 INFO:teuthology.orchestra.run.smithi131.stdout:(104/120): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2023-12-03T11:20:22.440 INFO:teuthology.orchestra.run.smithi131.stdout:(105/120): python3-portend-3.1.0-2.el9.noarch.r 195 kB/s | 16 kB 00:00 2023-12-03T11:20:22.465 INFO:teuthology.orchestra.run.smithi131.stdout:(106/120): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-12-03T11:20:22.467 INFO:teuthology.orchestra.run.smithi148.stdout:(22/120): python3-rbd-18.0.0-7537.gbcbf278c.el9 3.5 MB/s | 298 kB 00:00 2023-12-03T11:20:22.490 INFO:teuthology.orchestra.run.smithi131.stdout:(107/120): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2023-12-03T11:20:22.492 INFO:teuthology.orchestra.run.smithi148.stdout:(23/120): python3-rgw-18.0.0-7537.gbcbf278c.el9 1.2 MB/s | 99 kB 00:00 2023-12-03T11:20:22.516 INFO:teuthology.orchestra.run.smithi131.stdout:(108/120): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2023-12-03T11:20:22.526 INFO:teuthology.orchestra.run.smithi148.stdout:(24/120): rbd-fuse-18.0.0-7537.gbcbf278c.el9.x8 1.4 MB/s | 85 kB 00:00 2023-12-03T11:20:22.541 INFO:teuthology.orchestra.run.smithi131.stdout:(109/120): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2023-12-03T11:20:22.566 INFO:teuthology.orchestra.run.smithi131.stdout:(110/120): python3-tempora-5.0.0-2.el9.noarch.r 473 kB/s | 36 kB 00:00 2023-12-03T11:20:22.592 INFO:teuthology.orchestra.run.smithi131.stdout:(111/120): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2023-12-03T11:20:22.617 INFO:teuthology.orchestra.run.smithi131.stdout:(112/120): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2023-12-03T11:20:22.626 INFO:teuthology.orchestra.run.smithi148.stdout:(25/120): rbd-nbd-18.0.0-7537.gbcbf278c.el9.x86 1.7 MB/s | 170 kB 00:00 2023-12-03T11:20:22.642 INFO:teuthology.orchestra.run.smithi131.stdout:(113/120): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2023-12-03T11:20:22.668 INFO:teuthology.orchestra.run.smithi131.stdout:(114/120): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2023-12-03T11:20:22.693 INFO:teuthology.orchestra.run.smithi131.stdout:(115/120): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2023-12-03T11:20:22.718 INFO:teuthology.orchestra.run.smithi148.stdout:(26/120): ceph-grafana-dashboards-18.0.0-7537.g 305 kB/s | 28 kB 00:00 2023-12-03T11:20:22.719 INFO:teuthology.orchestra.run.smithi131.stdout:(116/120): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2023-12-03T11:20:22.743 INFO:teuthology.orchestra.run.smithi131.stdout:(117/120): s3cmd-2.3.0-4.el9.noarch.rpm 2.5 MB/s | 197 kB 00:00 2023-12-03T11:20:22.777 INFO:teuthology.orchestra.run.smithi148.stdout:(27/120): rbd-mirror-18.0.0-7537.gbcbf278c.el9. 11 MB/s | 3.0 MB 00:00 2023-12-03T11:20:22.802 INFO:teuthology.orchestra.run.smithi148.stdout:(28/120): ceph-mgr-cephadm-18.0.0-7537.gbcbf278 1.6 MB/s | 133 kB 00:00 2023-12-03T11:20:22.902 INFO:teuthology.orchestra.run.smithi131.stdout:(118/120): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2023-12-03T11:20:23.021 INFO:teuthology.orchestra.run.smithi148.stdout:(29/120): ceph-mgr-dashboard-18.0.0-7537.gbcbf2 7.2 MB/s | 1.8 MB 00:00 2023-12-03T11:20:23.105 INFO:teuthology.orchestra.run.smithi148.stdout:(30/120): ceph-mgr-modules-core-18.0.0-7537.gbc 2.8 MB/s | 243 kB 00:00 2023-12-03T11:20:23.172 INFO:teuthology.orchestra.run.smithi148.stdout:(31/120): ceph-mgr-rook-18.0.0-7537.gbcbf278c.e 755 kB/s | 50 kB 00:00 2023-12-03T11:20:23.231 INFO:teuthology.orchestra.run.smithi148.stdout:(32/120): ceph-prometheus-alerts-18.0.0-7537.gb 260 kB/s | 15 kB 00:00 2023-12-03T11:20:23.298 INFO:teuthology.orchestra.run.smithi148.stdout:(33/120): ceph-volume-18.0.0-7537.gbcbf278c.el9 3.8 MB/s | 262 kB 00:00 2023-12-03T11:20:23.473 INFO:teuthology.orchestra.run.smithi148.stdout:(34/120): cephadm-18.0.0-7537.gbcbf278c.el9.noa 4.3 MB/s | 774 kB 00:00 2023-12-03T11:20:23.574 INFO:teuthology.orchestra.run.smithi148.stdout:(35/120): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 106 kB 00:00 2023-12-03T11:20:23.599 INFO:teuthology.orchestra.run.smithi148.stdout:(36/120): flexiblas-3.0.4-8.el9.x86_64.rpm 1.2 MB/s | 32 kB 00:00 2023-12-03T11:20:23.716 INFO:teuthology.orchestra.run.smithi148.stdout:(37/120): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2023-12-03T11:20:23.741 INFO:teuthology.orchestra.run.smithi148.stdout:(38/120): flexiblas-openblas-openmp-3.0.4-8.el9 691 kB/s | 17 kB 00:00 2023-12-03T11:20:23.775 INFO:teuthology.orchestra.run.smithi148.stdout:(39/120): jq-1.6-16.el9.x86_64.rpm 5.5 MB/s | 186 kB 00:00 2023-12-03T11:20:23.809 INFO:teuthology.orchestra.run.smithi148.stdout:(40/120): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.6 MB/s | 159 kB 00:00 2023-12-03T11:20:23.819 INFO:teuthology.orchestra.run.smithi131.stdout:(119/120): librados2-18.0.0-7537.gbcbf278c.el9. 3.0 MB/s | 3.3 MB 00:01 2023-12-03T11:20:23.834 INFO:teuthology.orchestra.run.smithi148.stdout:(41/120): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.7 MB/s | 44 kB 00:00 2023-12-03T11:20:23.934 INFO:teuthology.orchestra.run.smithi148.stdout:(42/120): ceph-mgr-diskprediction-local-18.0.0- 6.5 MB/s | 7.4 MB 00:01 2023-12-03T11:20:23.960 INFO:teuthology.orchestra.run.smithi148.stdout:(43/120): librdkafka-1.6.1-102.el9.x86_64.rpm 5.1 MB/s | 661 kB 00:00 2023-12-03T11:20:23.985 INFO:teuthology.orchestra.run.smithi148.stdout:(44/120): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.6 MB/s | 282 kB 00:00 2023-12-03T11:20:24.011 INFO:teuthology.orchestra.run.smithi148.stdout:(45/120): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-12-03T11:20:24.035 INFO:teuthology.orchestra.run.smithi148.stdout:(46/120): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2023-12-03T11:20:24.052 INFO:teuthology.orchestra.run.smithi148.stdout:(47/120): openblas-0.3.21-2.el9.x86_64.rpm 824 kB/s | 34 kB 00:00 2023-12-03T11:20:24.194 INFO:teuthology.orchestra.run.smithi131.stdout:(120/120): librbd1-18.0.0-7537.gbcbf278c.el9.x8 2.1 MB/s | 3.0 MB 00:01 2023-12-03T11:20:24.201 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:20:24.201 INFO:teuthology.orchestra.run.smithi131.stdout:Total 17 MB/s | 181 MB 00:10 2023-12-03T11:20:24.227 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-12-03T11:20:24.324 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-12-03T11:20:24.324 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-12-03T11:20:24.428 INFO:teuthology.orchestra.run.smithi148.stdout:(48/120): ceph-test-18.0.0-7537.gbcbf278c.el9.x 12 MB/s | 41 MB 00:03 2023-12-03T11:20:24.503 INFO:teuthology.orchestra.run.smithi148.stdout:(49/120): openblas-openmp-0.3.21-2.el9.x86_64.r 10 MB/s | 4.7 MB 00:00 2023-12-03T11:20:24.595 INFO:teuthology.orchestra.run.smithi148.stdout:(50/120): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 5.8 MB 00:00 2023-12-03T11:20:24.620 INFO:teuthology.orchestra.run.smithi148.stdout:(51/120): python3-jinja2-2.11.3-4.el9.noarch.rp 1.2 MB/s | 228 kB 00:00 2023-12-03T11:20:24.645 INFO:teuthology.orchestra.run.smithi148.stdout:(52/120): python3-jsonpatch-1.21-16.el9.noarch. 176 kB/s | 24 kB 00:00 2023-12-03T11:20:24.670 INFO:teuthology.orchestra.run.smithi148.stdout:(53/120): python3-jsonpointer-2.0-4.el9.noarch. 242 kB/s | 18 kB 00:00 2023-12-03T11:20:24.696 INFO:teuthology.orchestra.run.smithi148.stdout:(54/120): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-12-03T11:20:24.721 INFO:teuthology.orchestra.run.smithi148.stdout:(55/120): python3-markupsafe-1.1.1-12.el9.x86_6 420 kB/s | 32 kB 00:00 2023-12-03T11:20:24.813 INFO:teuthology.orchestra.run.smithi148.stdout:(56/120): python3-numpy-1.20.1-5.el9.x86_64.rpm 34 MB/s | 4.8 MB 00:00 2023-12-03T11:20:24.838 INFO:teuthology.orchestra.run.smithi148.stdout:(57/120): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.9 MB/s | 217 kB 00:00 2023-12-03T11:20:24.863 INFO:teuthology.orchestra.run.smithi148.stdout:(58/120): python3-oauthlib-3.1.1-5.el9.noarch.r 1.2 MB/s | 174 kB 00:00 2023-12-03T11:20:24.888 INFO:teuthology.orchestra.run.smithi148.stdout:(59/120): python3-prettytable-0.7.2-27.el9.noar 548 kB/s | 41 kB 00:00 2023-12-03T11:20:24.905 INFO:teuthology.orchestra.run.smithi148.stdout:(60/120): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2023-12-03T11:20:24.930 INFO:teuthology.orchestra.run.smithi148.stdout:(61/120): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2023-12-03T11:20:24.956 INFO:teuthology.orchestra.run.smithi148.stdout:(62/120): python3-pytz-2021.1-5.el9.noarch.rpm 707 kB/s | 47 kB 00:00 2023-12-03T11:20:24.981 INFO:teuthology.orchestra.run.smithi148.stdout:(63/120): python3-requests-oauthlib-1.3.0-12.el 854 kB/s | 43 kB 00:00 2023-12-03T11:20:25.206 INFO:teuthology.orchestra.run.smithi148.stdout:(64/120): python3-toml-0.10.2-6.el9.noarch.rpm 156 kB/s | 39 kB 00:00 2023-12-03T11:20:25.440 INFO:teuthology.orchestra.run.smithi148.stdout:(65/120): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2023-12-03T11:20:25.465 INFO:teuthology.orchestra.run.smithi148.stdout:(66/120): socat-1.7.4.1-5.el9.x86_64.rpm 623 kB/s | 300 kB 00:00 2023-12-03T11:20:25.482 INFO:teuthology.orchestra.run.smithi148.stdout:(67/120): xmlstarlet-1.6.1-20.el9.x86_64.rpm 229 kB/s | 63 kB 00:00 2023-12-03T11:20:25.507 INFO:teuthology.orchestra.run.smithi148.stdout:(68/120): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 79 kB 00:00 2023-12-03T11:20:25.541 INFO:teuthology.orchestra.run.smithi148.stdout:(69/120): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-12-03T11:20:25.574 INFO:teuthology.orchestra.run.smithi148.stdout:(70/120): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.5 MB/s | 803 kB 00:00 2023-12-03T11:20:25.599 INFO:teuthology.orchestra.run.smithi148.stdout:(71/120): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2023-12-03T11:20:25.633 INFO:teuthology.orchestra.run.smithi148.stdout:(72/120): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2023-12-03T11:20:25.658 INFO:teuthology.orchestra.run.smithi148.stdout:(73/120): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2023-12-03T11:20:25.684 INFO:teuthology.orchestra.run.smithi148.stdout:(74/120): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2023-12-03T11:20:25.709 INFO:teuthology.orchestra.run.smithi148.stdout:(75/120): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-12-03T11:20:25.734 INFO:teuthology.orchestra.run.smithi148.stdout:(76/120): python3-urllib3-1.26.5-4.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2023-12-03T11:20:25.874 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-12-03T11:20:25.875 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-12-03T11:20:26.159 INFO:teuthology.orchestra.run.smithi148.stdout:(77/120): lua-devel-5.4.4-4.el9.x86_64.rpm 50 kB/s | 22 kB 00:00 2023-12-03T11:20:26.368 INFO:teuthology.orchestra.run.smithi148.stdout:(78/120): python3-devel-3.9.17-2.el9.x86_64.rpm 359 kB/s | 245 kB 00:00 2023-12-03T11:20:26.527 INFO:teuthology.orchestra.run.smithi148.stdout:(79/120): gperftools-libs-2.9.1-2.el9.x86_64.rp 390 kB/s | 309 kB 00:00 2023-12-03T11:20:26.669 INFO:teuthology.orchestra.run.smithi148.stdout:(80/120): liboath-2.6.7-2.el9.x86_64.rpm 343 kB/s | 49 kB 00:00 2023-12-03T11:20:26.819 INFO:teuthology.orchestra.run.smithi148.stdout:(81/120): libarrow-doc-9.0.0-9.el9.noarch.rpm 54 kB/s | 24 kB 00:00 2023-12-03T11:20:26.853 INFO:teuthology.orchestra.run.smithi148.stdout:(82/120): libunwind-1.6.2-1.el9.x86_64.rpm 366 kB/s | 67 kB 00:00 2023-12-03T11:20:27.186 INFO:teuthology.orchestra.run.smithi148.stdout:(83/120): parquet-libs-9.0.0-9.el9.x86_64.rpm 2.5 MB/s | 837 kB 00:00 2023-12-03T11:20:27.212 INFO:teuthology.orchestra.run.smithi148.stdout:(84/120): luarocks-3.9.2-1.el9.noarch.rpm 385 kB/s | 151 kB 00:00 2023-12-03T11:20:27.354 INFO:teuthology.orchestra.run.smithi148.stdout:(85/120): libarrow-9.0.0-9.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2023-12-03T11:20:27.379 INFO:teuthology.orchestra.run.smithi148.stdout:(86/120): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 261 kB/s | 43 kB 00:00 2023-12-03T11:20:27.404 INFO:teuthology.orchestra.run.smithi148.stdout:(87/120): python3-asyncssh-2.13.2-3.el9.noarch. 2.5 MB/s | 548 kB 00:00 2023-12-03T11:20:27.471 INFO:teuthology.orchestra.run.smithi148.stdout:(88/120): python3-cachetools-4.2.4-1.el9.noarch 275 kB/s | 32 kB 00:00 2023-12-03T11:20:27.505 INFO:teuthology.orchestra.run.smithi148.stdout:(89/120): python3-certifi-2021.10.8-2.el9.noarc 119 kB/s | 15 kB 00:00 2023-12-03T11:20:27.555 INFO:teuthology.orchestra.run.smithi148.stdout:(90/120): python3-cheroot-8.6.0-4.el9.noarch.rp 1.1 MB/s | 172 kB 00:00 2023-12-03T11:20:27.606 INFO:teuthology.orchestra.run.smithi148.stdout:(91/120): python3-cherrypy-18.6.1-2.el9.noarch. 2.6 MB/s | 358 kB 00:00 2023-12-03T11:20:27.680 INFO:teuthology.orchestra.run.smithi148.stdout:(92/120): python3-jaraco-8.2.1-3.el9.noarch.rpm 85 kB/s | 11 kB 00:00 2023-12-03T11:20:27.706 INFO:teuthology.orchestra.run.smithi148.stdout:(93/120): python3-google-auth-2.23.4-1.el9.noar 985 kB/s | 197 kB 00:00 2023-12-03T11:20:27.748 INFO:teuthology.orchestra.run.smithi148.stdout:(94/120): python3-jaraco-classes-3.2.1-5.el9.no 124 kB/s | 18 kB 00:00 2023-12-03T11:20:27.831 INFO:teuthology.orchestra.run.smithi148.stdout:(95/120): python3-jaraco-collections-3.0.0-8.el 154 kB/s | 23 kB 00:00 2023-12-03T11:20:27.856 INFO:teuthology.orchestra.run.smithi148.stdout:(96/120): python3-jaraco-functools-3.5.0-2.el9. 129 kB/s | 19 kB 00:00 2023-12-03T11:20:27.882 INFO:teuthology.orchestra.run.smithi148.stdout:(97/120): python3-jaraco-text-3.2.0-6.el9.noarc 147 kB/s | 20 kB 00:00 2023-12-03T11:20:27.949 INFO:teuthology.orchestra.run.smithi148.stdout:(98/120): python3-jwt+crypto-2.4.0-1.el9.noarch 77 kB/s | 9.0 kB 00:00 2023-12-03T11:20:28.066 INFO:teuthology.orchestra.run.smithi148.stdout:(99/120): python3-jwt-2.4.0-1.el9.noarch.rpm 196 kB/s | 41 kB 00:00 2023-12-03T11:20:28.091 INFO:teuthology.orchestra.run.smithi148.stdout:(100/120): python3-logutils-0.3.5-21.el9.noarch 326 kB/s | 46 kB 00:00 2023-12-03T11:20:28.125 INFO:teuthology.orchestra.run.smithi148.stdout:(101/120): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2023-12-03T11:20:28.233 INFO:teuthology.orchestra.run.smithi148.stdout:(102/120): python3-more-itertools-8.12.0-2.el9. 472 kB/s | 79 kB 00:00 2023-12-03T11:20:28.250 INFO:teuthology.orchestra.run.smithi148.stdout:(103/120): python3-natsort-7.1.1-5.el9.noarch.r 363 kB/s | 58 kB 00:00 2023-12-03T11:20:28.275 INFO:teuthology.orchestra.run.smithi148.stdout:(104/120): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2023-12-03T11:20:28.376 INFO:teuthology.orchestra.run.smithi148.stdout:(105/120): python3-pyOpenSSL-21.0.0-1.el9.noarc 718 kB/s | 90 kB 00:00 2023-12-03T11:20:28.392 INFO:teuthology.orchestra.run.smithi148.stdout:(106/120): python3-portend-3.1.0-2.el9.noarch.r 103 kB/s | 16 kB 00:00 2023-12-03T11:20:28.409 INFO:teuthology.orchestra.run.smithi148.stdout:(107/120): python3-repoze-lru-0.7-16.el9.noarch 230 kB/s | 31 kB 00:00 2023-12-03T11:20:28.510 INFO:teuthology.orchestra.run.smithi148.stdout:(108/120): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2023-12-03T11:20:28.526 INFO:teuthology.orchestra.run.smithi148.stdout:(109/120): python3-rsa-4.9-2.el9.noarch.rpm 506 kB/s | 59 kB 00:00 2023-12-03T11:20:28.561 INFO:teuthology.orchestra.run.smithi148.stdout:(110/120): python3-tempora-5.0.0-2.el9.noarch.r 237 kB/s | 36 kB 00:00 2023-12-03T11:20:28.644 INFO:teuthology.orchestra.run.smithi148.stdout:(111/120): python3-typing-extensions-4.4.0-2.el 380 kB/s | 51 kB 00:00 2023-12-03T11:20:28.669 INFO:teuthology.orchestra.run.smithi148.stdout:(112/120): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2023-12-03T11:20:28.703 INFO:teuthology.orchestra.run.smithi148.stdout:(113/120): python3-websocket-client-1.2.3-2.el9 629 kB/s | 90 kB 00:00 2023-12-03T11:20:28.786 INFO:teuthology.orchestra.run.smithi148.stdout:(114/120): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2023-12-03T11:20:28.812 INFO:teuthology.orchestra.run.smithi148.stdout:(115/120): python3-werkzeug-2.0.3-3.el9.1.noarc 2.5 MB/s | 427 kB 00:00 2023-12-03T11:20:28.904 INFO:teuthology.orchestra.run.smithi148.stdout:(116/120): re2-20211101-3.el9.x86_64.rpm 957 kB/s | 192 kB 00:00 2023-12-03T11:20:28.929 INFO:teuthology.orchestra.run.smithi148.stdout:(117/120): s3cmd-2.3.0-4.el9.noarch.rpm 1.4 MB/s | 197 kB 00:00 2023-12-03T11:20:29.088 INFO:teuthology.orchestra.run.smithi148.stdout:(118/120): thrift-0.15.0-2.el9.x86_64.rpm 5.7 MB/s | 1.6 MB 00:00 2023-12-03T11:20:29.280 INFO:teuthology.orchestra.run.smithi148.stdout:(119/120): librbd1-18.0.0-7537.gbcbf278c.el9.x8 8.5 MB/s | 3.0 MB 00:00 2023-12-03T11:20:29.330 INFO:teuthology.orchestra.run.smithi148.stdout:(120/120): librados2-18.0.0-7537.gbcbf278c.el9. 7.8 MB/s | 3.3 MB 00:00 2023-12-03T11:20:29.336 INFO:teuthology.orchestra.run.smithi148.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:20:29.336 INFO:teuthology.orchestra.run.smithi148.stdout:Total 15 MB/s | 181 MB 00:12 2023-12-03T11:20:29.356 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction check 2023-12-03T11:20:29.446 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction check succeeded. 2023-12-03T11:20:29.446 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction test 2023-12-03T11:20:30.690 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-12-03T11:20:30.764 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/122 2023-12-03T11:20:30.789 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/122 2023-12-03T11:20:30.835 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/122 2023-12-03T11:20:30.866 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/122 2023-12-03T11:20:30.927 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/122 2023-12-03T11:20:30.940 INFO:teuthology.orchestra.run.smithi148.stdout:Transaction test succeeded. 2023-12-03T11:20:30.940 INFO:teuthology.orchestra.run.smithi148.stdout:Running transaction 2023-12-03T11:20:31.262 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/122 2023-12-03T11:20:31.326 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:20:31.435 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:20:31.467 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:20:31.558 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:20:31.609 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:20:31.635 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:20:31.737 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:20:31.761 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:20:31.889 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:20:31.923 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/122 2023-12-03T11:20:31.994 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/122 2023-12-03T11:20:32.055 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 14/122 2023-12-03T11:20:32.089 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 15/122 2023-12-03T11:20:32.129 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 16/122 2023-12-03T11:20:32.169 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 17/122 2023-12-03T11:20:32.234 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 18/122 2023-12-03T11:20:32.269 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 19/122 2023-12-03T11:20:32.311 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 20/122 2023-12-03T11:20:32.338 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/122 2023-12-03T11:20:32.408 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/122 2023-12-03T11:20:32.451 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 23/122 2023-12-03T11:20:32.503 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 24/122 2023-12-03T11:20:32.532 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 25/122 2023-12-03T11:20:32.606 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 26/122 2023-12-03T11:20:32.679 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : luarocks-3.9.2-1.el9.noarch 27/122 2023-12-03T11:20:32.816 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 28/122 2023-12-03T11:20:32.874 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 29/122 2023-12-03T11:20:33.399 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el9.noarch 30/122 2023-12-03T11:20:33.478 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 31/122 2023-12-03T11:20:33.516 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 32/122 2023-12-03T11:20:33.554 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 33/122 2023-12-03T11:20:33.585 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 34/122 2023-12-03T11:20:33.691 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/122 2023-12-03T11:20:33.721 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 36/122 2023-12-03T11:20:33.785 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/122 2023-12-03T11:20:33.866 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/122 2023-12-03T11:20:33.897 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/122 2023-12-03T11:20:33.934 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/122 2023-12-03T11:20:33.981 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/122 2023-12-03T11:20:34.026 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/122 2023-12-03T11:20:34.068 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/122 2023-12-03T11:20:34.204 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/122 2023-12-03T11:20:34.245 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/122 2023-12-03T11:20:34.286 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/122 2023-12-03T11:20:34.381 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/122 2023-12-03T11:20:34.420 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 48/122 2023-12-03T11:20:34.462 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/122 2023-12-03T11:20:34.493 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/122 2023-12-03T11:20:34.590 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 51/122 2023-12-03T11:20:34.638 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 52/122 2023-12-03T11:20:34.687 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ply-3.11-14.el9.noarch 53/122 2023-12-03T11:20:34.743 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 54/122 2023-12-03T11:20:34.944 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 55/122 2023-12-03T11:20:35.001 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 56/122 2023-12-03T11:20:35.148 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 57/122 2023-12-03T11:20:35.195 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 58/122 2023-12-03T11:20:35.224 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 59/122 2023-12-03T11:20:35.258 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 60/122 2023-12-03T11:20:35.291 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 61/122 2023-12-03T11:20:35.323 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.9-15.el9.x86_64 62/122 2023-12-03T11:20:35.368 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 63/122 2023-12-03T11:20:35.403 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 64/122 2023-12-03T11:20:35.441 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:20:35.526 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/122 2023-12-03T11:20:35.560 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 67/122 2023-12-03T11:20:35.593 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/122 2023-12-03T11:20:35.635 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/122 2023-12-03T11:20:35.669 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/122 2023-12-03T11:20:35.693 INFO:teuthology.orchestra.run.smithi148.stdout: Preparing : 1/1 2023-12-03T11:20:35.759 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/122 2023-12-03T11:20:35.773 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/122 2023-12-03T11:20:35.797 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 72/122 2023-12-03T11:20:35.799 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/122 2023-12-03T11:20:35.845 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/122 2023-12-03T11:20:35.876 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/122 2023-12-03T11:20:35.909 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/122 2023-12-03T11:20:35.928 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/122 2023-12-03T11:20:35.965 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/122 2023-12-03T11:20:36.257 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 6/122 2023-12-03T11:20:36.334 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:20:36.454 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:20:36.485 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:20:36.576 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:20:36.617 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:20:36.645 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:20:36.706 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/122 2023-12-03T11:20:36.746 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:20:36.771 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:20:36.897 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 11/122 2023-12-03T11:20:36.924 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 12/122 2023-12-03T11:20:36.980 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/122 2023-12-03T11:20:36.994 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : liboath-2.6.7-2.el9.x86_64 13/122 2023-12-03T11:20:37.013 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/122 2023-12-03T11:20:37.045 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/122 2023-12-03T11:20:37.047 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 14/122 2023-12-03T11:20:37.085 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 15/122 2023-12-03T11:20:37.130 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 16/122 2023-12-03T11:20:37.170 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 17/122 2023-12-03T11:20:37.226 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/122 2023-12-03T11:20:37.244 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 18/122 2023-12-03T11:20:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/122 2023-12-03T11:20:37.278 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 19/122 2023-12-03T11:20:37.312 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 20/122 2023-12-03T11:20:37.331 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/122 2023-12-03T11:20:37.339 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-5.4.4-4.el9.x86_64 21/122 2023-12-03T11:20:37.409 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/122 2023-12-03T11:20:37.444 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 23/122 2023-12-03T11:20:37.488 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 24/122 2023-12-03T11:20:37.516 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 25/122 2023-12-03T11:20:37.588 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 26/122 2023-12-03T11:20:37.664 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : luarocks-3.9.2-1.el9.noarch 27/122 2023-12-03T11:20:37.799 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 28/122 2023-12-03T11:20:37.849 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 29/122 2023-12-03T11:20:38.010 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/122 2023-12-03T11:20:38.129 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/122 2023-12-03T11:20:38.391 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rsa-4.9-2.el9.noarch 30/122 2023-12-03T11:20:38.470 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 31/122 2023-12-03T11:20:38.508 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 32/122 2023-12-03T11:20:38.546 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 33/122 2023-12-03T11:20:38.577 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 34/122 2023-12-03T11:20:38.684 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : re2-1:20211101-3.el9.x86_64 35/122 2023-12-03T11:20:38.714 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 36/122 2023-12-03T11:20:38.778 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 37/122 2023-12-03T11:20:38.850 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 38/122 2023-12-03T11:20:38.881 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 39/122 2023-12-03T11:20:38.917 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 40/122 2023-12-03T11:20:38.964 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 41/122 2023-12-03T11:20:39.018 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 42/122 2023-12-03T11:20:39.062 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 43/122 2023-12-03T11:20:39.199 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 44/122 2023-12-03T11:20:39.238 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 45/122 2023-12-03T11:20:39.280 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 46/122 2023-12-03T11:20:39.374 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 47/122 2023-12-03T11:20:39.397 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/122 2023-12-03T11:20:39.414 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 48/122 2023-12-03T11:20:39.455 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 49/122 2023-12-03T11:20:39.481 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/122 2023-12-03T11:20:39.487 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 50/122 2023-12-03T11:20:39.521 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/122 2023-12-03T11:20:39.554 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jq-1.6-16.el9.x86_64 87/122 2023-12-03T11:20:39.584 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 51/122 2023-12-03T11:20:39.623 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 52/122 2023-12-03T11:20:39.681 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-ply-3.11-14.el9.noarch 53/122 2023-12-03T11:20:39.737 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 54/122 2023-12-03T11:20:39.850 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 88/122 2023-12-03T11:20:39.875 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:20:39.935 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 55/122 2023-12-03T11:20:39.966 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:20:39.978 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 56/122 2023-12-03T11:20:39.997 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 90/122 2023-12-03T11:20:40.033 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 91/122 2023-12-03T11:20:40.116 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 57/122 2023-12-03T11:20:40.155 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 58/122 2023-12-03T11:20:40.193 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 59/122 2023-12-03T11:20:40.226 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 60/122 2023-12-03T11:20:40.260 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 61/122 2023-12-03T11:20:40.291 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : fuse-2.9.9-15.el9.x86_64 62/122 2023-12-03T11:20:40.336 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 63/122 2023-12-03T11:20:40.371 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 64/122 2023-12-03T11:20:40.401 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:20:40.458 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 92/122 2023-12-03T11:20:40.479 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 66/122 2023-12-03T11:20:40.487 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:20:40.511 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 67/122 2023-12-03T11:20:40.545 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 68/122 2023-12-03T11:20:40.547 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:20:40.571 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 94/122 2023-12-03T11:20:40.587 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 69/122 2023-12-03T11:20:40.646 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 70/122 2023-12-03T11:20:40.736 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 71/122 2023-12-03T11:20:40.773 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 72/122 2023-12-03T11:20:40.877 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 73/122 2023-12-03T11:20:40.925 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 74/122 2023-12-03T11:20:41.666 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 75/122 2023-12-03T11:20:41.713 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 76/122 2023-12-03T11:20:41.747 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 77/122 2023-12-03T11:20:41.779 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 78/122 2023-12-03T11:20:41.950 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-0.3.21-2.el9.x86_64 79/122 2023-12-03T11:20:41.977 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 80/122 2023-12-03T11:20:42.056 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 81/122 2023-12-03T11:20:42.707 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 82/122 2023-12-03T11:20:42.751 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:20:42.788 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:20:42.817 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 83/122 2023-12-03T11:20:43.345 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:20:43.388 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:20:43.480 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:20:43.480 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-03T11:20:43.480 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-03T11:20:43.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:20:43.532 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:20:44.084 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/122 2023-12-03T11:20:44.169 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 85/122 2023-12-03T11:20:44.200 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 86/122 2023-12-03T11:20:44.233 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : jq-1.6-16.el9.x86_64 87/122 2023-12-03T11:20:44.530 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 88/122 2023-12-03T11:20:44.563 INFO:teuthology.orchestra.run.smithi148.stdout: Upgrading : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:20:44.652 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 89/122 2023-12-03T11:20:44.692 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 90/122 2023-12-03T11:20:44.737 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 91/122 2023-12-03T11:20:45.164 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 92/122 2023-12-03T11:20:45.191 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:20:45.278 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 93/122 2023-12-03T11:20:45.309 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 94/122 2023-12-03T11:20:47.416 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:20:47.446 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:20:47.998 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 95/122 2023-12-03T11:20:48.275 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:20:48.348 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 96/122 2023-12-03T11:20:48.349 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-03T11:20:48.349 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-03T11:20:48.349 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:20:48.384 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:20:54.758 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:20:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2023-12-03T11:20:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2023-12-03T11:20:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2023-12-03T11:20:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2023-12-03T11:20:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2023-12-03T11:20:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /root 2023-12-03T11:20:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2023-12-03T11:20:54.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:20:54.920 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:20:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:20:54.935 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:20:54.935 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-03T11:20:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:20:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:20:56.524 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:20:56.524 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:20:56.524 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-03T11:20:56.525 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:20:56.525 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:20:56.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:20:56.724 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:20:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:20:56.746 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:20:56.746 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-03T11:20:56.746 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:20:56.746 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:20:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:20:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:20:57.214 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:20:57.214 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:20:57.214 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-03T11:20:57.214 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:20:57.214 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:20:57.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:20:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:20:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:20:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 103/122 2023-12-03T11:20:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 104/122 2023-12-03T11:20:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:20:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:20:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:20:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:20:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:20:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:20:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 108/122 2023-12-03T11:20:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:20:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:20:59.357 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:20:59.357 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-03T11:20:59.357 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:20:59.357 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:20:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:20:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:20:59.420 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:20:59.961 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 97/122 2023-12-03T11:20:59.961 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /sys 2023-12-03T11:20:59.961 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /proc 2023-12-03T11:20:59.961 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /mnt 2023-12-03T11:20:59.961 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /var/tmp 2023-12-03T11:20:59.962 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /home 2023-12-03T11:20:59.962 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /root 2023-12-03T11:20:59.962 INFO:teuthology.orchestra.run.smithi148.stdout:skipping the directory /tmp 2023-12-03T11:20:59.962 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:00.132 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:21:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 98/122 2023-12-03T11:21:00.148 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:21:00.148 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-03T11:21:00.148 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 111/122 2023-12-03T11:21:00.221 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:21:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:21:00.242 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:21:00.242 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-03T11:21:00.242 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:21:00.243 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:21:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:21:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:21:00.316 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:21:00.316 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-03T11:21:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:21:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:21:00.634 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:21:00.634 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-03T11:21:00.634 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:21:00.634 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:21:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:01.715 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:21:01.741 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 99/122 2023-12-03T11:21:01.741 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:21:01.741 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-03T11:21:01.741 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:21:01.741 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-03T11:21:01.741 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:01.941 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:21:01.963 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 100/122 2023-12-03T11:21:01.963 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:21:01.963 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-03T11:21:01.963 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:21:01.963 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-03T11:21:01.963 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:02.408 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:21:02.430 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 101/122 2023-12-03T11:21:02.431 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:21:02.431 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-03T11:21:02.431 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:21:02.431 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-03T11:21:02.431 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:02.889 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:21:02.923 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 102/122 2023-12-03T11:21:02.953 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 103/122 2023-12-03T11:21:03.015 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 104/122 2023-12-03T11:21:03.038 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:21:03.261 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 105/122 2023-12-03T11:21:03.289 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:21:04.255 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 106/122 2023-12-03T11:21:04.281 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:21:04.382 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 107/122 2023-12-03T11:21:04.440 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 115/122 2023-12-03T11:21:04.473 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 116/122 2023-12-03T11:21:04.530 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 108/122 2023-12-03T11:21:04.558 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:21:04.572 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 117/122 2023-12-03T11:21:04.580 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 109/122 2023-12-03T11:21:04.581 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:21:04.581 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-03T11:21:04.581 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:21:04.581 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-03T11:21:04.581 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:04.605 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 118/122 2023-12-03T11:21:04.625 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:21:04.636 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 110/122 2023-12-03T11:21:04.663 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 119/122 2023-12-03T11:21:04.695 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : s3cmd-2.3.0-4.el9.noarch 120/122 2023-12-03T11:21:04.695 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:21:04.762 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:21:04.762 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:21:05.407 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 111/122 2023-12-03T11:21:05.435 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:21:05.457 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 112/122 2023-12-03T11:21:05.457 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:21:05.457 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-03T11:21:05.457 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:21:05.458 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-03T11:21:05.458 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:05.510 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:21:05.533 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 113/122 2023-12-03T11:21:05.534 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:21:05.534 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-03T11:21:05.534 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:05.828 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:21:05.850 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 114/122 2023-12-03T11:21:05.850 INFO:teuthology.orchestra.run.smithi148.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-03T11:21:05.851 INFO:teuthology.orchestra.run.smithi148.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-03T11:21:05.851 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:21:05.851 INFO:teuthology.orchestra.run.smithi148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-03T11:21:05.851 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:09.243 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:21:09.243 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 1/122 2023-12-03T11:21:09.243 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2/122 2023-12-03T11:21:09.243 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 3/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 4/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 5/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 6/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 11/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 12/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 13/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 14/122 2023-12-03T11:21:09.244 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 15/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 16/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 17/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 18/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 19/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 20/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 21/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 22/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 23/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 24/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 25/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 26/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 27/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 28/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 29/122 2023-12-03T11:21:09.245 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 30/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 31/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 32/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 33/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 34/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 35/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 36/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 37/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 38/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 39/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 40/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jq-1.6-16.el9.x86_64 41/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 42/122 2023-12-03T11:21:09.246 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 43/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 44/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 45/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-5.4.4-4.el9.x86_64 46/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 47/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 48/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 49/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 50/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 51/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 52/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 53/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 54/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 55/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 56/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 57/122 2023-12-03T11:21:09.247 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 58/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 59/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 60/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 61/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 62/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 63/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 64/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 66/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 67/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 68/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 69/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 70/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 71/122 2023-12-03T11:21:09.248 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 72/122 2023-12-03T11:21:09.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ply-3.11-14.el9.noarch 73/122 2023-12-03T11:21:09.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 74/122 2023-12-03T11:21:09.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 75/122 2023-12-03T11:21:09.249 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 76/122 2023-12-03T11:21:09.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 77/122 2023-12-03T11:21:09.250 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 78/122 2023-12-03T11:21:09.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 79/122 2023-12-03T11:21:09.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 80/122 2023-12-03T11:21:09.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 81/122 2023-12-03T11:21:09.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 82/122 2023-12-03T11:21:09.251 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 83/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 84/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 85/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 86/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 87/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 88/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 89/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 90/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 91/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 92/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 93/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 94/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 95/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 96/122 2023-12-03T11:21:09.252 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 97/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 98/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 99/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 100/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 101/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 102/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 103/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 104/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 105/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 106/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 107/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 108/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 109/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 110/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 111/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 112/122 2023-12-03T11:21:09.253 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 113/122 2023-12-03T11:21:09.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 114/122 2023-12-03T11:21:09.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 115/122 2023-12-03T11:21:09.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : re2-1:20211101-3.el9.x86_64 116/122 2023-12-03T11:21:09.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : s3cmd-2.3.0-4.el9.noarch 117/122 2023-12-03T11:21:09.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 118/122 2023-12-03T11:21:09.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 119/122 2023-12-03T11:21:09.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 120/122 2023-12-03T11:21:09.254 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 121/122 2023-12-03T11:21:09.647 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 115/122 2023-12-03T11:21:09.689 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 116/122 2023-12-03T11:21:09.795 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 117/122 2023-12-03T11:21:09.829 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 118/122 2023-12-03T11:21:09.879 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 119/122 2023-12-03T11:21:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: Installing : s3cmd-2.3.0-4.el9.noarch 120/122 2023-12-03T11:21:09.911 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:21:09.994 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 121/122 2023-12-03T11:21:09.995 INFO:teuthology.orchestra.run.smithi148.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:21:11.173 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:21:11.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:11.173 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2023-12-03T11:21:11.173 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.173 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.173 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2023-12-03T11:21:11.173 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-03T11:21:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: jq-1.6-16.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: lua-5.4.4-4.el9.x86_64 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-03T11:21:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-03T11:21:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-03T11:21:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply-3.11-14.el9.noarch 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-03T11:21:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-03T11:21:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-03T11:21:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-03T11:21:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-03T11:21:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-03T11:21:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-03T11:21:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-03T11:21:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-03T11:21:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-03T11:21:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-03T11:21:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-03T11:21:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-03T11:21:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-03T11:21:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: re2-1:20211101-3.el9.x86_64 2023-12-03T11:21:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: s3cmd-2.3.0-4.el9.noarch 2023-12-03T11:21:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-03T11:21:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-03T11:21:11.183 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-03T11:21:11.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:11.183 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-12-03T11:21:11.485 DEBUG:teuthology.parallel:result is None 2023-12-03T11:21:14.226 INFO:teuthology.orchestra.run.smithi148.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 1/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 3/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 4/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7537.gbcbf2 5/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 6/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 7/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 8/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 9/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 10/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 11/122 2023-12-03T11:21:14.227 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 12/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_ 13/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 14/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 15/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_6 16/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86 17/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 18/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el 19/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9. 20/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_6 21/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 22/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 23/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 24/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 25/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 26/122 2023-12-03T11:21:14.228 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 27/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c. 28/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noa 29/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.n 30/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcb 31/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el 32/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 33/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.e 34/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 35/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 36/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 37/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 38/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 39/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 40/122 2023-12-03T11:21:14.229 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : jq-1.6-16.el9.x86_64 41/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 42/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 43/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 44/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 45/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-5.4.4-4.el9.x86_64 46/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 47/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 48/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 49/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 50/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 51/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 52/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 53/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 54/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 55/122 2023-12-03T11:21:14.230 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 56/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 57/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 58/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 59/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 60/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 61/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 62/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 63/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 64/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 65/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 66/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 67/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 68/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 69/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 70/122 2023-12-03T11:21:14.231 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 71/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 72/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-ply-3.11-14.el9.noarch 73/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 74/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 75/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 76/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 77/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 78/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 79/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 80/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 81/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 82/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 83/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 84/122 2023-12-03T11:21:14.232 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 85/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 86/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 87/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 88/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 89/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 90/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 91/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 92/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 93/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 94/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 95/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 96/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 97/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 98/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 99/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 100/122 2023-12-03T11:21:14.233 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 101/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 102/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 103/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 104/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 105/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 106/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 107/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 108/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 109/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 110/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 111/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 112/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 113/122 2023-12-03T11:21:14.234 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 114/122 2023-12-03T11:21:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 115/122 2023-12-03T11:21:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : re2-1:20211101-3.el9.x86_64 116/122 2023-12-03T11:21:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : s3cmd-2.3.0-4.el9.noarch 117/122 2023-12-03T11:21:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 118/122 2023-12-03T11:21:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 119/122 2023-12-03T11:21:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 120/122 2023-12-03T11:21:14.235 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 121/122 2023-12-03T11:21:16.399 INFO:teuthology.orchestra.run.smithi148.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 122/122 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout:Upgraded: 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout: librados2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout: librbd1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout:Installed: 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-base-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-grafana-dashboards-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:16.400 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-immutable-object-cache-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mds-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-dashboard-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-modules-core-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mgr-rook-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-mon-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-osd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-prometheus-alerts-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-radosgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-selinux-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-test-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: ceph-volume-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:16.401 INFO:teuthology.orchestra.run.smithi148.stdout: cephadm-2:18.0.0-7537.gbcbf278c.el9.noarch 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: jq-1.6-16.el9.x86_64 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: libcephfs2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: libcephsqlite-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-03T11:21:16.402 INFO:teuthology.orchestra.run.smithi148.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: librados-devel-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: libradosstriper1-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: librgw2-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: lua-5.4.4-4.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-03T11:21:16.403 INFO:teuthology.orchestra.run.smithi148.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-argparse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ceph-common-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cephfs-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-03T11:21:16.404 INFO:teuthology.orchestra.run.smithi148.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-03T11:21:16.405 INFO:teuthology.orchestra.run.smithi148.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-ply-3.11-14.el9.noarch 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-03T11:21:16.406 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-03T11:21:16.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-03T11:21:16.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rados-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-03T11:21:16.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-03T11:21:16.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-03T11:21:16.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rgw-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-03T11:21:16.407 INFO:teuthology.orchestra.run.smithi148.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-03T11:21:16.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-03T11:21:16.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-03T11:21:16.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-03T11:21:16.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-03T11:21:16.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-03T11:21:16.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-03T11:21:16.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-03T11:21:16.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-03T11:21:16.408 INFO:teuthology.orchestra.run.smithi148.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-03T11:21:16.409 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-fuse-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.409 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-mirror-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.409 INFO:teuthology.orchestra.run.smithi148.stdout: rbd-nbd-2:18.0.0-7537.gbcbf278c.el9.x86_64 2023-12-03T11:21:16.409 INFO:teuthology.orchestra.run.smithi148.stdout: re2-1:20211101-3.el9.x86_64 2023-12-03T11:21:16.409 INFO:teuthology.orchestra.run.smithi148.stdout: s3cmd-2.3.0-4.el9.noarch 2023-12-03T11:21:16.409 INFO:teuthology.orchestra.run.smithi148.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-03T11:21:16.409 INFO:teuthology.orchestra.run.smithi148.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-03T11:21:16.410 INFO:teuthology.orchestra.run.smithi148.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-03T11:21:16.410 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:16.410 INFO:teuthology.orchestra.run.smithi148.stdout:Complete! 2023-12-03T11:21:16.727 DEBUG:teuthology.parallel:result is None 2023-12-03T11:21:16.727 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:21:17.031 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-03T11:21:17.056 INFO:teuthology.orchestra.run.smithi131.stdout:18.0.0-7537.gbcbf278c.el9 2023-12-03T11:21:17.057 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7537.gbcbf278c.el9 2023-12-03T11:21:17.057 INFO:teuthology.task.install:The correct ceph version 18.0.0-7537.gbcbf278c is installed. 2023-12-03T11:21:17.057 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:21:17.200 DEBUG:teuthology.orchestra.run.smithi148:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-03T11:21:17.222 INFO:teuthology.orchestra.run.smithi148.stdout:18.0.0-7537.gbcbf278c.el9 2023-12-03T11:21:17.222 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7537.gbcbf278c.el9 2023-12-03T11:21:17.222 INFO:teuthology.task.install:The correct ceph version 18.0.0-7537.gbcbf278c is installed. 2023-12-03T11:21:17.223 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-03T11:21:17.223 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:17.223 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-03T11:21:17.258 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:17.258 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-03T11:21:17.292 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-03T11:21:17.293 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:17.293 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2023-12-03T11:21:17.328 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-03T11:21:17.397 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:17.397 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/daemon-helper 2023-12-03T11:21:17.425 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-03T11:21:17.492 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-03T11:21:17.492 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:17.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-03T11:21:17.521 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-03T11:21:17.590 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:17.590 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-03T11:21:17.618 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-03T11:21:17.685 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-03T11:21:17.685 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:17.685 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2023-12-03T11:21:17.713 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-03T11:21:17.782 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:17.782 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/usr/bin/stdin-killer 2023-12-03T11:21:17.809 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-03T11:21:17.876 INFO:teuthology.run_tasks:Running task ceph... 2023-12-03T11:21:17.947 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-03T11:21:17.948 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2023-12-03T11:21:17.950 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 777 /var/log/ceph 2023-12-03T11:21:17.976 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-03T11:21:17.977 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-03T11:21:18.018 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-03T11:21:18.044 INFO:tasks.ceph:Creating extra log directories... 2023-12-03T11:21:18.045 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-03T11:21:18.087 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-03T11:21:18.126 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-03T11:21:18.127 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-03T11:21:18.127 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132', 'branch': 'wip-alimasa-multi-pubsub-etag', 'description': 'rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7476132', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-alimasa-multi-pubsub-etag'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}}, 'rgw': {'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-alimasa-multi-pubsub-etag', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}}, 'owner': 'scheduled_alimasa@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-alimasa-multi-pubsub-etag', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319', 'targets': {'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIGLLW5lEyD0TqrX0qfEz3d7YenSQguKT7RX2V4Cd/HtIAFDdBRn/bpxGTkfdJyYd38ELFEvaftd5NYZdYM044A=', 'smithi148.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJHR3bUn7kJuWNVa0JRRD0ch+Afsiy1VnVp8T2hvJIth26m2xDoKxdhmbZ4lfk5vkD+hkQifXIIl0tzjS8Trhzw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd'], 'rpm': ['s3cmd']}, 'flavor': 'default', 'sha1': 'bcbf278cf395873c2a482f5a7b2345faf2160319'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-03_11:04:43', 'tube': 'smithi', 'user': 'alimasa', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-03T11:21:18.127 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-03T11:21:18.154 DEBUG:teuthology.orchestra.run.smithi148:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-03T11:21:18.169 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2023-12-03T11:21:18.209 DEBUG:teuthology.orchestra.run.smithi148:> sudo install -d -m0777 -- /var/run/ceph 2023-12-03T11:21:18.236 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:18.236 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2023-12-03T11:21:18.289 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-03T11:21:18.290 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2023-12-03T11:21:18.345 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-03T11:21:18.345 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:21:18.345 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-12-03T11:21:18.346 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:21:18.346 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:21:18.346 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-12-03 11:21:05.178548799 +0000 2023-12-03T11:21:18.346 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-12-03 11:19:19.509763414 +0000 2023-12-03T11:21:18.346 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-12-03 11:19:19.509763414 +0000 2023-12-03T11:21:18.346 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2023-12-03 11:19:19.509763414 +0000 2023-12-03T11:21:18.346 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-03T11:21:18.412 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-12-03T11:21:18.412 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-12-03T11:21:18.412 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000196296 s, 2.6 MB/s 2023-12-03T11:21:18.413 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-03T11:21:18.470 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2023-12-03T11:21:18.525 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-03T11:21:18.525 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:21:18.525 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-12-03T11:21:18.525 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:21:18.525 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:21:18.525 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-12-03 11:21:05.178548799 +0000 2023-12-03T11:21:18.526 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-12-03 11:19:20.073751282 +0000 2023-12-03T11:21:18.526 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-12-03 11:19:20.073751282 +0000 2023-12-03T11:21:18.526 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2023-12-03 11:19:20.073751282 +0000 2023-12-03T11:21:18.526 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-03T11:21:18.590 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-12-03T11:21:18.591 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-12-03T11:21:18.591 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.00019948 s, 2.6 MB/s 2023-12-03T11:21:18.592 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-03T11:21:18.647 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2023-12-03T11:21:18.702 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-03T11:21:18.703 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:21:18.703 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 703 Links: 1 2023-12-03T11:21:18.703 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:21:18.703 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:21:18.703 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-12-03 11:21:05.179548778 +0000 2023-12-03T11:21:18.703 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-12-03 11:19:20.628739401 +0000 2023-12-03T11:21:18.703 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-12-03 11:19:20.628739401 +0000 2023-12-03T11:21:18.703 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2023-12-03 11:19:20.628739401 +0000 2023-12-03T11:21:18.703 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-03T11:21:18.768 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-12-03T11:21:18.768 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-12-03T11:21:18.768 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.00018713 s, 2.7 MB/s 2023-12-03T11:21:18.769 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-03T11:21:18.825 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2023-12-03T11:21:18.880 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-03T11:21:18.880 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:21:18.880 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-12-03T11:21:18.880 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:21:18.880 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:21:18.881 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-12-03 11:21:05.179548778 +0000 2023-12-03T11:21:18.881 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-12-03 11:19:21.169727820 +0000 2023-12-03T11:21:18.881 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-12-03 11:19:21.169727820 +0000 2023-12-03T11:21:18.881 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2023-12-03 11:19:21.169727820 +0000 2023-12-03T11:21:18.881 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-03T11:21:18.946 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-12-03T11:21:18.946 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-12-03T11:21:18.946 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000297659 s, 1.7 MB/s 2023-12-03T11:21:18.947 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-03T11:21:19.003 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:21:19.003 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:19.003 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/scratch_devs of=/dev/stdout 2023-12-03T11:21:19.020 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-03T11:21:19.021 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_1 2023-12-03T11:21:19.076 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-03T11:21:19.077 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:21:19.077 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-12-03T11:21:19.077 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:21:19.077 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:21:19.077 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-12-03 11:21:10.411315769 +0000 2023-12-03T11:21:19.077 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-12-03 11:19:19.489066789 +0000 2023-12-03T11:21:19.077 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-12-03 11:19:19.489066789 +0000 2023-12-03T11:21:19.077 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-12-03 11:19:19.489066789 +0000 2023-12-03T11:21:19.077 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-03T11:21:19.144 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-12-03T11:21:19.144 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-12-03T11:21:19.144 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000218373 s, 2.3 MB/s 2023-12-03T11:21:19.145 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-03T11:21:19.203 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_2 2023-12-03T11:21:19.260 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-03T11:21:19.260 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:21:19.261 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-12-03T11:21:19.261 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:21:19.261 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:21:19.261 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-12-03 11:21:10.412315746 +0000 2023-12-03T11:21:19.261 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-12-03 11:19:20.054053364 +0000 2023-12-03T11:21:19.261 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-12-03 11:19:20.054053364 +0000 2023-12-03T11:21:19.261 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-12-03 11:19:20.054053364 +0000 2023-12-03T11:21:19.261 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-03T11:21:19.328 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-12-03T11:21:19.328 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-12-03T11:21:19.328 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000218674 s, 2.3 MB/s 2023-12-03T11:21:19.329 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-03T11:21:19.386 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_3 2023-12-03T11:21:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-03T11:21:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:21:19.442 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-03T11:21:19.442 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:21:19.442 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:21:19.442 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-12-03 11:21:10.412315746 +0000 2023-12-03T11:21:19.442 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-12-03 11:19:20.620039935 +0000 2023-12-03T11:21:19.442 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-12-03 11:19:20.620039935 +0000 2023-12-03T11:21:19.442 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-12-03 11:19:20.620039935 +0000 2023-12-03T11:21:19.443 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-03T11:21:19.508 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-12-03T11:21:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-12-03T11:21:19.509 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000172708 s, 3.0 MB/s 2023-12-03T11:21:19.510 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-03T11:21:19.565 DEBUG:teuthology.orchestra.run.smithi148:> stat /dev/vg_nvme/lv_4 2023-12-03T11:21:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-03T11:21:19.620 INFO:teuthology.orchestra.run.smithi148.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-03T11:21:19.620 INFO:teuthology.orchestra.run.smithi148.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-12-03T11:21:19.620 INFO:teuthology.orchestra.run.smithi148.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-03T11:21:19.620 INFO:teuthology.orchestra.run.smithi148.stdout:Context: system_u:object_r:device_t:s0 2023-12-03T11:21:19.620 INFO:teuthology.orchestra.run.smithi148.stdout:Access: 2023-12-03 11:21:10.412315746 +0000 2023-12-03T11:21:19.620 INFO:teuthology.orchestra.run.smithi148.stdout:Modify: 2023-12-03 11:19:21.172026838 +0000 2023-12-03T11:21:19.621 INFO:teuthology.orchestra.run.smithi148.stdout:Change: 2023-12-03 11:19:21.172026838 +0000 2023-12-03T11:21:19.621 INFO:teuthology.orchestra.run.smithi148.stdout: Birth: 2023-12-03 11:19:21.172026838 +0000 2023-12-03T11:21:19.621 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-03T11:21:19.687 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records in 2023-12-03T11:21:19.687 INFO:teuthology.orchestra.run.smithi148.stderr:1+0 records out 2023-12-03T11:21:19.687 INFO:teuthology.orchestra.run.smithi148.stderr:512 bytes copied, 0.000190961 s, 2.7 MB/s 2023-12-03T11:21:19.688 DEBUG:teuthology.orchestra.run.smithi148:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-03T11:21:19.744 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:21:19.744 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-03T11:21:19.744 INFO:tasks.ceph:Generating config... 2023-12-03T11:21:19.745 INFO:tasks.ceph:[client] debug rgw = 20 2023-12-03T11:21:19.745 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2023-12-03T11:21:19.745 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2023-12-03T11:21:19.745 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2023-12-03T11:21:19.745 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-12-03T11:21:19.745 INFO:tasks.ceph:[client] rgw torrent flag = True 2023-12-03T11:21:19.745 INFO:tasks.ceph:[client] rgw user counters cache = True 2023-12-03T11:21:19.746 INFO:tasks.ceph:[client] setgroup = ceph 2023-12-03T11:21:19.746 INFO:tasks.ceph:[client] setuser = ceph 2023-12-03T11:21:19.746 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-12-03T11:21:19.746 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-12-03T11:21:19.746 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2023-12-03T11:21:19.746 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2023-12-03T11:21:19.746 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2023-12-03T11:21:19.746 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-03T11:21:19.746 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-03T11:21:19.746 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-03T11:21:19.746 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-03T11:21:19.746 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-03T11:21:19.746 INFO:tasks.ceph:[mon] lockdep = True 2023-12-03T11:21:19.746 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-03T11:21:19.746 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] lockdep = True 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-03T11:21:19.747 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-12-03T11:21:19.748 INFO:tasks.ceph:Setting up mon.a... 2023-12-03T11:21:19.748 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-03T11:21:19.799 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.keyring 2023-12-03T11:21:19.802 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-03T11:21:19.845 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-03T11:21:19.913 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.131'), ('mon.c', '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]'), ('mon.b', '172.21.15.148')] 2023-12-03T11:21:19.913 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790],172.21.15.148', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-12-03T11:21:19.914 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:19.914 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-03T11:21:19.968 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.131 --addv c '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]' --add b 172.21.15.148 --print /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:20.052 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:21:20.052 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:21:20.052 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:20.052 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: generated fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:21:20.053 INFO:teuthology.orchestra.run.smithi131.stdout:setting min_mon_release = pacific 2023-12-03T11:21:20.053 INFO:teuthology.orchestra.run.smithi131.stdout:epoch 0 2023-12-03T11:21:20.053 INFO:teuthology.orchestra.run.smithi131.stdout:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:21:20.053 INFO:teuthology.orchestra.run.smithi131.stdout:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:21:20.053 INFO:teuthology.orchestra.run.smithi131.stdout:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:21:20.053 INFO:teuthology.orchestra.run.smithi131.stdout:min_mon_release 16 (pacific) 2023-12-03T11:21:20.053 INFO:teuthology.orchestra.run.smithi131.stdout:election_strategy: 1 2023-12-03T11:21:20.053 INFO:teuthology.orchestra.run.smithi131.stdout:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:21:20.053 INFO:teuthology.orchestra.run.smithi131.stdout:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:21:20.053 INFO:teuthology.orchestra.run.smithi131.stdout:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:21:20.053 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-03T11:21:20.055 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-03T11:21:20.110 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 666a215a-2cfd-4a1c-90d3-5202ec868043... 2023-12-03T11:21:20.111 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-03T11:21:20.153 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-03T11:21:20.200 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2023-12-03T11:21:20.200 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2023-12-03T11:21:20.200 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-03T11:21:20.200 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2023-12-03T11:21:20.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.200 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-03T11:21:20.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2023-12-03T11:21:20.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790],172.21.15.148" 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: mon client directed command retry = 5 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: ms inject socket failures = 5000 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: osd_max_pg_log_entries = 10 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: osd_min_pg_log_entries = 10 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: rgw override bucket index max shards = 1 2023-12-03T11:21:20.203 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2023-12-03T11:21:20.204 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2023-12-03T11:21:20.205 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: bdev async discard = True 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: bdev enable discard = True 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore allocator = bitmap 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 1/20 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 1/20 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 4/10 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: lockdep = True 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2023-12-03T11:21:20.206 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: osd shutdown pgref assert = True 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-12-03T11:21:20.207 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2023-12-03T11:21:20.208 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-12-03T11:21:20.208 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2023-12-03T11:21:20.208 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2023-12-03T11:21:20.208 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:21:20.208 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2023-12-03T11:21:20.208 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2023-12-03T11:21:20.208 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:21:20.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.208 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: lockdep = True 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2023-12-03T11:21:20.209 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: debug rgw = 20 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: rgw bucket counters cache = True 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: rgw crypt require ssl = False 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: rgw crypt s3 kms backend = testing 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: rgw torrent flag = True 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: rgw user counters cache = True 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: setgroup = ceph 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout: setuser = ceph 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2023-12-03T11:21:20.210 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2023-12-03T11:21:20.211 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2023-12-03T11:21:20.211 INFO:teuthology.orchestra.run.smithi148.stdout:[global] 2023-12-03T11:21:20.211 INFO:teuthology.orchestra.run.smithi148.stdout: chdir = "" 2023-12-03T11:21:20.211 INFO:teuthology.orchestra.run.smithi148.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-03T11:21:20.211 INFO:teuthology.orchestra.run.smithi148.stdout: auth supported = cephx 2023-12-03T11:21:20.211 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.211 INFO:teuthology.orchestra.run.smithi148.stdout: filestore xattr use omap = true 2023-12-03T11:21:20.211 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: mon clock drift allowed = 1.000 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: osd crush chooseleaf type = 0 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: auth debug = true 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on old message = true 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: ms die on bug = true 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: mon pg warn max object skew = 0 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: # disable pg_autoscaler by default for new pools 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default size = 2 2023-12-03T11:21:20.212 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow primary affinity = true 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd allow pg remap = true 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on legacy crush tunables = false 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on crush straw calc version zero = false 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on no sortbitwise = false 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on osd down out interval zero = false 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: mon warn on too few osds = false 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: mon_allow_pool_size_one = true 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: osd default data pool replay window = 5 2023-12-03T11:21:20.213 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: mon allow pool delete = true 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: mon cluster log file level = debug 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: debug asserts on shutdown = true 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: mon health detail to clog = false 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: mon host = "172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790],172.21.15.148" 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: mon client directed command retry = 5 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: ms inject socket failures = 5000 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: osd_max_pg_log_entries = 10 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: osd_min_pg_log_entries = 10 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: rgw override bucket index max shards = 1 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: fsid = 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout:[osd] 2023-12-03T11:21:20.214 INFO:teuthology.orchestra.run.smithi148.stdout: osd journal size = 100 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub load threshold = 5.0 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: osd scrub max interval = 600 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: osd mclock profile = high_recovery_ops 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: osd recover clone overlap = true 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: osd recovery max chunk = 1048576 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug shutdown = true 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug op order = true 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug verify stray on activate = true 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug trim objects = true 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: osd open classes on start = true 2023-12-03T11:21:20.215 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug pg log writeout = true 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: osd deep scrub update digest min age = 30 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: osd map max advance = 10 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: journal zero on create = true 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: filestore ondisk finisher threads = 3 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: filestore apply finisher threads = 3 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: bdev debug aio = true 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: osd debug misdirected ops = true 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: bdev async discard = True 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: bdev enable discard = True 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore allocator = bitmap 2023-12-03T11:21:20.216 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore block size = 96636764160 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: bluestore fsck on mount = True 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluefs = 1/20 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: debug bluestore = 1/20 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: debug osd = 20 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: debug rocksdb = 4/10 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: lockdep = True 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd backfillfull_ratio = 0.85 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd full ratio = 0.9 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd nearfull ratio = 0.8 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: osd failsafe full ratio = 0.95 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: osd objectstore = bluestore 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: osd shutdown pgref assert = True 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.217 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr] 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: debug mgr = 20 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: mgr/telemetry/nag = false 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout:[mon] 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: debug ms = 1 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: debug mon = 20 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: debug paxos = 20 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: debug auth = 20 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: mon data avail warn = 5 2023-12-03T11:21:20.218 INFO:teuthology.orchestra.run.smithi148.stdout: mon mgr mkfs grace = 240 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min pgs per osd = 4 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd reporter subtree level = osd 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: mon osd prime pg temp = true 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: mon reweight min bytes per osd = 10 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: auth mon ticket ttl = 660 # 11m 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: auth service ticket ttl = 240 # 4m 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: # don't complain about insecure global_id in the test suite 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: # 1m isn't quite enough 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: mon_down_mkfs_grace = 2m 2023-12-03T11:21:20.219 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: mon_warn_on_filestore_osds = false 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: lockdep = True 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout:[client] 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: rgw cache enabled = true 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable ops log = true 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: rgw enable usage log = true 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: debug rgw = 20 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: rgw bucket counters cache = True 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: rgw crypt require ssl = False 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: rgw crypt s3 kms backend = testing 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2023-12-03T11:21:20.220 INFO:teuthology.orchestra.run.smithi148.stdout: rgw torrent flag = True 2023-12-03T11:21:20.221 INFO:teuthology.orchestra.run.smithi148.stdout: rgw user counters cache = True 2023-12-03T11:21:20.221 INFO:teuthology.orchestra.run.smithi148.stdout: setgroup = ceph 2023-12-03T11:21:20.221 INFO:teuthology.orchestra.run.smithi148.stdout: setuser = ceph 2023-12-03T11:21:20.221 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.a] 2023-12-03T11:21:20.221 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.c] 2023-12-03T11:21:20.221 INFO:teuthology.orchestra.run.smithi148.stdout:[mon.b] 2023-12-03T11:21:20.222 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-03T11:21:20.223 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-03T11:21:20.318 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-03T11:21:20.318 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:20.318 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-03T11:21:20.333 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:20.333 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-03T11:21:20.387 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T11:21:20.388 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:20.388 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-03T11:21:20.388 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-03T11:21:20.468 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:20.468 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:20.524 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T11:21:20.524 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:20.524 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-03T11:21:20.524 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-03T11:21:20.564 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:20.564 DEBUG:teuthology.orchestra.run.smithi148:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:20.619 INFO:tasks.ceph:Setting up mon nodes... 2023-12-03T11:21:20.619 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-03T11:21:20.619 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-03T11:21:20.673 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-03T11:21:20.676 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-03T11:21:20.760 INFO:teuthology.orchestra.run.smithi148.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-03T11:21:20.763 INFO:tasks.ceph:Setting up mds nodes... 2023-12-03T11:21:20.766 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-03T11:21:20.767 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-03T11:21:20.809 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-03T11:21:20.825 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-03T11:21:20.867 INFO:teuthology.orchestra.run.smithi148.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-03T11:21:20.883 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-03T11:21:20.883 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi148.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-03T11:21:20.883 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-03T11:21:20.909 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:21:20.910 INFO:tasks.ceph:role: osd.0 2023-12-03T11:21:20.910 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T11:21:20.910 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-03T11:21:20.984 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:21:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:21:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:21:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:21:20.985 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:21:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:21:20.985 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:21:20.985 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:21:20.985 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:21:20.985 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:21:21.490 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-12-03T11:21:21.492 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-12-03T11:21:21.492 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-03T11:21:21.612 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-03T11:21:21.647 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-03T11:21:21.716 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:21:21.716 INFO:tasks.ceph:role: osd.1 2023-12-03T11:21:21.716 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T11:21:21.716 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-03T11:21:21.791 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:21:21.791 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:21:21.791 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:21:21.791 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:21:21.791 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:21:21.791 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:21:21.791 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:21:21.791 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:21:21.791 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:21:21.791 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:21:22.246 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-12-03T11:21:22.248 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-12-03T11:21:22.248 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-03T11:21:22.339 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-03T11:21:22.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-03T11:21:22.437 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:21:22.437 INFO:tasks.ceph:role: osd.2 2023-12-03T11:21:22.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T11:21:22.437 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-03T11:21:22.511 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:21:22.511 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:21:22.512 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:21:22.512 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:21:22.512 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:21:22.512 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:21:22.512 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:21:22.512 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:21:22.512 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:21:22.512 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:21:23.015 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-12-03T11:21:23.017 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-12-03T11:21:23.017 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-03T11:21:23.123 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-03T11:21:23.156 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-03T11:21:23.227 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-03T11:21:23.227 INFO:tasks.ceph:role: osd.3 2023-12-03T11:21:23.227 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T11:21:23.227 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-03T11:21:23.301 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:21:23.301 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:21:23.301 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:21:23.301 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:21:23.302 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:21:23.302 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:21:23.302 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:21:23.302 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:21:23.302 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:21:23.302 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:21:23.821 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-12-03T11:21:23.823 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-12-03T11:21:23.823 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-03T11:21:23.975 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-03T11:21:24.008 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:24.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:24.102+0000 7f3d5ae69500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-03T11:21:24.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:24.102+0000 7f3d5ae69500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-03T11:21:24.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:24.102+0000 7f3d5ae69500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-03T11:21:24.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:24.102+0000 7f3d5ae69500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-03T11:21:24.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:24.102+0000 7f3d5ae69500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-03T11:21:24.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:24.103+0000 7f3d5ae69500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-03T11:21:26.971 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-03T11:21:27.003 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:27.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:27.093+0000 7fb9dcbe2500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-03T11:21:27.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:27.094+0000 7fb9dcbe2500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-03T11:21:27.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:27.094+0000 7fb9dcbe2500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-03T11:21:27.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:27.094+0000 7fb9dcbe2500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-03T11:21:27.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:27.094+0000 7fb9dcbe2500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-03T11:21:27.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:27.094+0000 7fb9dcbe2500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-03T11:21:29.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-03T11:21:29.980 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:30.072 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:30.070+0000 7fb887c12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-03T11:21:30.072 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:30.071+0000 7fb887c12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-03T11:21:30.072 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:30.071+0000 7fb887c12500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-03T11:21:30.072 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:30.071+0000 7fb887c12500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-03T11:21:30.073 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:30.071+0000 7fb887c12500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-03T11:21:30.073 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:30.071+0000 7fb887c12500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-03T11:21:32.927 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-03T11:21:32.959 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:33.052 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:33.048+0000 7f538f616500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-03T11:21:33.052 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:33.049+0000 7f538f616500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-03T11:21:33.052 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:33.049+0000 7f538f616500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-03T11:21:33.052 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:33.049+0000 7f538f616500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-03T11:21:33.052 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:33.049+0000 7f538f616500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-03T11:21:33.052 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:21:33.049+0000 7f538f616500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-03T11:21:35.896 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-03T11:21:35.923 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-03T11:21:35.955 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:21:35.955 INFO:tasks.ceph:role: osd.4 2023-12-03T11:21:35.956 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T11:21:35.956 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-03T11:21:36.034 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:21:36.034 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:21:36.034 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:21:36.034 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:21:36.034 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:21:36.034 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:21:36.034 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:21:36.034 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:21:36.035 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:21:36.035 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:21:36.545 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-12-03T11:21:36.550 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-12-03T11:21:36.550 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-03T11:21:36.680 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-03T11:21:36.714 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-03T11:21:36.781 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:21:36.781 INFO:tasks.ceph:role: osd.5 2023-12-03T11:21:36.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T11:21:36.782 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-03T11:21:36.856 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:21:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:21:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:21:36.856 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:21:36.857 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:21:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:21:36.857 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:21:36.857 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:21:36.857 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:21:36.857 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:21:37.300 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-12-03T11:21:37.302 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-12-03T11:21:37.302 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-03T11:21:37.385 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-03T11:21:37.456 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-03T11:21:37.524 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:21:37.524 INFO:tasks.ceph:role: osd.6 2023-12-03T11:21:37.524 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T11:21:37.524 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-03T11:21:37.601 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:21:37.601 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:21:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:21:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:21:37.602 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:21:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:21:37.602 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:21:37.602 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:21:37.602 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:21:37.602 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:21:38.091 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-12-03T11:21:38.093 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-12-03T11:21:38.093 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-03T11:21:38.241 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-03T11:21:38.273 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-03T11:21:38.340 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-03T11:21:38.341 INFO:tasks.ceph:role: osd.7 2023-12-03T11:21:38.341 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T11:21:38.341 DEBUG:teuthology.orchestra.run.smithi148:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-03T11:21:38.415 INFO:teuthology.orchestra.run.smithi148.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-03T11:21:38.415 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-03T11:21:38.415 INFO:teuthology.orchestra.run.smithi148.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-03T11:21:38.415 INFO:teuthology.orchestra.run.smithi148.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-03T11:21:38.415 INFO:teuthology.orchestra.run.smithi148.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-03T11:21:38.415 INFO:teuthology.orchestra.run.smithi148.stdout: = sunit=0 swidth=0 blks 2023-12-03T11:21:38.415 INFO:teuthology.orchestra.run.smithi148.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-03T11:21:38.415 INFO:teuthology.orchestra.run.smithi148.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-03T11:21:38.415 INFO:teuthology.orchestra.run.smithi148.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-03T11:21:38.415 INFO:teuthology.orchestra.run.smithi148.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-03T11:21:38.898 INFO:teuthology.orchestra.run.smithi148.stdout:Discarding blocks...Done. 2023-12-03T11:21:38.900 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi148.front.sepia.ceph.com -o noatime 2023-12-03T11:21:38.900 DEBUG:teuthology.orchestra.run.smithi148:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-03T11:21:39.047 DEBUG:teuthology.orchestra.run.smithi148:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-03T11:21:39.083 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:39.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:39.226+0000 7f32ab80e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-03T11:21:39.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:39.226+0000 7f32ab80e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-03T11:21:39.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:39.226+0000 7f32ab80e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-03T11:21:39.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:39.226+0000 7f32ab80e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-03T11:21:39.228 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:39.226+0000 7f32ab80e500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-03T11:21:39.229 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:39.227+0000 7f32ab80e500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-03T11:21:42.072 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-03T11:21:42.101 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:42.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:42.187+0000 7f03f780e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-03T11:21:42.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:42.187+0000 7f03f780e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-03T11:21:42.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:42.187+0000 7f03f780e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-03T11:21:42.189 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:42.187+0000 7f03f780e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-03T11:21:42.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:42.187+0000 7f03f780e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-03T11:21:42.190 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:42.188+0000 7f03f780e500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-03T11:21:45.042 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-03T11:21:45.074 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:45.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:45.165+0000 7f66632b6500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-03T11:21:45.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:45.165+0000 7f66632b6500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-03T11:21:45.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:45.165+0000 7f66632b6500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-03T11:21:45.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:45.165+0000 7f66632b6500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-03T11:21:45.167 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:45.165+0000 7f66632b6500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-03T11:21:45.168 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:45.166+0000 7f66632b6500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-03T11:21:48.019 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-03T11:21:48.048 DEBUG:teuthology.orchestra.run.smithi148:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:48.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:48.133+0000 7f770a59b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-03T11:21:48.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:48.133+0000 7f770a59b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-03T11:21:48.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:48.133+0000 7f770a59b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-03T11:21:48.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:48.133+0000 7f770a59b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-03T11:21:48.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:48.133+0000 7f770a59b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-03T11:21:48.135 INFO:teuthology.orchestra.run.smithi148.stderr:2023-12-03T11:21:48.134+0000 7f770a59b500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-03T11:21:50.995 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-03T11:21:51.026 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-03T11:21:51.027 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:51.027 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-03T11:21:51.059 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:51.059 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-03T11:21:51.130 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:51.130 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-03T11:21:51.200 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:51.201 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-03T11:21:51.272 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:51.272 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-03T11:21:51.343 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:51.343 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-03T11:21:51.376 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:51.376 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-03T11:21:51.446 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:51.447 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-03T11:21:51.516 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:51.516 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-03T11:21:51.585 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:51.585 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-03T11:21:51.654 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:51.654 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-03T11:21:51.672 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:51.672 DEBUG:teuthology.orchestra.run.smithi148:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-03T11:21:51.710 INFO:tasks.ceph:Adding keys to all mons... 2023-12-03T11:21:51.710 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-03T11:21:51.714 DEBUG:teuthology.orchestra.run.smithi148:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-03T11:21:51.754 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2023-12-03T11:21:51.754 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCwZGxl5rQnKBAAHKbvCakYru+Qx3N2jPdQLA== 2023-12-03T11:21:51.754 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2023-12-03T11:21:51.754 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQC0ZGxl010rBhAAr50Y+QHLi+IbMZt70kHndg== 2023-12-03T11:21:51.754 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2023-12-03T11:21:51.754 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQC3ZGxlffqkBRAA+daynSoZwWttcjf7jxia+Q== 2023-12-03T11:21:51.754 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2023-12-03T11:21:51.754 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQC6ZGxlHnhGBBAA1M5jDiqjUJtYvdOLZWH8kA== 2023-12-03T11:21:51.754 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2023-12-03T11:21:51.754 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQC9ZGxlF/gGAxAA19Yj/ewddwJkDMzWSnIPoQ== 2023-12-03T11:21:51.754 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCwZGxl9pZWLRAAgwFIMZTf75qOViIURDKOQA== 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDDZGxlBQWVDRAAXxxHVKJPHWg+h4FYxHXW2g== 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDGZGxlGaU/CxAAMGbDBMUQooAL5fo02rI6Lg== 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDJZGxlsbDxCRAASNwjyc+uHCgE0B//ESzWXg== 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDMZGxlLmMGCBAA79lZ9FxbaDbypq7rJpqoEQ== 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCwZGxleAo7MBAA/Yqp9B/s6WjL9HSp2aIuvA== 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout:[client.1] 2023-12-03T11:21:51.755 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCwZGxlSYu2MxAAspUsGJ/B+qBwmA18UX2i5w== 2023-12-03T11:21:51.776 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.y] 2023-12-03T11:21:51.776 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCwZGxl5rQnKBAAHKbvCakYru+Qx3N2jPdQLA== 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.0] 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC0ZGxl010rBhAAr50Y+QHLi+IbMZt70kHndg== 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.1] 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC3ZGxlffqkBRAA+daynSoZwWttcjf7jxia+Q== 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.2] 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC6ZGxlHnhGBBAA1M5jDiqjUJtYvdOLZWH8kA== 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.3] 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQC9ZGxlF/gGAxAA19Yj/ewddwJkDMzWSnIPoQ== 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout:[mgr.x] 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCwZGxl9pZWLRAAgwFIMZTf75qOViIURDKOQA== 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.4] 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDDZGxlBQWVDRAAXxxHVKJPHWg+h4FYxHXW2g== 2023-12-03T11:21:51.777 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.5] 2023-12-03T11:21:51.778 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDGZGxlGaU/CxAAMGbDBMUQooAL5fo02rI6Lg== 2023-12-03T11:21:51.778 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.6] 2023-12-03T11:21:51.778 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDJZGxlsbDxCRAASNwjyc+uHCgE0B//ESzWXg== 2023-12-03T11:21:51.778 INFO:teuthology.orchestra.run.smithi148.stdout:[osd.7] 2023-12-03T11:21:51.778 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQDMZGxlLmMGCBAA79lZ9FxbaDbypq7rJpqoEQ== 2023-12-03T11:21:51.778 INFO:teuthology.orchestra.run.smithi148.stdout:[client.0] 2023-12-03T11:21:51.778 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCwZGxleAo7MBAA/Yqp9B/s6WjL9HSp2aIuvA== 2023-12-03T11:21:51.778 INFO:teuthology.orchestra.run.smithi148.stdout:[client.1] 2023-12-03T11:21:51.778 INFO:teuthology.orchestra.run.smithi148.stdout: key = AQCwZGxlSYu2MxAAspUsGJ/B+qBwmA18UX2i5w== 2023-12-03T11:21:51.779 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:21:51.799 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:21:51.872 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:51.875 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:51.927 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:51.929 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:51.981 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:51.983 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:52.035 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:52.037 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:52.088 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:21:52.091 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-03T11:21:52.142 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:52.144 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:52.196 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:52.199 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:52.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:52.252 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:52.304 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:52.306 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-03T11:21:52.358 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:21:52.361 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:21:52.415 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:21:52.417 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-03T11:21:52.471 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-03T11:21:52.472 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-03T11:21:52.498 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-03T11:21:52.595 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-03T11:21:52.621 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-03T11:21:52.688 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-03T11:21:52.784 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-03T11:21:52.811 DEBUG:teuthology.orchestra.run.smithi148:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-03T11:21:52.840 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-03T11:21:52.938 DEBUG:teuthology.orchestra.run.smithi148:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-03T11:21:52.965 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:52.969 DEBUG:teuthology.orchestra.run.smithi148:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-03T11:21:53.020 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-03T11:21:53.020 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-03T11:21:53.020 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-03T11:21:53.022 INFO:tasks.ceph.mon.a:Started 2023-12-03T11:21:53.022 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-03T11:21:53.023 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-03T11:21:53.025 INFO:tasks.ceph.mon.c:Started 2023-12-03T11:21:53.025 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-03T11:21:53.025 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-03T11:21:53.063 INFO:tasks.ceph.mon.b:Started 2023-12-03T11:21:53.063 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-03T11:21:53.063 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-03T11:21:53.063 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-03T11:21:53.066 INFO:tasks.ceph.mgr.y:Started 2023-12-03T11:21:53.066 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-03T11:21:53.066 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-03T11:21:53.068 INFO:tasks.ceph.mgr.x:Started 2023-12-03T11:21:53.068 INFO:tasks.ceph:Setting crush tunables to default 2023-12-03T11:21:53.068 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd crush tunables default 2023-12-03T11:21:58.454 INFO:teuthology.orchestra.run.smithi131.stderr:adjusted tunables profile to default 2023-12-03T11:21:58.467 INFO:tasks.ceph:check_enable_crimson: False 2023-12-03T11:21:58.467 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-03T11:21:58.467 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:58.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-03T11:21:58.494 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:58.495 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-03T11:21:58.562 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:58.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-03T11:21:58.629 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:21:58.629 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-03T11:21:58.696 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:58.696 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-03T11:21:58.723 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:58.724 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-03T11:21:58.791 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:58.791 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-03T11:21:58.834 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:58.833+0000 7f58eac14040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-03T11:21:58.852 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:58.851+0000 7f619ce0f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-03T11:21:58.858 DEBUG:teuthology.orchestra.run.smithi148:> set -ex 2023-12-03T11:21:58.858 DEBUG:teuthology.orchestra.run.smithi148:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-03T11:21:58.884 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:58.883+0000 7f58eac14040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-03T11:21:58.905 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:58.905+0000 7f619ce0f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-03T11:21:58.925 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new e0dc6080-5d4a-4384-af9c-946f4b87bd55 0 2023-12-03T11:21:59.146 INFO:teuthology.orchestra.run.smithi148.stdout:0 2023-12-03T11:21:59.157 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new b51ea299-720b-494f-9168-f281da3efcfd 1 2023-12-03T11:21:59.343 INFO:teuthology.orchestra.run.smithi148.stdout:1 2023-12-03T11:21:59.354 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new c131a91e-f214-4127-8dbb-b6bcfd207715 2 2023-12-03T11:21:59.454 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:59.453+0000 7f58eac14040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-03T11:21:59.459 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:59.459+0000 7f619ce0f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-03T11:21:59.506 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:59.505+0000 7f58eac14040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-03T11:21:59.514 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:59.514+0000 7f619ce0f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-03T11:21:59.543 INFO:teuthology.orchestra.run.smithi148.stdout:2 2023-12-03T11:21:59.551 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:59.550+0000 7f58eac14040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-03T11:21:59.554 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 0c5e1c10-cea3-4bbd-822f-817505238e44 3 2023-12-03T11:21:59.562 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:59.562+0000 7f619ce0f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-03T11:21:59.603 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:59.602+0000 7f58eac14040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-03T11:21:59.619 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:59.619+0000 7f619ce0f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-03T11:21:59.645 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:59.643+0000 7f58eac14040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-03T11:21:59.665 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:59.665+0000 7f619ce0f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-03T11:21:59.741 INFO:teuthology.orchestra.run.smithi148.stdout:3 2023-12-03T11:21:59.746 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:59.745+0000 7f58eac14040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-03T11:21:59.752 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 9543b361-87b7-44f5-8ec7-d8a8eb0a9abd 4 2023-12-03T11:21:59.771 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:59.770+0000 7f619ce0f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-03T11:21:59.816 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:59.815+0000 7f58eac14040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-03T11:21:59.844 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:59.843+0000 7f619ce0f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-03T11:21:59.861 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:59.859+0000 7f58eac14040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-03T11:21:59.894 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:59.893+0000 7f619ce0f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-03T11:21:59.913 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:59.911+0000 7f58eac14040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-03T11:21:59.949 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:59.946+0000 7f619ce0f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-03T11:21:59.957 INFO:teuthology.orchestra.run.smithi148.stdout:4 2023-12-03T11:21:59.959 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:21:59.958+0000 7f58eac14040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-03T11:21:59.968 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new a9325e67-7d72-4c93-aea6-094128a0f451 5 2023-12-03T11:21:59.997 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:21:59.997+0000 7f619ce0f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-03T11:22:00.157 INFO:teuthology.orchestra.run.smithi148.stdout:5 2023-12-03T11:22:00.168 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new 2f6637e8-71a7-4c19-a45e-ae7828747391 6 2023-12-03T11:22:00.337 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:00.335+0000 7f58eac14040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-03T11:22:00.393 INFO:teuthology.orchestra.run.smithi148.stdout:6 2023-12-03T11:22:00.399 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:00.398+0000 7f619ce0f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-03T11:22:00.405 DEBUG:teuthology.orchestra.run.smithi148:> sudo ceph --cluster ceph osd new cf2f61d8-b3f7-4f47-a5ab-27852d6778a5 7 2023-12-03T11:22:00.471 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:00.470+0000 7f58eac14040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-03T11:22:00.541 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:00.541+0000 7f619ce0f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-03T11:22:00.587 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:00.586+0000 7f58eac14040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-03T11:22:00.590 INFO:teuthology.orchestra.run.smithi148.stdout:7 2023-12-03T11:22:00.601 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-03T11:22:00.602 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-03T11:22:00.604 INFO:tasks.ceph.osd.0:Started 2023-12-03T11:22:00.604 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-03T11:22:00.604 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-03T11:22:00.606 INFO:tasks.ceph.osd.1:Started 2023-12-03T11:22:00.606 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-03T11:22:00.607 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-03T11:22:00.610 INFO:tasks.ceph.osd.2:Started 2023-12-03T11:22:00.611 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-03T11:22:00.611 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-03T11:22:00.613 INFO:tasks.ceph.osd.3:Started 2023-12-03T11:22:00.613 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-03T11:22:00.613 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-03T11:22:00.616 INFO:tasks.ceph.osd.4:Started 2023-12-03T11:22:00.616 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-03T11:22:00.616 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-03T11:22:00.618 INFO:tasks.ceph.osd.5:Started 2023-12-03T11:22:00.618 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-03T11:22:00.618 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-03T11:22:00.620 INFO:tasks.ceph.osd.6:Started 2023-12-03T11:22:00.620 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-03T11:22:00.621 DEBUG:teuthology.orchestra.run.smithi148:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-03T11:22:00.622 INFO:tasks.ceph.osd.7:Started 2023-12-03T11:22:00.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-03T11:22:00.643 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:00.642+0000 7f58eac14040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-03T11:22:00.661 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:00.661+0000 7f619ce0f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-03T11:22:00.715 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:00.714+0000 7f619ce0f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-03T11:22:00.790 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:00.789+0000 7f58eac14040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:22:00.814 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:00.813+0000 7f619ce0f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:22:00.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:22:00.844 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":10,"fsid":"666a215a-2cfd-4a1c-90d3-5202ec868043","created":"2023-12-03T11:21:58.358528+0000","modified":"2023-12-03T11:22:00.585004+0000","last_up_change":"0.000000","last_in_change":"2023-12-03T11:22:00.585004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e0dc6080-5d4a-4384-af9c-946f4b87bd55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b51ea299-720b-494f-9168-f281da3efcfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c131a91e-f214-4127-8dbb-b6bcfd207715","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0c5e1c10-cea3-4bbd-822f-817505238e44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9543b361-87b7-44f5-8ec7-d8a8eb0a9abd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a9325e67-7d72-4c93-aea6-094128a0f451","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f6637e8-71a7-4c19-a45e-ae7828747391","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cf2f61d8-b3f7-4f47-a5ab-27852d6778a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:22:00.855 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-03T11:22:00.856 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-03T11:22:00.889 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:00.888+0000 7f58eac14040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-03T11:22:00.907 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:00.906+0000 7f619ce0f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-03T11:22:01.031 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:01.029+0000 7f58eac14040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:22:01.048 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:01.047+0000 7f619ce0f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-03T11:22:01.072 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:01.071+0000 7f58eac14040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-03T11:22:01.089 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:01.089+0000 7f619ce0f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-03T11:22:01.209 INFO:tasks.ceph.osd.0.smithi131.stderr:2023-12-03T11:22:01.207+0000 7f22fca16500 -1 Falling back to public interface 2023-12-03T11:22:01.211 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:01.210+0000 7f58eac14040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-03T11:22:01.218 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-12-03T11:22:01.217+0000 7fe24a60e500 -1 Falling back to public interface 2023-12-03T11:22:01.218 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-12-03T11:22:01.218+0000 7f932fbbe500 -1 Falling back to public interface 2023-12-03T11:22:01.223 INFO:tasks.ceph.osd.1.smithi131.stderr:2023-12-03T11:22:01.222+0000 7fd569a23500 -1 Falling back to public interface 2023-12-03T11:22:01.229 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:01.228+0000 7f619ce0f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-03T11:22:01.233 INFO:tasks.ceph.osd.2.smithi131.stderr:2023-12-03T11:22:01.232+0000 7f870becf500 -1 Falling back to public interface 2023-12-03T11:22:01.235 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-12-03T11:22:01.234+0000 7f3b32e0c500 -1 Falling back to public interface 2023-12-03T11:22:01.235 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-03T11:22:01.234+0000 7f4673325500 -1 Falling back to public interface 2023-12-03T11:22:01.235 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-03T11:22:01.235+0000 7f46722cc640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-12-03T11:22:01.238 INFO:tasks.ceph.osd.3.smithi131.stderr:2023-12-03T11:22:01.237+0000 7f315161c500 -1 Falling back to public interface 2023-12-03T11:22:01.661 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-03T11:22:01.832 INFO:teuthology.misc.health.smithi131.stdout: 2023-12-03T11:22:01.832 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":10,"fsid":"666a215a-2cfd-4a1c-90d3-5202ec868043","created":"2023-12-03T11:21:58.358528+0000","modified":"2023-12-03T11:22:00.585004+0000","last_up_change":"0.000000","last_in_change":"2023-12-03T11:22:00.585004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e0dc6080-5d4a-4384-af9c-946f4b87bd55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b51ea299-720b-494f-9168-f281da3efcfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c131a91e-f214-4127-8dbb-b6bcfd207715","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0c5e1c10-cea3-4bbd-822f-817505238e44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9543b361-87b7-44f5-8ec7-d8a8eb0a9abd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a9325e67-7d72-4c93-aea6-094128a0f451","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f6637e8-71a7-4c19-a45e-ae7828747391","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cf2f61d8-b3f7-4f47-a5ab-27852d6778a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:22:01.842 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-03T11:22:02.020 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:02.019+0000 7f619ce0f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-03T11:22:02.037 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:02.036+0000 7f58eac14040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-03T11:22:02.288 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:02.288+0000 7f619ce0f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-03T11:22:02.305 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:02.304+0000 7f58eac14040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-03T11:22:02.340 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:02.340+0000 7f619ce0f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-03T11:22:02.357 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:02.356+0000 7f58eac14040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-03T11:22:02.442 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:02.441+0000 7f619ce0f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-03T11:22:02.457 INFO:tasks.ceph.mgr.y.smithi131.stderr:2023-12-03T11:22:02.456+0000 7f58eac14040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-03T11:22:03.468 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:03.468+0000 7f613dd5d640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-03T11:22:03.469 INFO:tasks.ceph.mgr.x.smithi148.stderr:2023-12-03T11:22:03.468+0000 7f613dd5d640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-03T11:22:04.664 INFO:tasks.ceph.osd.0.smithi131.stderr:2023-12-03T11:22:04.663+0000 7f22fca16500 -1 osd.0 0 log_to_monitors true 2023-12-03T11:22:04.697 INFO:tasks.ceph.osd.1.smithi131.stderr:2023-12-03T11:22:04.695+0000 7fd569a23500 -1 osd.1 0 log_to_monitors true 2023-12-03T11:22:04.709 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-12-03T11:22:04.708+0000 7f932fbbe500 -1 osd.6 0 log_to_monitors true 2023-12-03T11:22:04.739 INFO:tasks.ceph.osd.2.smithi131.stderr:2023-12-03T11:22:04.738+0000 7f870becf500 -1 osd.2 0 log_to_monitors true 2023-12-03T11:22:04.766 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-12-03T11:22:04.765+0000 7f3b32e0c500 -1 osd.5 0 log_to_monitors true 2023-12-03T11:22:04.769 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-12-03T11:22:04.769+0000 7fe24a60e500 -1 osd.4 0 log_to_monitors true 2023-12-03T11:22:04.770 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-03T11:22:04.770+0000 7f4673325500 -1 osd.7 0 log_to_monitors true 2023-12-03T11:22:04.778 INFO:tasks.ceph.osd.3.smithi131.stderr:2023-12-03T11:22:04.777+0000 7f315161c500 -1 osd.3 0 log_to_monitors true 2023-12-03T11:22:08.502 INFO:tasks.ceph.osd.3.smithi131.stderr:2023-12-03T11:22:08.501+0000 7f314c7c9640 -1 osd.3 0 waiting for initial osdmap 2023-12-03T11:22:08.511 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-03T11:22:08.509+0000 7f466ea90640 -1 osd.7 0 waiting for initial osdmap 2023-12-03T11:22:08.511 INFO:tasks.ceph.osd.1.smithi131.stderr:2023-12-03T11:22:08.510+0000 7fd564bf0640 -1 osd.1 0 waiting for initial osdmap 2023-12-03T11:22:08.513 INFO:tasks.ceph.osd.2.smithi131.stderr:2023-12-03T11:22:08.512+0000 7f870763a640 -1 osd.2 0 waiting for initial osdmap 2023-12-03T11:22:08.517 INFO:tasks.ceph.osd.3.smithi131.stderr:2023-12-03T11:22:08.516+0000 7f3144e01640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:22:08.525 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-03T11:22:08.524+0000 7f46670c8640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:22:08.526 INFO:tasks.ceph.osd.1.smithi131.stderr:2023-12-03T11:22:08.525+0000 7fd55d228640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:22:08.530 INFO:tasks.ceph.osd.2.smithi131.stderr:2023-12-03T11:22:08.529+0000 7f86ffc72640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:22:08.534 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-12-03T11:22:08.532+0000 7fe245d79640 -1 osd.4 0 waiting for initial osdmap 2023-12-03T11:22:08.543 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-12-03T11:22:08.542+0000 7fe23e3b1640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:22:08.560 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-12-03T11:22:08.559+0000 7f932b32b640 -1 osd.6 0 waiting for initial osdmap 2023-12-03T11:22:08.565 INFO:tasks.ceph.osd.0.smithi131.stderr:2023-12-03T11:22:08.564+0000 7f22f7b9e640 -1 osd.0 0 waiting for initial osdmap 2023-12-03T11:22:08.568 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-12-03T11:22:08.567+0000 7f9323963640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:22:08.584 INFO:tasks.ceph.osd.0.smithi131.stderr:2023-12-03T11:22:08.583+0000 7f22f01d6640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:22:08.607 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-12-03T11:22:08.605+0000 7f3b2df0f640 -1 osd.5 0 waiting for initial osdmap 2023-12-03T11:22:08.616 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-12-03T11:22:08.615+0000 7f3b26547640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-03T11:22:08.648 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-03T11:22:08.917 INFO:teuthology.misc.health.smithi131.stdout: 2023-12-03T11:22:08.918 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":12,"fsid":"666a215a-2cfd-4a1c-90d3-5202ec868043","created":"2023-12-03T11:21:58.358528+0000","modified":"2023-12-03T11:22:06.466969+0000","last_up_change":"0.000000","last_in_change":"2023-12-03T11:22:00.585004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e0dc6080-5d4a-4384-af9c-946f4b87bd55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b51ea299-720b-494f-9168-f281da3efcfd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c131a91e-f214-4127-8dbb-b6bcfd207715","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0c5e1c10-cea3-4bbd-822f-817505238e44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9543b361-87b7-44f5-8ec7-d8a8eb0a9abd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a9325e67-7d72-4c93-aea6-094128a0f451","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f6637e8-71a7-4c19-a45e-ae7828747391","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cf2f61d8-b3f7-4f47-a5ab-27852d6778a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:22:08.928 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-03T11:22:15.738 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-03T11:22:16.016 INFO:teuthology.misc.health.smithi131.stdout: 2023-12-03T11:22:16.016 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":16,"fsid":"666a215a-2cfd-4a1c-90d3-5202ec868043","created":"2023-12-03T11:21:58.358528+0000","modified":"2023-12-03T11:22:12.522883+0000","last_up_change":"2023-12-03T11:22:09.517837+0000","last_in_change":"2023-12-03T11:22:00.585004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-03T11:22:10.504790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0dc6080-5d4a-4384-af9c-946f4b87bd55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6801","nonce":946067187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6803","nonce":946067187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6807","nonce":946067187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6805","nonce":946067187}]},"public_addr":"172.21.15.131:6801/946067187","cluster_addr":"172.21.15.131:6803/946067187","heartbeat_back_addr":"172.21.15.131:6807/946067187","heartbeat_front_addr":"172.21.15.131:6805/946067187","state":["exists","up"]},{"osd":1,"uuid":"b51ea299-720b-494f-9168-f281da3efcfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6809","nonce":2158589240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6811","nonce":2158589240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6815","nonce":2158589240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6813","nonce":2158589240}]},"public_addr":"172.21.15.131:6809/2158589240","cluster_addr":"172.21.15.131:6811/2158589240","heartbeat_back_addr":"172.21.15.131:6815/2158589240","heartbeat_front_addr":"172.21.15.131:6813/2158589240","state":["exists","up"]},{"osd":2,"uuid":"c131a91e-f214-4127-8dbb-b6bcfd207715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6817","nonce":3071035975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6819","nonce":3071035975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6823","nonce":3071035975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6821","nonce":3071035975}]},"public_addr":"172.21.15.131:6817/3071035975","cluster_addr":"172.21.15.131:6819/3071035975","heartbeat_back_addr":"172.21.15.131:6823/3071035975","heartbeat_front_addr":"172.21.15.131:6821/3071035975","state":["exists","up"]},{"osd":3,"uuid":"0c5e1c10-cea3-4bbd-822f-817505238e44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6825","nonce":184481672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6827","nonce":184481672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6831","nonce":184481672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6829","nonce":184481672}]},"public_addr":"172.21.15.131:6825/184481672","cluster_addr":"172.21.15.131:6827/184481672","heartbeat_back_addr":"172.21.15.131:6831/184481672","heartbeat_front_addr":"172.21.15.131:6829/184481672","state":["exists","up"]},{"osd":4,"uuid":"9543b361-87b7-44f5-8ec7-d8a8eb0a9abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6801","nonce":4184359357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6803","nonce":4184359357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6807","nonce":4184359357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6805","nonce":4184359357}]},"public_addr":"172.21.15.148:6801/4184359357","cluster_addr":"172.21.15.148:6803/4184359357","heartbeat_back_addr":"172.21.15.148:6807/4184359357","heartbeat_front_addr":"172.21.15.148:6805/4184359357","state":["exists","up"]},{"osd":5,"uuid":"a9325e67-7d72-4c93-aea6-094128a0f451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6818","nonce":1462848938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6822","nonce":1462848938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6830","nonce":1462848938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6826","nonce":1462848938}]},"public_addr":"172.21.15.148:6818/1462848938","cluster_addr":"172.21.15.148:6822/1462848938","heartbeat_back_addr":"172.21.15.148:6830/1462848938","heartbeat_front_addr":"172.21.15.148:6826/1462848938","state":["exists","up"]},{"osd":6,"uuid":"2f6637e8-71a7-4c19-a45e-ae7828747391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6809","nonce":1983247150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6811","nonce":1983247150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6815","nonce":1983247150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6813","nonce":1983247150}]},"public_addr":"172.21.15.148:6809/1983247150","cluster_addr":"172.21.15.148:6811/1983247150","heartbeat_back_addr":"172.21.15.148:6815/1983247150","heartbeat_front_addr":"172.21.15.148:6813/1983247150","state":["exists","up"]},{"osd":7,"uuid":"cf2f61d8-b3f7-4f47-a5ab-27852d6778a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6819","nonce":2085634430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6823","nonce":2085634430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6831","nonce":2085634430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6827","nonce":2085634430}]},"public_addr":"172.21.15.148:6819/2085634430","cluster_addr":"172.21.15.148:6823/2085634430","heartbeat_back_addr":"172.21.15.148:6831/2085634430","heartbeat_front_addr":"172.21.15.148:6827/2085634430","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.689628+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.700394+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.754531+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.763060+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.723251+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.816889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.680250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.772050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:22:16.028 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-03T11:22:16.028 INFO:tasks.ceph:Creating RBD pool 2023-12-03T11:22:16.028 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd pool create rbd 8 2023-12-03T11:22:16.534 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'rbd' created 2023-12-03T11:22:16.549 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-03T11:22:17.536 INFO:teuthology.orchestra.run.smithi131.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-03T11:22:17.556 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-03T11:22:17.556 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-03T11:22:17.556 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-03T11:22:17.556 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-03T11:22:17.557 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-03T11:22:17.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:22:17.901 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6832","nonce":4108154146},{"type":"v1","addr":"172.21.15.148:6833","nonce":4108154146}]},"active_addr":"172.21.15.148:6833/4108154146","active_change":"2023-12-03T11:22:02.454833+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":4247357949}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":4279354839}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":1461962490}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.148:0","nonce":2970837686}]}]} 2023-12-03T11:22:17.905 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-03T11:22:17.905 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-03T11:22:17.906 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-03T11:22:18.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:22:18.188 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":18,"fsid":"666a215a-2cfd-4a1c-90d3-5202ec868043","created":"2023-12-03T11:21:58.358528+0000","modified":"2023-12-03T11:22:17.534075+0000","last_up_change":"2023-12-03T11:22:09.517837+0000","last_in_change":"2023-12-03T11:22:00.585004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-03T11:22:10.504790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-03T11:22:16.320496+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0dc6080-5d4a-4384-af9c-946f4b87bd55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6801","nonce":946067187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6803","nonce":946067187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6807","nonce":946067187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6805","nonce":946067187}]},"public_addr":"172.21.15.131:6801/946067187","cluster_addr":"172.21.15.131:6803/946067187","heartbeat_back_addr":"172.21.15.131:6807/946067187","heartbeat_front_addr":"172.21.15.131:6805/946067187","state":["exists","up"]},{"osd":1,"uuid":"b51ea299-720b-494f-9168-f281da3efcfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6809","nonce":2158589240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6811","nonce":2158589240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6815","nonce":2158589240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6813","nonce":2158589240}]},"public_addr":"172.21.15.131:6809/2158589240","cluster_addr":"172.21.15.131:6811/2158589240","heartbeat_back_addr":"172.21.15.131:6815/2158589240","heartbeat_front_addr":"172.21.15.131:6813/2158589240","state":["exists","up"]},{"osd":2,"uuid":"c131a91e-f214-4127-8dbb-b6bcfd207715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6817","nonce":3071035975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6819","nonce":3071035975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6823","nonce":3071035975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6821","nonce":3071035975}]},"public_addr":"172.21.15.131:6817/3071035975","cluster_addr":"172.21.15.131:6819/3071035975","heartbeat_back_addr":"172.21.15.131:6823/3071035975","heartbeat_front_addr":"172.21.15.131:6821/3071035975","state":["exists","up"]},{"osd":3,"uuid":"0c5e1c10-cea3-4bbd-822f-817505238e44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6825","nonce":184481672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6827","nonce":184481672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6831","nonce":184481672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6829","nonce":184481672}]},"public_addr":"172.21.15.131:6825/184481672","cluster_addr":"172.21.15.131:6827/184481672","heartbeat_back_addr":"172.21.15.131:6831/184481672","heartbeat_front_addr":"172.21.15.131:6829/184481672","state":["exists","up"]},{"osd":4,"uuid":"9543b361-87b7-44f5-8ec7-d8a8eb0a9abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6801","nonce":4184359357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6803","nonce":4184359357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6807","nonce":4184359357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6805","nonce":4184359357}]},"public_addr":"172.21.15.148:6801/4184359357","cluster_addr":"172.21.15.148:6803/4184359357","heartbeat_back_addr":"172.21.15.148:6807/4184359357","heartbeat_front_addr":"172.21.15.148:6805/4184359357","state":["exists","up"]},{"osd":5,"uuid":"a9325e67-7d72-4c93-aea6-094128a0f451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6818","nonce":1462848938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6822","nonce":1462848938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6830","nonce":1462848938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6826","nonce":1462848938}]},"public_addr":"172.21.15.148:6818/1462848938","cluster_addr":"172.21.15.148:6822/1462848938","heartbeat_back_addr":"172.21.15.148:6830/1462848938","heartbeat_front_addr":"172.21.15.148:6826/1462848938","state":["exists","up"]},{"osd":6,"uuid":"2f6637e8-71a7-4c19-a45e-ae7828747391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6809","nonce":1983247150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6811","nonce":1983247150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6815","nonce":1983247150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6813","nonce":1983247150}]},"public_addr":"172.21.15.148:6809/1983247150","cluster_addr":"172.21.15.148:6811/1983247150","heartbeat_back_addr":"172.21.15.148:6815/1983247150","heartbeat_front_addr":"172.21.15.148:6813/1983247150","state":["exists","up"]},{"osd":7,"uuid":"cf2f61d8-b3f7-4f47-a5ab-27852d6778a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6819","nonce":2085634430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6823","nonce":2085634430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6831","nonce":2085634430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6827","nonce":2085634430}]},"public_addr":"172.21.15.148:6819/2085634430","cluster_addr":"172.21.15.148:6823/2085634430","heartbeat_back_addr":"172.21.15.148:6831/2085634430","heartbeat_front_addr":"172.21.15.148:6827/2085634430","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.689628+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.700394+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.754531+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.763060+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.723251+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.816889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.680250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.772050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:22:18.200 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-03T11:22:18.201 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-03T11:22:18.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:22:18.480 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":18,"fsid":"666a215a-2cfd-4a1c-90d3-5202ec868043","created":"2023-12-03T11:21:58.358528+0000","modified":"2023-12-03T11:22:17.534075+0000","last_up_change":"2023-12-03T11:22:09.517837+0000","last_in_change":"2023-12-03T11:22:00.585004+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-03T11:22:10.504790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-03T11:22:16.320496+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e0dc6080-5d4a-4384-af9c-946f4b87bd55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6801","nonce":946067187}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6803","nonce":946067187}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6807","nonce":946067187}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":946067187},{"type":"v1","addr":"172.21.15.131:6805","nonce":946067187}]},"public_addr":"172.21.15.131:6801/946067187","cluster_addr":"172.21.15.131:6803/946067187","heartbeat_back_addr":"172.21.15.131:6807/946067187","heartbeat_front_addr":"172.21.15.131:6805/946067187","state":["exists","up"]},{"osd":1,"uuid":"b51ea299-720b-494f-9168-f281da3efcfd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6809","nonce":2158589240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6811","nonce":2158589240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6815","nonce":2158589240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2158589240},{"type":"v1","addr":"172.21.15.131:6813","nonce":2158589240}]},"public_addr":"172.21.15.131:6809/2158589240","cluster_addr":"172.21.15.131:6811/2158589240","heartbeat_back_addr":"172.21.15.131:6815/2158589240","heartbeat_front_addr":"172.21.15.131:6813/2158589240","state":["exists","up"]},{"osd":2,"uuid":"c131a91e-f214-4127-8dbb-b6bcfd207715","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6817","nonce":3071035975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6819","nonce":3071035975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6823","nonce":3071035975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":3071035975},{"type":"v1","addr":"172.21.15.131:6821","nonce":3071035975}]},"public_addr":"172.21.15.131:6817/3071035975","cluster_addr":"172.21.15.131:6819/3071035975","heartbeat_back_addr":"172.21.15.131:6823/3071035975","heartbeat_front_addr":"172.21.15.131:6821/3071035975","state":["exists","up"]},{"osd":3,"uuid":"0c5e1c10-cea3-4bbd-822f-817505238e44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6825","nonce":184481672}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6827","nonce":184481672}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6831","nonce":184481672}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":184481672},{"type":"v1","addr":"172.21.15.131:6829","nonce":184481672}]},"public_addr":"172.21.15.131:6825/184481672","cluster_addr":"172.21.15.131:6827/184481672","heartbeat_back_addr":"172.21.15.131:6831/184481672","heartbeat_front_addr":"172.21.15.131:6829/184481672","state":["exists","up"]},{"osd":4,"uuid":"9543b361-87b7-44f5-8ec7-d8a8eb0a9abd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6800","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6801","nonce":4184359357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6802","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6803","nonce":4184359357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6806","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6807","nonce":4184359357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6804","nonce":4184359357},{"type":"v1","addr":"172.21.15.148:6805","nonce":4184359357}]},"public_addr":"172.21.15.148:6801/4184359357","cluster_addr":"172.21.15.148:6803/4184359357","heartbeat_back_addr":"172.21.15.148:6807/4184359357","heartbeat_front_addr":"172.21.15.148:6805/4184359357","state":["exists","up"]},{"osd":5,"uuid":"a9325e67-7d72-4c93-aea6-094128a0f451","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6816","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6818","nonce":1462848938}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6820","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6822","nonce":1462848938}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6828","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6830","nonce":1462848938}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6824","nonce":1462848938},{"type":"v1","addr":"172.21.15.148:6826","nonce":1462848938}]},"public_addr":"172.21.15.148:6818/1462848938","cluster_addr":"172.21.15.148:6822/1462848938","heartbeat_back_addr":"172.21.15.148:6830/1462848938","heartbeat_front_addr":"172.21.15.148:6826/1462848938","state":["exists","up"]},{"osd":6,"uuid":"2f6637e8-71a7-4c19-a45e-ae7828747391","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6808","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6809","nonce":1983247150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6810","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6811","nonce":1983247150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6814","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6815","nonce":1983247150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6812","nonce":1983247150},{"type":"v1","addr":"172.21.15.148:6813","nonce":1983247150}]},"public_addr":"172.21.15.148:6809/1983247150","cluster_addr":"172.21.15.148:6811/1983247150","heartbeat_back_addr":"172.21.15.148:6815/1983247150","heartbeat_front_addr":"172.21.15.148:6813/1983247150","state":["exists","up"]},{"osd":7,"uuid":"cf2f61d8-b3f7-4f47-a5ab-27852d6778a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6817","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6819","nonce":2085634430}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6821","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6823","nonce":2085634430}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6829","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6831","nonce":2085634430}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.148:6825","nonce":2085634430},{"type":"v1","addr":"172.21.15.148:6827","nonce":2085634430}]},"public_addr":"172.21.15.148:6819/2085634430","cluster_addr":"172.21.15.148:6823/2085634430","heartbeat_back_addr":"172.21.15.148:6831/2085634430","heartbeat_front_addr":"172.21.15.148:6827/2085634430","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.689628+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.700394+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.754531+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.763060+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.723251+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.816889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.680250+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-03T11:22:05.772050+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-03T11:22:18.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-03T11:22:18.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-03T11:22:18.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-03T11:22:18.494 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-03T11:22:18.494 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-03T11:22:18.494 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-03T11:22:18.495 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-03T11:22:18.496 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-03T11:22:18.743 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:18.743 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-03T11:22:18.747 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:18.747 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:18.748 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-03T11:22:18.748 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-03T11:22:18.749 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:18.750 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-03T11:22:18.750 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:18.750 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:18.751 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-03T11:22:18.751 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-03T11:22:18.752 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:18.752 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-03T11:22:18.753 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:18.754 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-03T11:22:19.298 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:19.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-12-03T11:22:19.348 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:19.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-12-03T11:22:19.370 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:19.381 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:19.382 INFO:teuthology.orchestra.run.smithi131.stdout:55834574851 2023-12-03T11:22:19.385 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-12-03T11:22:19.387 INFO:teuthology.orchestra.run.smithi131.stdout:55834574851 2023-12-03T11:22:19.390 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:19.396 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:19.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-12-03T11:22:19.400 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.7 2023-12-03T11:22:19.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2023-12-03T11:22:19.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-12-03T11:22:19.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-12-03T11:22:20.318 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-03T11:22:20.368 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-03T11:22:20.385 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-03T11:22:20.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-03T11:22:20.401 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-03T11:22:20.409 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-03T11:22:20.410 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-03T11:22:20.412 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-03T11:22:20.859 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:20.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-12-03T11:22:20.901 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:20.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-12-03T11:22:20.973 INFO:teuthology.orchestra.run.smithi131.stdout:55834574851 2023-12-03T11:22:20.975 INFO:teuthology.orchestra.run.smithi131.stdout:55834574851 2023-12-03T11:22:20.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2023-12-03T11:22:20.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.7 2023-12-03T11:22:21.003 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:21.003 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:21.004 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:21.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2023-12-03T11:22:21.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-12-03T11:22:21.023 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:21.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-12-03T11:22:21.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-12-03T11:22:21.880 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-03T11:22:21.915 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-03T11:22:21.992 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-03T11:22:21.992 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-03T11:22:22.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-03T11:22:22.022 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-03T11:22:22.025 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-03T11:22:22.036 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-03T11:22:22.357 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:22.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-12-03T11:22:22.377 DEBUG:teuthology.parallel:result is None 2023-12-03T11:22:22.439 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:22.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-12-03T11:22:22.457 DEBUG:teuthology.parallel:result is None 2023-12-03T11:22:22.514 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:22.526 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:22.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-12-03T11:22:22.527 DEBUG:teuthology.parallel:result is None 2023-12-03T11:22:22.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-12-03T11:22:22.539 DEBUG:teuthology.parallel:result is None 2023-12-03T11:22:22.555 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:22.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.7 2023-12-03T11:22:22.568 DEBUG:teuthology.parallel:result is None 2023-12-03T11:22:22.577 INFO:teuthology.orchestra.run.smithi131.stdout:55834574852 2023-12-03T11:22:22.584 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:22.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2023-12-03T11:22:22.596 DEBUG:teuthology.parallel:result is None 2023-12-03T11:22:22.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-12-03T11:22:22.598 DEBUG:teuthology.parallel:result is None 2023-12-03T11:22:22.610 INFO:teuthology.orchestra.run.smithi131.stdout:55834574853 2023-12-03T11:22:22.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2023-12-03T11:22:22.622 DEBUG:teuthology.parallel:result is None 2023-12-03T11:22:22.623 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-03T11:22:22.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-03T11:22:22.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:22:22.941 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2023-12-03T11:22:22.953 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-12-03T11:22:22.464316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218856,"kb_used_data":2660,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755864,"statfs":{"total":773094113280,"available":772870004736,"internally_reserved":0,"allocated":2723840,"data_stored":1684037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001705"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.784551+0000","last_change":"2023-12-03T11:22:17.542605+0000","last_active":"2023-12-03T11:22:18.784551+0000","last_peered":"2023-12-03T11:22:18.784551+0000","last_clean":"2023-12-03T11:22:18.784551+0000","last_became_active":"2023-12-03T11:22:17.542286+0000","last_became_peered":"2023-12-03T11:22:17.542286+0000","last_unstale":"2023-12-03T11:22:18.784551+0000","last_undegraded":"2023-12-03T11:22:18.784551+0000","last_fullsized":"2023-12-03T11:22:18.784551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T23:14:11.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.781488+0000","last_change":"2023-12-03T11:22:17.545351+0000","last_active":"2023-12-03T11:22:18.781488+0000","last_peered":"2023-12-03T11:22:18.781488+0000","last_clean":"2023-12-03T11:22:18.781488+0000","last_became_active":"2023-12-03T11:22:17.545066+0000","last_became_peered":"2023-12-03T11:22:17.545066+0000","last_unstale":"2023-12-03T11:22:18.781488+0000","last_undegraded":"2023-12-03T11:22:18.781488+0000","last_fullsized":"2023-12-03T11:22:18.781488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T14:35:54.652392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.784591+0000","last_change":"2023-12-03T11:22:17.644255+0000","last_active":"2023-12-03T11:22:18.784591+0000","last_peered":"2023-12-03T11:22:18.784591+0000","last_clean":"2023-12-03T11:22:18.784591+0000","last_became_active":"2023-12-03T11:22:17.643928+0000","last_became_peered":"2023-12-03T11:22:17.643928+0000","last_unstale":"2023-12-03T11:22:18.784591+0000","last_undegraded":"2023-12-03T11:22:18.784591+0000","last_fullsized":"2023-12-03T11:22:18.784591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T11:56:26.517301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.781501+0000","last_change":"2023-12-03T11:22:17.643870+0000","last_active":"2023-12-03T11:22:18.781501+0000","last_peered":"2023-12-03T11:22:18.781501+0000","last_clean":"2023-12-03T11:22:18.781501+0000","last_became_active":"2023-12-03T11:22:17.643635+0000","last_became_peered":"2023-12-03T11:22:17.643635+0000","last_unstale":"2023-12-03T11:22:18.781501+0000","last_undegraded":"2023-12-03T11:22:18.781501+0000","last_fullsized":"2023-12-03T11:22:18.781501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T19:35:54.178427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.542874+0000","last_change":"2023-12-03T11:22:17.544693+0000","last_active":"2023-12-03T11:22:18.542874+0000","last_peered":"2023-12-03T11:22:18.542874+0000","last_clean":"2023-12-03T11:22:18.542874+0000","last_became_active":"2023-12-03T11:22:17.544285+0000","last_became_peered":"2023-12-03T11:22:17.544285+0000","last_unstale":"2023-12-03T11:22:18.542874+0000","last_undegraded":"2023-12-03T11:22:18.542874+0000","last_fullsized":"2023-12-03T11:22:18.542874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T14:37:10.997683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.548791+0000","last_change":"2023-12-03T11:22:17.546433+0000","last_active":"2023-12-03T11:22:18.548791+0000","last_peered":"2023-12-03T11:22:18.548791+0000","last_clean":"2023-12-03T11:22:18.548791+0000","last_became_active":"2023-12-03T11:22:17.546104+0000","last_became_peered":"2023-12-03T11:22:17.546104+0000","last_unstale":"2023-12-03T11:22:18.548791+0000","last_undegraded":"2023-12-03T11:22:18.548791+0000","last_fullsized":"2023-12-03T11:22:18.548791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T13:54:51.255855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.784638+0000","last_change":"2023-12-03T11:22:17.544847+0000","last_active":"2023-12-03T11:22:18.784638+0000","last_peered":"2023-12-03T11:22:18.784638+0000","last_clean":"2023-12-03T11:22:18.784638+0000","last_became_active":"2023-12-03T11:22:17.544384+0000","last_became_peered":"2023-12-03T11:22:17.544384+0000","last_unstale":"2023-12-03T11:22:18.784638+0000","last_undegraded":"2023-12-03T11:22:18.784638+0000","last_fullsized":"2023-12-03T11:22:18.784638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T18:34:54.180112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.542874+0000","last_change":"2023-12-03T11:22:17.546785+0000","last_active":"2023-12-03T11:22:18.542874+0000","last_peered":"2023-12-03T11:22:18.542874+0000","last_clean":"2023-12-03T11:22:18.542874+0000","last_became_active":"2023-12-03T11:22:17.546419+0000","last_became_peered":"2023-12-03T11:22:17.546419+0000","last_unstale":"2023-12-03T11:22:18.542874+0000","last_undegraded":"2023-12-03T11:22:18.542874+0000","last_fullsized":"2023-12-03T11:22:18.542874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T23:18:40.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:22:17.540502+0000","last_change":"2023-12-03T11:22:11.548671+0000","last_active":"2023-12-03T11:22:17.540502+0000","last_peered":"2023-12-03T11:22:17.540502+0000","last_clean":"2023-12-03T11:22:17.540502+0000","last_became_active":"2023-12-03T11:22:11.547569+0000","last_became_peered":"2023-12-03T11:22:11.547569+0000","last_unstale":"2023-12-03T11:22:17.540502+0000","last_undegraded":"2023-12-03T11:22:17.540502+0000","last_fullsized":"2023-12-03T11:22:17.540502+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:10.519342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:10.519342+0000","last_clean_scrub_stamp":"2023-12-03T11:22:10.519342+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T23:19:03.633211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":653408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":782336,"data_stored":652389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-03T11:22:22.954 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-03T11:22:23.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:22:23.231 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2023-12-03T11:22:23.243 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-12-03T11:22:22.464316+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218856,"kb_used_data":2660,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755864,"statfs":{"total":773094113280,"available":772870004736,"internally_reserved":0,"allocated":2723840,"data_stored":1684037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001705"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.784551+0000","last_change":"2023-12-03T11:22:17.542605+0000","last_active":"2023-12-03T11:22:18.784551+0000","last_peered":"2023-12-03T11:22:18.784551+0000","last_clean":"2023-12-03T11:22:18.784551+0000","last_became_active":"2023-12-03T11:22:17.542286+0000","last_became_peered":"2023-12-03T11:22:17.542286+0000","last_unstale":"2023-12-03T11:22:18.784551+0000","last_undegraded":"2023-12-03T11:22:18.784551+0000","last_fullsized":"2023-12-03T11:22:18.784551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T23:14:11.791499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.781488+0000","last_change":"2023-12-03T11:22:17.545351+0000","last_active":"2023-12-03T11:22:18.781488+0000","last_peered":"2023-12-03T11:22:18.781488+0000","last_clean":"2023-12-03T11:22:18.781488+0000","last_became_active":"2023-12-03T11:22:17.545066+0000","last_became_peered":"2023-12-03T11:22:17.545066+0000","last_unstale":"2023-12-03T11:22:18.781488+0000","last_undegraded":"2023-12-03T11:22:18.781488+0000","last_fullsized":"2023-12-03T11:22:18.781488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T14:35:54.652392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.784591+0000","last_change":"2023-12-03T11:22:17.644255+0000","last_active":"2023-12-03T11:22:18.784591+0000","last_peered":"2023-12-03T11:22:18.784591+0000","last_clean":"2023-12-03T11:22:18.784591+0000","last_became_active":"2023-12-03T11:22:17.643928+0000","last_became_peered":"2023-12-03T11:22:17.643928+0000","last_unstale":"2023-12-03T11:22:18.784591+0000","last_undegraded":"2023-12-03T11:22:18.784591+0000","last_fullsized":"2023-12-03T11:22:18.784591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T11:56:26.517301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.781501+0000","last_change":"2023-12-03T11:22:17.643870+0000","last_active":"2023-12-03T11:22:18.781501+0000","last_peered":"2023-12-03T11:22:18.781501+0000","last_clean":"2023-12-03T11:22:18.781501+0000","last_became_active":"2023-12-03T11:22:17.643635+0000","last_became_peered":"2023-12-03T11:22:17.643635+0000","last_unstale":"2023-12-03T11:22:18.781501+0000","last_undegraded":"2023-12-03T11:22:18.781501+0000","last_fullsized":"2023-12-03T11:22:18.781501+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T19:35:54.178427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.542874+0000","last_change":"2023-12-03T11:22:17.544693+0000","last_active":"2023-12-03T11:22:18.542874+0000","last_peered":"2023-12-03T11:22:18.542874+0000","last_clean":"2023-12-03T11:22:18.542874+0000","last_became_active":"2023-12-03T11:22:17.544285+0000","last_became_peered":"2023-12-03T11:22:17.544285+0000","last_unstale":"2023-12-03T11:22:18.542874+0000","last_undegraded":"2023-12-03T11:22:18.542874+0000","last_fullsized":"2023-12-03T11:22:18.542874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T14:37:10.997683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.548791+0000","last_change":"2023-12-03T11:22:17.546433+0000","last_active":"2023-12-03T11:22:18.548791+0000","last_peered":"2023-12-03T11:22:18.548791+0000","last_clean":"2023-12-03T11:22:18.548791+0000","last_became_active":"2023-12-03T11:22:17.546104+0000","last_became_peered":"2023-12-03T11:22:17.546104+0000","last_unstale":"2023-12-03T11:22:18.548791+0000","last_undegraded":"2023-12-03T11:22:18.548791+0000","last_fullsized":"2023-12-03T11:22:18.548791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T13:54:51.255855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.784638+0000","last_change":"2023-12-03T11:22:17.544847+0000","last_active":"2023-12-03T11:22:18.784638+0000","last_peered":"2023-12-03T11:22:18.784638+0000","last_clean":"2023-12-03T11:22:18.784638+0000","last_became_active":"2023-12-03T11:22:17.544384+0000","last_became_peered":"2023-12-03T11:22:17.544384+0000","last_unstale":"2023-12-03T11:22:18.784638+0000","last_undegraded":"2023-12-03T11:22:18.784638+0000","last_fullsized":"2023-12-03T11:22:18.784638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T18:34:54.180112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-03T11:22:18.542874+0000","last_change":"2023-12-03T11:22:17.546785+0000","last_active":"2023-12-03T11:22:18.542874+0000","last_peered":"2023-12-03T11:22:18.542874+0000","last_clean":"2023-12-03T11:22:18.542874+0000","last_became_active":"2023-12-03T11:22:17.546419+0000","last_became_peered":"2023-12-03T11:22:17.546419+0000","last_unstale":"2023-12-03T11:22:18.542874+0000","last_undegraded":"2023-12-03T11:22:18.542874+0000","last_fullsized":"2023-12-03T11:22:18.542874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:16.530592+0000","last_clean_scrub_stamp":"2023-12-03T11:22:16.530592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T23:18:40.372561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-12-03T11:22:17.540502+0000","last_change":"2023-12-03T11:22:11.548671+0000","last_active":"2023-12-03T11:22:17.540502+0000","last_peered":"2023-12-03T11:22:17.540502+0000","last_clean":"2023-12-03T11:22:17.540502+0000","last_became_active":"2023-12-03T11:22:11.547569+0000","last_became_peered":"2023-12-03T11:22:11.547569+0000","last_unstale":"2023-12-03T11:22:17.540502+0000","last_undegraded":"2023-12-03T11:22:17.540502+0000","last_fullsized":"2023-12-03T11:22:17.540502+0000","mapping_epoch":14,"log_start":"15'100","ondisk_log_start":"15'100","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-03T11:22:10.519342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-03T11:22:10.519342+0000","last_clean_scrub_stamp":"2023-12-03T11:22:10.519342+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-04T23:19:03.633211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":786432,"data_stored":653408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3520000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":63040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":782336,"data_stored":652389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-03T11:22:23.244 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-03T11:22:23.244 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-03T11:22:23.244 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-03T11:22:23.244 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-03T11:22:23.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:22:23.554 INFO:teuthology.orchestra.run.smithi131.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-03T11:22:23.566 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-03T11:22:23.567 INFO:teuthology.run_tasks:Running task openssl_keys... 2023-12-03T11:22:23.579 INFO:teuthology.run_tasks:Running task rgw... 2023-12-03T11:22:23.598 DEBUG:tasks.rgw:config is {'client.0': None} 2023-12-03T11:22:23.598 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2023-12-03T11:22:23.598 INFO:tasks.rgw:Creating data pools 2023-12-03T11:22:23.598 DEBUG:tasks.rgw:Obtaining remote for client client.0 2023-12-03T11:22:23.599 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2023-12-03T11:22:24.129 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'default.rgw.buckets.data' created 2023-12-03T11:22:24.148 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2023-12-03T11:22:25.135 INFO:teuthology.orchestra.run.smithi131.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2023-12-03T11:22:25.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2023-12-03T11:22:26.139 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'default.rgw.buckets.index' created 2023-12-03T11:22:26.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2023-12-03T11:22:27.146 INFO:teuthology.orchestra.run.smithi131.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2023-12-03T11:22:27.173 DEBUG:tasks.rgw:Pools created 2023-12-03T11:22:27.173 INFO:tasks.rgw:Configuring compression type = random 2023-12-03T11:22:27.173 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2023-12-03T11:22:27.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2023-12-03T11:22:27.174 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2023-12-03T11:22:27.271 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:22:27.271 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:22:27.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:27.281+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.167+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:29.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.167+0000 7fc14b311800 20 realm 2023-12-03T11:22:29.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.167+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.167+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:29.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.167+0000 7fc14b311800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:22:29.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.167+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.168+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:29.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.168+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.169+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:29.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.169+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.169+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:29.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.169+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.170+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:29.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.170+0000 7fc14b311800 10 Creating default zonegroup 2023-12-03T11:22:29.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.170+0000 7fc14b311800 10 couldn't find old data placement pools config, setting up new ones for the zone 2023-12-03T11:22:29.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.179+0000 7fc148e18640 0 -- 172.21.15.131:0/1340496944 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7fc13c046040 msgr2=0x7fc13c046420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:22:29.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.183+0000 7fc14b311800 10 WARNING: driver->list_zones() returned r=-2 2023-12-03T11:22:29.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.183+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.184+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:29.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.185+0000 7fc148617640 0 -- 172.21.15.131:0/1340496944 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55c82a562650 msgr2=0x55c82a564a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:22:29.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.187+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.187+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:29.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.187+0000 7fc14b311800 10 could not read realm id: (2) No such file or directory 2023-12-03T11:22:29.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.187+0000 7fc14b311800 10 WARNING: failed to set zone as default, r=-22 2023-12-03T11:22:29.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.187+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.187+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:29.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.190+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.190+0000 7fc14b311800 20 rados_obj.operate() r=0 bl.length=874 2023-12-03T11:22:29.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.190+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.191+0000 7fc14b311800 20 rados_obj.operate() r=0 bl.length=420 2023-12-03T11:22:29.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.191+0000 7fc14b311800 10 Using default name default 2023-12-03T11:22:29.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.191+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:22:29.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 20 rados_obj.operate() r=0 bl.length=874 2023-12-03T11:22:29.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 20 zone default found 2023-12-03T11:22:29.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 4 Realm: () 2023-12-03T11:22:29.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:22:29.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:22:29.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:22:29.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 20 zonegroup default 2023-12-03T11:22:29.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:29.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:29.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:29.192+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:31.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:31.170+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:31.172 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:31.170+0000 7fc14b311800 20 rados->read ofs=0 len=0 2023-12-03T11:22:31.172 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:31.170+0000 7fc14b311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:31.172 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:31.170+0000 7fc14b311800 20 started sync module instance, tier type = 2023-12-03T11:22:31.172 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:31.170+0000 7fc14b311800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:22:33.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.211+0000 7fc14b311800 20 add_watcher() i=0 2023-12-03T11:22:33.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.211+0000 7fc14b311800 20 add_watcher() i=1 2023-12-03T11:22:33.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.211+0000 7fc14b311800 20 add_watcher() i=2 2023-12-03T11:22:33.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.211+0000 7fc14b311800 20 add_watcher() i=3 2023-12-03T11:22:33.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.211+0000 7fc14b311800 20 add_watcher() i=4 2023-12-03T11:22:33.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.211+0000 7fc14b311800 20 add_watcher() i=5 2023-12-03T11:22:33.213 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.211+0000 7fc14b311800 20 add_watcher() i=6 2023-12-03T11:22:33.213 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.212+0000 7fc14b311800 20 add_watcher() i=7 2023-12-03T11:22:33.213 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.212+0000 7fc14b311800 2 all 8 watchers are set, enabling cache 2023-12-03T11:22:33.213 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.212+0000 7fc14b311800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2023-12-03T11:22:33.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.212+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2023-12-03T11:22:33.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.212+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.212+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2023-12-03T11:22:33.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.212+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2023-12-03T11:22:33.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.212+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2023-12-03T11:22:33.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2023-12-03T11:22:33.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2023-12-03T11:22:33.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2023-12-03T11:22:33.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.216 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2023-12-03T11:22:33.216 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2023-12-03T11:22:33.216 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.216 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2023-12-03T11:22:33.216 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2023-12-03T11:22:33.216 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.213+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.216 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2023-12-03T11:22:33.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2023-12-03T11:22:33.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2023-12-03T11:22:33.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2023-12-03T11:22:33.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2023-12-03T11:22:33.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2023-12-03T11:22:33.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2023-12-03T11:22:33.221 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2023-12-03T11:22:33.221 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.214+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.221 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2023-12-03T11:22:33.221 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2023-12-03T11:22:33.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2023-12-03T11:22:33.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2023-12-03T11:22:33.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2023-12-03T11:22:33.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2023-12-03T11:22:33.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2023-12-03T11:22:33.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2023-12-03T11:22:33.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.215+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.216+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2023-12-03T11:22:33.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.217+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2023-12-03T11:22:33.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2023-12-03T11:22:33.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2023-12-03T11:22:33.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2023-12-03T11:22:33.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2023-12-03T11:22:33.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2023-12-03T11:22:33.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.218+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2023-12-03T11:22:33.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2023-12-03T11:22:33.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2023-12-03T11:22:33.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2023-12-03T11:22:33.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2023-12-03T11:22:33.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2023-12-03T11:22:33.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.231 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.219+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.220+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2023-12-03T11:22:33.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.221+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.222+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.223+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2023-12-03T11:22:33.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2023-12-03T11:22:33.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2023-12-03T11:22:33.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2023-12-03T11:22:33.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2023-12-03T11:22:33.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2023-12-03T11:22:33.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.224+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2023-12-03T11:22:33.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2023-12-03T11:22:33.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.225+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2023-12-03T11:22:33.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2023-12-03T11:22:33.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2023-12-03T11:22:33.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2023-12-03T11:22:33.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2023-12-03T11:22:33.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2023-12-03T11:22:33.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.226+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2023-12-03T11:22:33.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.227+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.228+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2023-12-03T11:22:33.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.229+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2023-12-03T11:22:33.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2023-12-03T11:22:33.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.230+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.231+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2023-12-03T11:22:33.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.231+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2023-12-03T11:22:33.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.231+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.231+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.231+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.231+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.231+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.231+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.231+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2023-12-03T11:22:33.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2023-12-03T11:22:33.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2023-12-03T11:22:33.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2023-12-03T11:22:33.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.232+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.233+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2023-12-03T11:22:33.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.233+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2023-12-03T11:22:33.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.233+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.233+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2023-12-03T11:22:33.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.233+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2023-12-03T11:22:33.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.233+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.233+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.233+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.233+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2023-12-03T11:22:33.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.234+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.235+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.235+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.235+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.235+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.235+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.235+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.236+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.237+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.237+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.237+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.237+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.237+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.237+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2023-12-03T11:22:33.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.238+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2023-12-03T11:22:33.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.239+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.240+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2023-12-03T11:22:33.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.240+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.240+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.240+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.240+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.240+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.240+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.240+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.240+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.240+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.241+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2023-12-03T11:22:33.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.242+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.243+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.244+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.244+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.244+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.244+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.244+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.244+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.244+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2023-12-03T11:22:33.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.244+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2023-12-03T11:22:33.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.244+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.245+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2023-12-03T11:22:33.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.245+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2023-12-03T11:22:33.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.245+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.245+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2023-12-03T11:22:33.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.245+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2023-12-03T11:22:33.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.245+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.245+0000 7fc14b311800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2023-12-03T11:22:33.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.245+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1210 entering 2023-12-03T11:22:33.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.246+0000 7fc14b311800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1168 entering 2023-12-03T11:22:33.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.251+0000 7fc10efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:22:33.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.251+0000 7fc14b311800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:22:33.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:33.251+0000 7fc14b311800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:22:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.186+0000 7fc14b311800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2023-12-03T11:22:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.186+0000 7fc14b311800 5 note: GC not initialized 2023-12-03T11:22:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.187+0000 7fc075ffb640 20 reqs_thread_entry: start 2023-12-03T11:22:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.187+0000 7fc14b311800 20 init_complete bucket index max shards: 1 2023-12-03T11:22:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.187+0000 7fc14b311800 20 Filter name: none 2023-12-03T11:22:36.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.187+0000 7fc0677fe640 20 reqs_thread_entry: start 2023-12-03T11:22:36.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.213+0000 7fc10efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:22:36.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.216+0000 7fc14b311800 20 remove_watcher() i=0 2023-12-03T11:22:36.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.216+0000 7fc14b311800 2 removed watcher, disabling cache 2023-12-03T11:22:36.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.217+0000 7fc14b311800 20 remove_watcher() i=1 2023-12-03T11:22:36.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.219+0000 7fc14b311800 20 remove_watcher() i=2 2023-12-03T11:22:36.221 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.220+0000 7fc14b311800 20 remove_watcher() i=3 2023-12-03T11:22:36.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.222+0000 7fc14b311800 20 remove_watcher() i=4 2023-12-03T11:22:36.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.223+0000 7fc14b311800 20 remove_watcher() i=5 2023-12-03T11:22:36.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.226+0000 7fc14b311800 20 remove_watcher() i=6 2023-12-03T11:22:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.227+0000 7fc14b311800 20 remove_watcher() i=7 2023-12-03T11:22:36.243 INFO:teuthology.orchestra.run.smithi131.stdout:[] 2023-12-03T11:22:36.243 DEBUG:tasks.util.rgw: json result: [] 2023-12-03T11:22:36.243 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-03T11:22:36.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2023-12-03T11:22:36.243 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2023-12-03T11:22:36.292 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:22:36.292 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:22:36.303 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.302+0000 7f0013f1e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:22:36.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.302+0000 7f0013f1e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:22:36.306 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.305+0000 7eff4f7fe640 20 reqs_thread_entry: start 2023-12-03T11:22:36.317 INFO:teuthology.orchestra.run.smithi131.stdout:{"id":"e1920b66-3a00-44a2-8d9c-7e860031ca81","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-03T11:22:36.317 DEBUG:tasks.util.rgw: json result: {'id': 'e1920b66-3a00-44a2-8d9c-7e860031ca81', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-03T11:22:36.317 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2023-12-03T11:22:36.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2023-12-03T11:22:36.318 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2023-12-03T11:22:36.358 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:22:36.358 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:22:36.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.368+0000 7fea42940800 20 rados->read ofs=0 len=0 2023-12-03T11:22:36.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.370+0000 7fea42940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:36.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.370+0000 7fea42940800 20 realm 2023-12-03T11:22:36.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.370+0000 7fea42940800 20 rados->read ofs=0 len=0 2023-12-03T11:22:36.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.370+0000 7fea42940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:36.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.370+0000 7fea42940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:22:36.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.370+0000 7fea42940800 20 rados->read ofs=0 len=0 2023-12-03T11:22:36.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.371+0000 7fea42940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:36.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.371+0000 7fea42940800 20 rados->read ofs=0 len=0 2023-12-03T11:22:36.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.371+0000 7fea42940800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:22:36.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.371+0000 7fea42940800 20 rados->read ofs=0 len=0 2023-12-03T11:22:36.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.372+0000 7fea42940800 20 rados_obj.operate() r=0 bl.length=890 2023-12-03T11:22:36.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.372+0000 7fea42940800 20 searching for the correct realm 2023-12-03T11:22:36.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.381+0000 7fea3e64c640 0 -- 172.21.15.131:0/185750303 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7fea38061050 msgr2=0x7fea38088130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:22:36.384 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.383+0000 7fea42940800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:22:36.384 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.383+0000 7fea42940800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:22:36.385 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.383+0000 7fea42940800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:22:36.385 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.383+0000 7fea42940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:22:36.385 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.383+0000 7fea42940800 20 rados->read ofs=0 len=0 2023-12-03T11:22:36.385 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.383+0000 7fea42940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:36.385 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.383+0000 7fea42940800 20 rados->read ofs=0 len=0 2023-12-03T11:22:36.385 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.383+0000 7fea42940800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:22:36.385 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.383+0000 7fea42940800 20 rados->read ofs=0 len=0 2023-12-03T11:22:36.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 20 rados_obj.operate() r=0 bl.length=420 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 20 zone default found 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 4 Realm: () 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 20 zonegroup default 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 20 rados->read ofs=0 len=0 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 20 rados->read ofs=0 len=0 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 20 rados->read ofs=0 len=0 2023-12-03T11:22:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.384+0000 7fea42940800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:22:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.385+0000 7fea42940800 20 started sync module instance, tier type = 2023-12-03T11:22:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.385+0000 7fea42940800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:22:36.395 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.394+0000 7fea3e64c640 0 -- 172.21.15.131:0/185750303 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7fea18076940 msgr2=0x7fea18078d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:22:36.404 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.402+0000 7fea42940800 20 add_watcher() i=0 2023-12-03T11:22:36.404 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.402+0000 7fea42940800 20 add_watcher() i=1 2023-12-03T11:22:36.404 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.402+0000 7fea42940800 20 add_watcher() i=2 2023-12-03T11:22:36.404 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.402+0000 7fea42940800 20 add_watcher() i=3 2023-12-03T11:22:36.404 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.402+0000 7fea42940800 20 add_watcher() i=4 2023-12-03T11:22:36.404 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.402+0000 7fea42940800 20 add_watcher() i=5 2023-12-03T11:22:36.404 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.402+0000 7fea42940800 20 add_watcher() i=6 2023-12-03T11:22:36.405 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.403+0000 7fea42940800 20 add_watcher() i=7 2023-12-03T11:22:36.405 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.403+0000 7fea42940800 2 all 8 watchers are set, enabling cache 2023-12-03T11:22:36.407 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.405+0000 7fea03fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:22:36.407 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.406+0000 7fea42940800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:22:36.407 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.406+0000 7fea42940800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:22:36.412 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.410+0000 7fea42940800 5 note: GC not initialized 2023-12-03T11:22:36.412 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.410+0000 7fe972ffd640 20 reqs_thread_entry: start 2023-12-03T11:22:36.412 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.410+0000 7fea42940800 20 init_complete bucket index max shards: 1 2023-12-03T11:22:36.412 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.411+0000 7fea42940800 20 Filter name: none 2023-12-03T11:22:36.412 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.411+0000 7fe970ff9640 20 reqs_thread_entry: start 2023-12-03T11:22:36.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.420+0000 7fea03fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:22:36.423 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.422+0000 7fea42940800 20 remove_watcher() i=0 2023-12-03T11:22:36.423 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.422+0000 7fea42940800 2 removed watcher, disabling cache 2023-12-03T11:22:36.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.423+0000 7fea42940800 20 remove_watcher() i=1 2023-12-03T11:22:36.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.425+0000 7fea42940800 20 remove_watcher() i=2 2023-12-03T11:22:36.427 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.426+0000 7fea42940800 20 remove_watcher() i=3 2023-12-03T11:22:36.428 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.427+0000 7fea42940800 20 remove_watcher() i=4 2023-12-03T11:22:36.429 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.428+0000 7fea42940800 20 remove_watcher() i=5 2023-12-03T11:22:36.430 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.429+0000 7fea42940800 20 remove_watcher() i=6 2023-12-03T11:22:36.431 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.430+0000 7fea42940800 20 remove_watcher() i=7 2023-12-03T11:22:36.436 INFO:teuthology.orchestra.run.smithi131.stdout:[] 2023-12-03T11:22:36.436 DEBUG:tasks.util.rgw: json result: [] 2023-12-03T11:22:36.436 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2023-12-03T11:22:36.436 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2023-12-03T11:22:36.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2023-12-03T11:22:36.436 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2023-12-03T11:22:36.522 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:22:36.523 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:22:36.533 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.532+0000 7fd892685800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:22:36.534 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.532+0000 7fd892685800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:22:36.536 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.536+0000 7fd7ce7fc640 20 reqs_thread_entry: start 2023-12-03T11:22:36.546 INFO:teuthology.orchestra.run.smithi131.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2023-12-03T11:22:36.546 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2023-12-03T11:22:36.546 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2023-12-03T11:22:36.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2023-12-03T11:22:36.547 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2023-12-03T11:22:36.595 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:22:36.595 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:22:36.606 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.605+0000 7fd62b013800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:22:36.606 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.605+0000 7fd62b013800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:22:36.609 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.608+0000 7fd5667fc640 20 reqs_thread_entry: start 2023-12-03T11:22:36.619 INFO:teuthology.orchestra.run.smithi131.stdout:{"id":"e1920b66-3a00-44a2-8d9c-7e860031ca81","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-03T11:22:36.619 DEBUG:tasks.util.rgw: json result: {'id': 'e1920b66-3a00-44a2-8d9c-7e860031ca81', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-03T11:22:36.619 INFO:tasks.rgw:Configuring storage class type = FROZEN 2023-12-03T11:22:36.619 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2023-12-03T11:22:36.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2023-12-03T11:22:36.620 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2023-12-03T11:22:36.666 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:22:36.666 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:22:36.677 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.676+0000 7fc572d2c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:22:36.677 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.676+0000 7fc572d2c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:22:36.680 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.679+0000 7fc4abfff640 20 reqs_thread_entry: start 2023-12-03T11:22:36.689 INFO:teuthology.orchestra.run.smithi131.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2023-12-03T11:22:36.689 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2023-12-03T11:22:36.689 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2023-12-03T11:22:36.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2023-12-03T11:22:36.689 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2023-12-03T11:22:36.738 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:22:36.738 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:22:36.749 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.747+0000 7f5288e12800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:22:36.749 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.747+0000 7f5288e12800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:22:36.751 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:22:36.750+0000 7f51c27fc640 20 reqs_thread_entry: start 2023-12-03T11:22:36.763 INFO:teuthology.orchestra.run.smithi131.stdout:{"id":"e1920b66-3a00-44a2-8d9c-7e860031ca81","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2023-12-03T11:22:36.763 DEBUG:tasks.util.rgw: json result: {'id': 'e1920b66-3a00-44a2-8d9c-7e860031ca81', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2023-12-03T11:22:36.763 INFO:tasks.rgw:Starting rgw... 2023-12-03T11:22:36.763 INFO:tasks.rgw:rgw client.0 config is {} 2023-12-03T11:22:36.763 INFO:tasks.rgw:Using beast as radosgw frontend 2023-12-03T11:22:36.764 INFO:tasks.rgw.client.0:Restarting daemon 2023-12-03T11:22:36.764 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2023-12-03T11:22:36.766 INFO:tasks.rgw.client.0:Started 2023-12-03T11:22:36.766 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi131.front.sepia.ceph.com:80/ 2023-12-03T11:22:36.766 DEBUG:teuthology.orchestra.run.smithi131:> curl http://smithi131.front.sepia.ceph.com:80/ 2023-12-03T11:22:36.785 DEBUG:teuthology.orchestra.run:got remote process result: 7 2023-12-03T11:22:36.785 INFO:teuthology.orchestra.run.smithi131.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-03T11:22:36.785 INFO:teuthology.orchestra.run.smithi131.stderr: Dload Upload Total Spent Left Speed 2023-12-03T11:22:36.785 INFO:teuthology.orchestra.run.smithi131.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2023-12-03T11:22:36.786 INFO:teuthology.orchestra.run.smithi131.stderr:curl: (7) Failed to connect to smithi131.front.sepia.ceph.com port 80: Connection refused 2023-12-03T11:22:37.786 DEBUG:teuthology.orchestra.run.smithi131:> curl http://smithi131.front.sepia.ceph.com:80/ 2023-12-03T11:22:37.805 INFO:teuthology.orchestra.run.smithi131.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2023-12-03T11:22:37.805 INFO:teuthology.orchestra.run.smithi131.stderr: Dload Upload Total Spent Left Speed 2023-12-03T11:22:37.807 INFO:teuthology.orchestra.run.smithi131.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2023-12-03T11:22:37.807 INFO:teuthology.orchestra.run.smithi131.stdout:anonymous 2023-12-03T11:22:37.808 INFO:teuthology.run_tasks:Running task tox... 2023-12-03T11:22:37.822 INFO:tasks.tox:Deploying tox from pip... 2023-12-03T11:22:37.822 DEBUG:teuthology.orchestra.run.smithi131:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2023-12-03T11:22:40.268 DEBUG:teuthology.orchestra.run.smithi131:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2023-12-03T11:22:40.781 INFO:teuthology.orchestra.run.smithi131.stdout:Collecting tox==3.15.0 2023-12-03T11:22:41.565 INFO:teuthology.orchestra.run.smithi131.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2023-12-03T11:22:42.108 INFO:teuthology.orchestra.run.smithi131.stdout:Collecting filelock<4,>=3.0.0 2023-12-03T11:22:42.297 INFO:teuthology.orchestra.run.smithi131.stdout: Downloading filelock-3.13.1-py3-none-any.whl (11 kB) 2023-12-03T11:22:42.417 INFO:teuthology.orchestra.run.smithi131.stdout:Collecting py<2,>=1.4.17 2023-12-03T11:22:42.617 INFO:teuthology.orchestra.run.smithi131.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2023-12-03T11:22:42.940 INFO:teuthology.orchestra.run.smithi131.stdout:Collecting six<2,>=1.14.0 2023-12-03T11:22:43.128 INFO:teuthology.orchestra.run.smithi131.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:22:43.402 INFO:teuthology.orchestra.run.smithi131.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2023-12-03T11:22:43.604 INFO:teuthology.orchestra.run.smithi131.stdout: Downloading virtualenv-20.25.0-py3-none-any.whl (3.8 MB) 2023-12-03T11:22:46.781 INFO:teuthology.orchestra.run.smithi131.stdout:Collecting toml>=0.9.4 2023-12-03T11:22:46.959 INFO:teuthology.orchestra.run.smithi131.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2023-12-03T11:22:47.052 INFO:teuthology.orchestra.run.smithi131.stdout:Collecting pluggy<1,>=0.12.0 2023-12-03T11:22:47.231 INFO:teuthology.orchestra.run.smithi131.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2023-12-03T11:22:47.352 INFO:teuthology.orchestra.run.smithi131.stdout:Collecting packaging>=14 2023-12-03T11:22:47.537 INFO:teuthology.orchestra.run.smithi131.stdout: Downloading packaging-23.2-py3-none-any.whl (53 kB) 2023-12-03T11:22:47.703 INFO:teuthology.orchestra.run.smithi131.stdout:Collecting platformdirs<5,>=3.9.1 2023-12-03T11:22:47.888 INFO:teuthology.orchestra.run.smithi131.stdout: Downloading platformdirs-4.0.0-py3-none-any.whl (17 kB) 2023-12-03T11:22:47.987 INFO:teuthology.orchestra.run.smithi131.stdout:Collecting distlib<1,>=0.3.7 2023-12-03T11:22:48.183 INFO:teuthology.orchestra.run.smithi131.stdout: Downloading distlib-0.3.7-py2.py3-none-any.whl (468 kB) 2023-12-03T11:22:48.556 INFO:teuthology.orchestra.run.smithi131.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2023-12-03T11:22:49.377 INFO:teuthology.orchestra.run.smithi131.stdout:Successfully installed distlib-0.3.7 filelock-3.13.1 packaging-23.2 platformdirs-4.0.0 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.25.0 2023-12-03T11:22:49.590 INFO:teuthology.orchestra.run.smithi131.stderr:WARNING: You are using pip version 21.2.3; however, version 23.3.1 is available. 2023-12-03T11:22:49.591 INFO:teuthology.orchestra.run.smithi131.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2023-12-03T11:22:49.652 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:22:49.665 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:22:49.665 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:22:49.665 DEBUG:teuthology.orchestra.run.smithi131:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:22:49.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:22:49.680 INFO:teuthology.orchestra.run.smithi131.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:22:49.680 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:22:49.734 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:22:49.734 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:22:49.788 INFO:tasks.workunit:timeout=3h 2023-12-03T11:22:49.789 INFO:tasks.workunit:cleanup=True 2023-12-03T11:22:49.789 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:22:49.843 INFO:tasks.workunit.client.0.smithi131.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:23:55.593 INFO:tasks.workunit.client.0.smithi131.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:23:55.594 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:23:55.594 INFO:tasks.workunit.client.0.smithi131.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:23:55.594 INFO:tasks.workunit.client.0.smithi131.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:23:55.594 INFO:tasks.workunit.client.0.smithi131.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:23:55.594 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:23:55.594 INFO:tasks.workunit.client.0.smithi131.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:23:55.594 INFO:tasks.workunit.client.0.smithi131.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:23:55.594 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:23:55.594 INFO:tasks.workunit.client.0.smithi131.stderr: git switch -c 2023-12-03T11:23:55.595 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:23:55.595 INFO:tasks.workunit.client.0.smithi131.stderr:Or undo this operation with: 2023-12-03T11:23:55.595 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:23:55.595 INFO:tasks.workunit.client.0.smithi131.stderr: git switch - 2023-12-03T11:23:55.595 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:23:55.595 INFO:tasks.workunit.client.0.smithi131.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:23:55.595 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:23:55.595 INFO:tasks.workunit.client.0.smithi131.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:23:55.596 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:23:55.660 INFO:tasks.workunit.client.0.smithi131.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:23:55.662 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:23:55.662 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:23:56.287 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:23:56.364 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:23:56.404 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:23:56.405 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:23:56.405 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:23:56.444 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:23:56.447 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:23:56.447 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:23:56.502 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2023-12-03T11:23:56.504 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2023-12-03T11:23:56.504 DEBUG:teuthology.orchestra.run.smithi131:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2023-12-03T11:23:56.560 INFO:tasks.workunit.client.0.smithi131.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2023-12-03T11:23:56.561 INFO:tasks.workunit.client.0.smithi131.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:23:56.561 INFO:tasks.workunit.client.0.smithi131.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:23:58.880 INFO:tasks.workunit.client.0.smithi131.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2023-12-03T11:23:58.880 INFO:tasks.workunit.client.0.smithi131.stderr:++ deactivate nondestructive 2023-12-03T11:23:58.880 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n '' ']' 2023-12-03T11:23:58.880 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n '' ']' 2023-12-03T11:23:58.880 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:23:58.880 INFO:tasks.workunit.client.0.smithi131.stderr:++ hash -r 2023-12-03T11:23:58.880 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n '' ']' 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ unset VIRTUAL_ENV 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' '!' nondestructive = nondestructive ']' 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ export VIRTUAL_ENV 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ export PATH 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n '' ']' 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -z '' ']' 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ _OLD_VIRTUAL_PS1= 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ PS1='(rgw) ' 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ export PS1 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:23:58.881 INFO:tasks.workunit.client.0.smithi131.stderr:++ hash -r 2023-12-03T11:23:58.882 INFO:tasks.workunit.client.0.smithi131.stderr:+ pip install pip --upgrade 2023-12-03T11:23:59.108 INFO:tasks.workunit.client.0.smithi131.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-12-03T11:23:59.313 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting pip 2023-12-03T11:23:59.406 INFO:tasks.workunit.client.0.smithi131.stdout: Downloading pip-23.3.1-py3-none-any.whl (2.1 MB) 2023-12-03T11:23:59.616 INFO:tasks.workunit.client.0.smithi131.stdout:Installing collected packages: pip 2023-12-03T11:23:59.617 INFO:tasks.workunit.client.0.smithi131.stdout: Attempting uninstall: pip 2023-12-03T11:23:59.617 INFO:tasks.workunit.client.0.smithi131.stdout: Found existing installation: pip 21.2.3 2023-12-03T11:23:59.764 INFO:tasks.workunit.client.0.smithi131.stdout: Uninstalling pip-21.2.3: 2023-12-03T11:23:59.769 INFO:tasks.workunit.client.0.smithi131.stdout: Successfully uninstalled pip-21.2.3 2023-12-03T11:24:00.726 INFO:tasks.workunit.client.0.smithi131.stdout:Successfully installed pip-23.3.1 2023-12-03T11:24:00.982 INFO:tasks.workunit.client.0.smithi131.stderr:+ pip install boto3 2023-12-03T11:24:03.872 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting boto3 2023-12-03T11:24:03.948 INFO:tasks.workunit.client.0.smithi131.stdout: Downloading boto3-1.33.6-py3-none-any.whl.metadata (6.7 kB) 2023-12-03T11:24:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting botocore<1.34.0,>=1.33.6 (from boto3) 2023-12-03T11:24:05.867 INFO:tasks.workunit.client.0.smithi131.stdout: Downloading botocore-1.33.6-py3-none-any.whl.metadata (6.1 kB) 2023-12-03T11:24:06.271 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-12-03T11:24:06.289 INFO:tasks.workunit.client.0.smithi131.stdout: Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-12-03T11:24:06.695 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting s3transfer<0.9.0,>=0.8.2 (from boto3) 2023-12-03T11:24:06.713 INFO:tasks.workunit.client.0.smithi131.stdout: Downloading s3transfer-0.8.2-py3-none-any.whl.metadata (1.8 kB) 2023-12-03T11:24:07.087 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:24:07.111 INFO:tasks.workunit.client.0.smithi131.stdout: Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-12-03T11:24:07.206 INFO:tasks.workunit.client.0.smithi131.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 kB 2.6 MB/s eta 0:00:00 2023-12-03T11:24:07.583 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:24:07.601 INFO:tasks.workunit.client.0.smithi131.stdout: Downloading urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2023-12-03T11:24:07.658 INFO:tasks.workunit.client.0.smithi131.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 kB 718.9 kB/s eta 0:00:00 2023-12-03T11:24:08.085 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:24:08.107 INFO:tasks.workunit.client.0.smithi131.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:24:08.190 INFO:tasks.workunit.client.0.smithi131.stdout:Downloading boto3-1.33.6-py3-none-any.whl (139 kB) 2023-12-03T11:24:08.243 INFO:tasks.workunit.client.0.smithi131.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.3/139.3 kB 2.6 MB/s eta 0:00:00 2023-12-03T11:24:08.271 INFO:tasks.workunit.client.0.smithi131.stdout:Downloading botocore-1.33.6-py3-none-any.whl (11.8 MB) 2023-12-03T11:24:08.545 INFO:tasks.workunit.client.0.smithi131.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.8/11.8 MB 43.6 MB/s eta 0:00:00 2023-12-03T11:24:08.562 INFO:tasks.workunit.client.0.smithi131.stdout:Downloading s3transfer-0.8.2-py3-none-any.whl (82 kB) 2023-12-03T11:24:08.619 INFO:tasks.workunit.client.0.smithi131.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.0/82.0 kB 1.3 MB/s eta 0:00:00 2023-12-03T11:24:08.638 INFO:tasks.workunit.client.0.smithi131.stdout:Downloading urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2023-12-03T11:24:08.694 INFO:tasks.workunit.client.0.smithi131.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 143.8/143.8 kB 2.5 MB/s eta 0:00:00 2023-12-03T11:24:08.794 INFO:tasks.workunit.client.0.smithi131.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-12-03T11:24:09.839 INFO:tasks.workunit.client.0.smithi131.stdout:Successfully installed boto3-1.33.6 botocore-1.33.6 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.8.2 six-1.16.0 urllib3-1.26.18 2023-12-03T11:24:09.967 INFO:tasks.workunit.client.0.smithi131.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2023-12-03T11:24:10.101 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2023-12-03T11:24:10.135 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:10.135 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:10.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.147+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.149+0000 7f1f9e73d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.149+0000 7f1f9e73d800 20 realm 2023-12-03T11:24:10.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.149+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.149+0000 7f1f9e73d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.149+0000 7f1f9e73d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:10.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.149+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.149+0000 7f1f9e73d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.149+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.150+0000 7f1f9e73d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:10.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.150+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.151+0000 7f1f9e73d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:10.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.151+0000 7f1f9e73d800 20 searching for the correct realm 2023-12-03T11:24:10.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.161+0000 7f1f9a49c640 0 -- 172.21.15.131:0/3774352703 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55f52d000db0 msgr2=0x55f52d0031a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:10.163 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.162+0000 7f1f9e73d800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:10.163 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.162+0000 7f1f9e73d800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:10.163 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.162+0000 7f1f9e73d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:10.163 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.162+0000 7f1f9e73d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:10.163 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.162+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.164 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.162+0000 7f1f9e73d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.164 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.162+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.164 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:10.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:10.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 20 zone default found 2023-12-03T11:24:10.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 4 Realm: () 2023-12-03T11:24:10.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:10.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:10.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:10.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 20 zonegroup default 2023-12-03T11:24:10.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.163+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.164+0000 7f1f9e73d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.164+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.164+0000 7f1f9e73d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.164+0000 7f1f9e73d800 20 started sync module instance, tier type = 2023-12-03T11:24:10.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.164+0000 7f1f9e73d800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:10.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.179+0000 7f1f91c9b640 0 -- 172.21.15.131:0/3774352703 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55f52d005c00 msgr2=0x55f52d007ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:10.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.181+0000 7f1f9e73d800 20 add_watcher() i=0 2023-12-03T11:24:10.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.181+0000 7f1f9e73d800 20 add_watcher() i=1 2023-12-03T11:24:10.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.181+0000 7f1f9e73d800 20 add_watcher() i=2 2023-12-03T11:24:10.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.181+0000 7f1f9e73d800 20 add_watcher() i=3 2023-12-03T11:24:10.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.181+0000 7f1f9e73d800 20 add_watcher() i=4 2023-12-03T11:24:10.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.183+0000 7f1f9e73d800 20 add_watcher() i=5 2023-12-03T11:24:10.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.185+0000 7f1f9e73d800 20 add_watcher() i=6 2023-12-03T11:24:10.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.185+0000 7f1f9e73d800 20 add_watcher() i=7 2023-12-03T11:24:10.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.185+0000 7f1f9e73d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:10.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.187+0000 7f1f5ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:10.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.187+0000 7f1f9e73d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:10.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.187+0000 7f1f9e73d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:10.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.193+0000 7f1f9e73d800 5 note: GC not initialized 2023-12-03T11:24:10.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.193+0000 7f1eceffd640 20 reqs_thread_entry: start 2023-12-03T11:24:10.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.193+0000 7f1f9e73d800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:10.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.193+0000 7f1f9e73d800 20 Filter name: none 2023-12-03T11:24:10.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.193+0000 7f1eccff9640 20 reqs_thread_entry: start 2023-12-03T11:24:10.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.193+0000 7f1f9e73d800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2023-12-03T11:24:10.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.193+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.194+0000 7f1f9e73d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.194+0000 7f1f9e73d800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2023-12-03T11:24:10.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.194+0000 7f1f9e73d800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2023-12-03T11:24:10.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.194+0000 7f1f9e73d800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2023-12-03T11:24:10.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.194+0000 7f1f9e73d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.194+0000 7f1f9e73d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.194+0000 7f1f9e73d800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2023-12-03T11:24:10.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.194+0000 7f1f9e73d800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-12-03T11:24:10.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.194+0000 7f1f9e73d800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2023-12-03T11:24:10.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.194+0000 7f1f9e73d800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2023-12-03T11:24:10.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.195+0000 7f1f9e73d800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2023-12-03T11:24:10.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.195+0000 7f1f9e73d800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2023-12-03T11:24:10.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.195+0000 7f1f9e73d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2023-12-03T11:24:10.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.196+0000 7f1f90c99640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 94511510360896 notifier 4704 bl.length()=559 2023-12-03T11:24:10.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.196+0000 7f1f90c99640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2023-12-03T11:24:10.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.196+0000 7f1f90c99640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2023-12-03T11:24:10.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.198+0000 7f1f9e73d800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2023-12-03T11:24:10.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.198+0000 7f1f9e73d800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-12-03T11:24:10.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.198+0000 7f1f9e73d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2023-12-03T11:24:10.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.198+0000 7f1f7bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888064 cookie 139773603991552 notifier 4704 bl.length()=186 2023-12-03T11:24:10.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.198+0000 7f1f7bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2023-12-03T11:24:10.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.198+0000 7f1f7bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2023-12-03T11:24:10.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.199+0000 7f1f5ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:10.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.202+0000 7f1f9e73d800 20 remove_watcher() i=0 2023-12-03T11:24:10.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.202+0000 7f1f9e73d800 2 removed watcher, disabling cache 2023-12-03T11:24:10.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.203+0000 7f1f9e73d800 20 remove_watcher() i=1 2023-12-03T11:24:10.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.207+0000 7f1f9e73d800 20 remove_watcher() i=2 2023-12-03T11:24:10.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.208+0000 7f1f9e73d800 20 remove_watcher() i=3 2023-12-03T11:24:10.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.211+0000 7f1f9e73d800 20 remove_watcher() i=4 2023-12-03T11:24:10.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.215+0000 7f1f9e73d800 20 remove_watcher() i=5 2023-12-03T11:24:10.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.216+0000 7f1f9e73d800 20 remove_watcher() i=6 2023-12-03T11:24:10.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.217+0000 7f1f9e73d800 20 remove_watcher() i=7 2023-12-03T11:24:10.498 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: recalculated bucket check stats are correct 2023-12-03T11:24:10.499 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:10.500 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2023-12-03T11:24:10.527 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:10.527 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:10.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.539+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.541+0000 7fd2f7f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.541+0000 7fd2f7f37800 20 realm 2023-12-03T11:24:10.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.541+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.541+0000 7fd2f7f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.541+0000 7fd2f7f37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:10.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.541+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.541+0000 7fd2f7f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.541+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.542+0000 7fd2f7f37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:10.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.542+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.542+0000 7fd2f7f37800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:10.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.542+0000 7fd2f7f37800 20 searching for the correct realm 2023-12-03T11:24:10.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.552+0000 7fd2f3ccd640 0 -- 172.21.15.131:0/792085080 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x56454a9e8670 msgr2=0x56454a9eaa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 zone default found 2023-12-03T11:24:10.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 4 Realm: () 2023-12-03T11:24:10.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:10.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:10.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:10.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 zonegroup default 2023-12-03T11:24:10.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.553+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.554+0000 7fd2f7f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.554+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.554+0000 7fd2f7f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.554+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.554+0000 7fd2f7f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.554+0000 7fd2f7f37800 20 started sync module instance, tier type = 2023-12-03T11:24:10.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.554+0000 7fd2f7f37800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:10.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.568+0000 7fd2f34cc640 0 -- 172.21.15.131:0/792085080 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x56454a9ed610 msgr2=0x56454a9efa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:10.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.573+0000 7fd2f7f37800 20 add_watcher() i=0 2023-12-03T11:24:10.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.574+0000 7fd2f7f37800 20 add_watcher() i=1 2023-12-03T11:24:10.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.574+0000 7fd2f7f37800 20 add_watcher() i=2 2023-12-03T11:24:10.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.574+0000 7fd2f7f37800 20 add_watcher() i=3 2023-12-03T11:24:10.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.574+0000 7fd2f7f37800 20 add_watcher() i=4 2023-12-03T11:24:10.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.574+0000 7fd2f7f37800 20 add_watcher() i=5 2023-12-03T11:24:10.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.574+0000 7fd2f7f37800 20 add_watcher() i=6 2023-12-03T11:24:10.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.576+0000 7fd2f7f37800 20 add_watcher() i=7 2023-12-03T11:24:10.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.576+0000 7fd2f7f37800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:10.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.578+0000 7fd2b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:10.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.578+0000 7fd2f7f37800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:10.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.578+0000 7fd2f7f37800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:10.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.584+0000 7fd2f7f37800 5 note: GC not initialized 2023-12-03T11:24:10.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.584+0000 7fd230ff9640 20 reqs_thread_entry: start 2023-12-03T11:24:10.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.584+0000 7fd2f7f37800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:10.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.584+0000 7fd2f7f37800 20 Filter name: none 2023-12-03T11:24:10.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.585+0000 7fd2267fc640 20 reqs_thread_entry: start 2023-12-03T11:24:10.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.585+0000 7fd2f7f37800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:24:10.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.585+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.585+0000 7fd2f7f37800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:10.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.585+0000 7fd2f7f37800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:24:10.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.585+0000 7fd2f7f37800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.585+0000 7fd2f7f37800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 : miss 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.585+0000 7fd2f7f37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 info.flags=0x17 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 to cache LRU end 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:24:10.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.586+0000 7fd2f7f37800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:24:10.589 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.589+0000 7fd2b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:10.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.591+0000 7fd2f7f37800 20 remove_watcher() i=0 2023-12-03T11:24:10.592 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.591+0000 7fd2f7f37800 2 removed watcher, disabling cache 2023-12-03T11:24:10.593 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.592+0000 7fd2f7f37800 20 remove_watcher() i=1 2023-12-03T11:24:10.594 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.593+0000 7fd2f7f37800 20 remove_watcher() i=2 2023-12-03T11:24:10.596 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.595+0000 7fd2f7f37800 20 remove_watcher() i=3 2023-12-03T11:24:10.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.596+0000 7fd2f7f37800 20 remove_watcher() i=4 2023-12-03T11:24:10.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.597+0000 7fd2f7f37800 20 remove_watcher() i=5 2023-12-03T11:24:10.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.598+0000 7fd2f7f37800 20 remove_watcher() i=6 2023-12-03T11:24:10.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.599+0000 7fd2f7f37800 20 remove_watcher() i=7 2023-12-03T11:24:10.606 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket check-bucket 2023-12-03T11:24:10.633 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:10.633 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:10.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.645+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.647+0000 7f975ff31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.647+0000 7f975ff31800 20 realm 2023-12-03T11:24:10.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.647+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.647+0000 7f975ff31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.647+0000 7f975ff31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:10.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.647+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.647+0000 7f975ff31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.647+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.648+0000 7f975ff31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:10.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.648+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.648+0000 7f975ff31800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:10.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.648+0000 7f975ff31800 20 searching for the correct realm 2023-12-03T11:24:10.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.658+0000 7f975bb7e640 0 -- 172.21.15.131:0/657451036 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55785c964c20 msgr2=0x55785c967030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:10.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.658+0000 7f975ff31800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:10.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.658+0000 7f975ff31800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:10.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.658+0000 7f975ff31800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:10.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.658+0000 7f975ff31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:10.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.658+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.658+0000 7f975ff31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.658+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:10.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:10.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 20 zone default found 2023-12-03T11:24:10.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 4 Realm: () 2023-12-03T11:24:10.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:10.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:10.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:10.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 20 zonegroup default 2023-12-03T11:24:10.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.659+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.660+0000 7f975ff31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.660+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.660+0000 7f975ff31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.660+0000 7f975ff31800 20 started sync module instance, tier type = 2023-12-03T11:24:10.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.660+0000 7f975ff31800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:10.672 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.671+0000 7f975337d640 0 -- 172.21.15.131:0/657451036 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55785c969c70 msgr2=0x55785c96c060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:10.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.672+0000 7f975ff31800 20 add_watcher() i=0 2023-12-03T11:24:10.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.672+0000 7f975ff31800 20 add_watcher() i=1 2023-12-03T11:24:10.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.672+0000 7f975ff31800 20 add_watcher() i=2 2023-12-03T11:24:10.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.672+0000 7f975ff31800 20 add_watcher() i=3 2023-12-03T11:24:10.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.672+0000 7f975ff31800 20 add_watcher() i=4 2023-12-03T11:24:10.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.672+0000 7f975ff31800 20 add_watcher() i=5 2023-12-03T11:24:10.677 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.676+0000 7f975ff31800 20 add_watcher() i=6 2023-12-03T11:24:10.677 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.676+0000 7f975ff31800 20 add_watcher() i=7 2023-12-03T11:24:10.678 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.676+0000 7f975ff31800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:10.679 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.678+0000 7f9721fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:10.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.679+0000 7f975ff31800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:10.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.679+0000 7f975ff31800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:10.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.684+0000 7f975ff31800 5 note: GC not initialized 2023-12-03T11:24:10.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.685+0000 7f9698ff9640 20 reqs_thread_entry: start 2023-12-03T11:24:10.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.685+0000 7f975ff31800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:10.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.685+0000 7f975ff31800 20 Filter name: none 2023-12-03T11:24:10.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.685+0000 7f968e7fc640 20 reqs_thread_entry: start 2023-12-03T11:24:10.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.685+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.685+0000 7f975ff31800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:10.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.685+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.686+0000 7f975ff31800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:10.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.686+0000 7f975ff31800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:10.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.686+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.686+0000 7f975ff31800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:10.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.686+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.686+0000 7f975ff31800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:10.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.686+0000 7f975ff31800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:10.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.687+0000 7f975ff31800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.687+0000 7f975ff31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.688+0000 7f9721fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:10.691 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.690+0000 7f975ff31800 20 remove_watcher() i=0 2023-12-03T11:24:10.691 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.690+0000 7f975ff31800 2 removed watcher, disabling cache 2023-12-03T11:24:10.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.692+0000 7f975ff31800 20 remove_watcher() i=1 2023-12-03T11:24:10.695 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.694+0000 7f975ff31800 20 remove_watcher() i=2 2023-12-03T11:24:10.696 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.695+0000 7f975ff31800 20 remove_watcher() i=3 2023-12-03T11:24:10.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.700+0000 7f975ff31800 20 remove_watcher() i=4 2023-12-03T11:24:10.702 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.701+0000 7f975ff31800 20 remove_watcher() i=5 2023-12-03T11:24:10.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.704+0000 7f975ff31800 20 remove_watcher() i=6 2023-12-03T11:24:10.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.705+0000 7f975ff31800 20 remove_watcher() i=7 2023-12-03T11:24:10.711 INFO:tasks.workunit.client.0.smithi131.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 112, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2023-12-03T11:24:10.711 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: bucket check unlinked does not report normal entries 2023-12-03T11:24:10.711 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:10.713 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-12-03T11:24:10.744 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:10.744 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:10.757 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.756+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.758+0000 7f0f04b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.758+0000 7f0f04b3d800 20 realm 2023-12-03T11:24:10.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.758+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.758+0000 7f0f04b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.758+0000 7f0f04b3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:10.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.758+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.758+0000 7f0f04b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.758+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.759+0000 7f0f04b3d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:10.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.759+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.759+0000 7f0f04b3d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:10.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.759+0000 7f0f04b3d800 20 searching for the correct realm 2023-12-03T11:24:10.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.769+0000 7f0f008a3640 0 -- 172.21.15.131:0/2346273670 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55f695802fa0 msgr2=0x55f695805390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:10.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.769+0000 7f0f04b3d800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:10.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.769+0000 7f0f04b3d800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:10.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.769+0000 7f0f04b3d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:10.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.769+0000 7f0f04b3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:10.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.769+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:10.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 20 zone default found 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 4 Realm: () 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 20 zonegroup default 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.770+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.771+0000 7f0f04b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.771+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.771+0000 7f0f04b3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.771+0000 7f0f04b3d800 20 started sync module instance, tier type = 2023-12-03T11:24:10.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.771+0000 7f0f04b3d800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:10.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.780+0000 7f0f000a2640 0 -- 172.21.15.131:0/2346273670 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55f695807f80 msgr2=0x55f69580a370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:10.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.781+0000 7f0f04b3d800 20 add_watcher() i=0 2023-12-03T11:24:10.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.781+0000 7f0f04b3d800 20 add_watcher() i=1 2023-12-03T11:24:10.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.781+0000 7f0f04b3d800 20 add_watcher() i=2 2023-12-03T11:24:10.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.781+0000 7f0f04b3d800 20 add_watcher() i=3 2023-12-03T11:24:10.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.781+0000 7f0f04b3d800 20 add_watcher() i=4 2023-12-03T11:24:10.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.781+0000 7f0f04b3d800 20 add_watcher() i=5 2023-12-03T11:24:10.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.782+0000 7f0f04b3d800 20 add_watcher() i=6 2023-12-03T11:24:10.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.782+0000 7f0f04b3d800 20 add_watcher() i=7 2023-12-03T11:24:10.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.782+0000 7f0f04b3d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:10.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.784+0000 7f0ec77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:10.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.784+0000 7f0f04b3d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:10.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.784+0000 7f0f04b3d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:10.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.790+0000 7f0f04b3d800 5 note: GC not initialized 2023-12-03T11:24:10.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.790+0000 7f0e367fc640 20 reqs_thread_entry: start 2023-12-03T11:24:10.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.790+0000 7f0f04b3d800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:10.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.790+0000 7f0f04b3d800 20 Filter name: none 2023-12-03T11:24:10.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.790+0000 7f0e27fff640 20 reqs_thread_entry: start 2023-12-03T11:24:10.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.790+0000 7f0f04b3d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:24:10.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.790+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:10.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:24:10.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:24:10.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 : miss 2023-12-03T11:24:10.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 20 rados->read ofs=0 len=0 2023-12-03T11:24:10.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:10.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 info.flags=0x17 2023-12-03T11:24:10.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 to cache LRU end 2023-12-03T11:24:10.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:24:10.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:24:10.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 2023-12-03T11:24:10.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.791+0000 7f0f04b3d800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:10.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.792+0000 7f0f04b3d800 1 NOTICE: finished shard 0 (0 entries found) 2023-12-03T11:24:10.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.792+0000 7f0f04b3d800 1 NOTICE: finished all shards (0 entries found) 2023-12-03T11:24:10.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.792+0000 7f0ec77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:10.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.794+0000 7f0f04b3d800 20 remove_watcher() i=0 2023-12-03T11:24:10.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.794+0000 7f0f04b3d800 2 removed watcher, disabling cache 2023-12-03T11:24:10.797 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.796+0000 7f0f04b3d800 20 remove_watcher() i=1 2023-12-03T11:24:10.798 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.797+0000 7f0f04b3d800 20 remove_watcher() i=2 2023-12-03T11:24:10.799 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.798+0000 7f0f04b3d800 20 remove_watcher() i=3 2023-12-03T11:24:10.800 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.799+0000 7f0f04b3d800 20 remove_watcher() i=4 2023-12-03T11:24:10.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.800+0000 7f0f04b3d800 20 remove_watcher() i=5 2023-12-03T11:24:10.803 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.802+0000 7f0f04b3d800 20 remove_watcher() i=6 2023-12-03T11:24:10.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:10.803+0000 7f0f04b3d800 20 remove_watcher() i=7 2023-12-03T11:24:10.810 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-12-03T11:24:11.186 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-12-03T11:24:12.615 INFO:tasks.workunit.client.0.smithi131.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:24:12.617 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:24:12.650 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:12.650 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:12.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.664+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.665+0000 7f221008a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:12.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.665+0000 7f221008a800 20 realm 2023-12-03T11:24:12.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.665+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.666+0000 7f221008a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:12.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.666+0000 7f221008a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:12.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.666+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.666+0000 7f221008a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:12.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.666+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.667+0000 7f221008a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:12.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.667+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.667+0000 7f221008a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:12.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.667+0000 7f221008a800 20 searching for the correct realm 2023-12-03T11:24:12.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.880+0000 7f220db8a640 0 -- 172.21.15.131:0/3261950431 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f220805c040 msgr2=0x7f2208069480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:12.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.882+0000 7f221008a800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:12.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.882+0000 7f221008a800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:12.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.882+0000 7f221008a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:12.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.882+0000 7f221008a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:12.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.882+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.882+0000 7f221008a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:12.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.882+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.883+0000 7f221008a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:12.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.883+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.883+0000 7f221008a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:12.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.883+0000 7f221008a800 20 zone default found 2023-12-03T11:24:12.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.883+0000 7f221008a800 4 Realm: () 2023-12-03T11:24:12.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.883+0000 7f221008a800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:12.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.883+0000 7f221008a800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:12.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.883+0000 7f221008a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:12.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.883+0000 7f221008a800 20 zonegroup default 2023-12-03T11:24:12.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.883+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.884+0000 7f221008a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:12.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.884+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.884+0000 7f221008a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:12.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.884+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.884+0000 7f221008a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:12.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.884+0000 7f221008a800 20 started sync module instance, tier type = 2023-12-03T11:24:12.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.884+0000 7f221008a800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:12.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.892+0000 7f220e38b640 0 -- 172.21.15.131:0/3261950431 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f21f8073250 msgr2=0x7f21f803bbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:12.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.896+0000 7f221008a800 20 add_watcher() i=0 2023-12-03T11:24:12.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.896+0000 7f221008a800 20 add_watcher() i=1 2023-12-03T11:24:12.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.896+0000 7f221008a800 20 add_watcher() i=2 2023-12-03T11:24:12.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.896+0000 7f221008a800 20 add_watcher() i=3 2023-12-03T11:24:12.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.896+0000 7f221008a800 20 add_watcher() i=4 2023-12-03T11:24:12.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.896+0000 7f221008a800 20 add_watcher() i=5 2023-12-03T11:24:12.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.896+0000 7f221008a800 20 add_watcher() i=6 2023-12-03T11:24:12.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.897+0000 7f221008a800 20 add_watcher() i=7 2023-12-03T11:24:12.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.897+0000 7f221008a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:12.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.899+0000 7f21d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:12.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.900+0000 7f221008a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:12.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.900+0000 7f221008a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:12.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.906+0000 7f221008a800 5 note: GC not initialized 2023-12-03T11:24:12.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.906+0000 7f21427fc640 20 reqs_thread_entry: start 2023-12-03T11:24:12.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.907+0000 7f221008a800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:12.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.907+0000 7f221008a800 20 Filter name: none 2023-12-03T11:24:12.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.907+0000 7f2133fff640 20 reqs_thread_entry: start 2023-12-03T11:24:12.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.907+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.907+0000 7f221008a800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:12.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.907+0000 7f221008a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:12.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.908+0000 7f221008a800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:12.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.908+0000 7f221008a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:12.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.908+0000 7f221008a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:12.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.908+0000 7f221008a800 20 INFO: main: starting shard=0 2023-12-03T11:24:12.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.908+0000 7f221008a800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:12.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.908+0000 7f221008a800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:24:12.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.909+0000 7f221008a800 20 INFO: main: done 2023-12-03T11:24:12.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.909+0000 7f21d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:12.913 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.912+0000 7f221008a800 20 remove_watcher() i=0 2023-12-03T11:24:12.913 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.912+0000 7f221008a800 2 removed watcher, disabling cache 2023-12-03T11:24:12.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.913+0000 7f221008a800 20 remove_watcher() i=1 2023-12-03T11:24:12.915 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.914+0000 7f221008a800 20 remove_watcher() i=2 2023-12-03T11:24:12.916 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.915+0000 7f221008a800 20 remove_watcher() i=3 2023-12-03T11:24:12.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.917+0000 7f221008a800 20 remove_watcher() i=4 2023-12-03T11:24:12.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.918+0000 7f221008a800 20 remove_watcher() i=5 2023-12-03T11:24:12.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.919+0000 7f221008a800 20 remove_watcher() i=6 2023-12-03T11:24:12.921 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:12.920+0000 7f221008a800 20 remove_watcher() i=7 2023-12-03T11:24:12.982 INFO:tasks.workunit.client.0.smithi131.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:24:12.984 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:24:13.013 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:13.013 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:13.027 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.026+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.029 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.028+0000 7f2217333800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.028+0000 7f2217333800 20 realm 2023-12-03T11:24:13.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.028+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.028+0000 7f2217333800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.028+0000 7f2217333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:13.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.028+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.028+0000 7f2217333800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.028+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.031 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.029+0000 7f2217333800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:13.031 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.029+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.031 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.030+0000 7f2217333800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:13.031 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.030+0000 7f2217333800 20 searching for the correct realm 2023-12-03T11:24:13.041 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.040+0000 7f2213068640 0 -- 172.21.15.131:0/1136459769 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55e27837c4c0 msgr2=0x55e27837e8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:13.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:13.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:13.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:13.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:13.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.043 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:13.043 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.043 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 zone default found 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 4 Realm: () 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 zonegroup default 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.041+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.042+0000 7f2217333800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.042+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.042+0000 7f2217333800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.042+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.042+0000 7f2217333800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.042+0000 7f2217333800 20 started sync module instance, tier type = 2023-12-03T11:24:13.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.042+0000 7f2217333800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:13.056 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.055+0000 7f2212867640 0 -- 172.21.15.131:0/1136459769 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55e2783814b0 msgr2=0x55e2783838a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:13.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.058+0000 7f2217333800 20 add_watcher() i=0 2023-12-03T11:24:13.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.058+0000 7f2217333800 20 add_watcher() i=1 2023-12-03T11:24:13.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.058+0000 7f2217333800 20 add_watcher() i=2 2023-12-03T11:24:13.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.058+0000 7f2217333800 20 add_watcher() i=3 2023-12-03T11:24:13.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.058+0000 7f2217333800 20 add_watcher() i=4 2023-12-03T11:24:13.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.058+0000 7f2217333800 20 add_watcher() i=5 2023-12-03T11:24:13.061 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.060+0000 7f2217333800 20 add_watcher() i=6 2023-12-03T11:24:13.061 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.060+0000 7f2217333800 20 add_watcher() i=7 2023-12-03T11:24:13.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.060+0000 7f2217333800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:13.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.062+0000 7f21d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:13.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.063+0000 7f2217333800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:13.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.063+0000 7f2217333800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:13.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.068+0000 7f2217333800 5 note: GC not initialized 2023-12-03T11:24:13.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.068+0000 7f2147fff640 20 reqs_thread_entry: start 2023-12-03T11:24:13.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.069+0000 7f2217333800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:13.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.069+0000 7f2217333800 20 Filter name: none 2023-12-03T11:24:13.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.069+0000 7f2145ffb640 20 reqs_thread_entry: start 2023-12-03T11:24:13.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.069+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.069+0000 7f2217333800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:13.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.069+0000 7f2217333800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.070+0000 7f2217333800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:13.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.070+0000 7f2217333800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:13.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.070+0000 7f2217333800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:13.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.070+0000 7f2217333800 20 INFO: main: starting shard=0 2023-12-03T11:24:13.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.070+0000 7f2217333800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:13.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.070+0000 7f2217333800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:24:13.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.070+0000 7f2217333800 20 INFO: main: done 2023-12-03T11:24:13.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.071+0000 7f21d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:13.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.074+0000 7f2217333800 20 remove_watcher() i=0 2023-12-03T11:24:13.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.074+0000 7f2217333800 2 removed watcher, disabling cache 2023-12-03T11:24:13.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.075+0000 7f2217333800 20 remove_watcher() i=1 2023-12-03T11:24:13.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.076+0000 7f2217333800 20 remove_watcher() i=2 2023-12-03T11:24:13.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.077+0000 7f2217333800 20 remove_watcher() i=3 2023-12-03T11:24:13.079 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.078+0000 7f2217333800 20 remove_watcher() i=4 2023-12-03T11:24:13.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.079+0000 7f2217333800 20 remove_watcher() i=5 2023-12-03T11:24:13.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.081+0000 7f2217333800 20 remove_watcher() i=6 2023-12-03T11:24:13.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.082+0000 7f2217333800 20 remove_watcher() i=7 2023-12-03T11:24:13.156 INFO:tasks.workunit.client.0.smithi131.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:24:13.158 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object e 2023-12-03T11:24:13.187 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:13.187 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:13.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.200+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.201+0000 7f65ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.201+0000 7f65ddf2c800 20 realm 2023-12-03T11:24:13.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.201+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.202+0000 7f65ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.202+0000 7f65ddf2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:13.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.202+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.202+0000 7f65ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.202+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.203+0000 7f65ddf2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:13.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.203+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.203+0000 7f65ddf2c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:13.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.203+0000 7f65ddf2c800 20 searching for the correct realm 2023-12-03T11:24:13.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.213+0000 7f65d9cc3640 0 -- 172.21.15.131:0/4000772253 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55cb0c63fba0 msgr2=0x55cb0c642060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:13.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.214+0000 7f65ddf2c800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:13.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.214+0000 7f65ddf2c800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:13.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.214+0000 7f65ddf2c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:13.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.214+0000 7f65ddf2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:13.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.214+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:13.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 20 zone default found 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 4 Realm: () 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 20 zonegroup default 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.215+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.216+0000 7f65ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.216+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.216+0000 7f65ddf2c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.216+0000 7f65ddf2c800 20 started sync module instance, tier type = 2023-12-03T11:24:13.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.216+0000 7f65ddf2c800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:13.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.223+0000 7f65da4c4640 0 -- 172.21.15.131:0/4000772253 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f65c4057150 msgr2=0x7f65c406d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:13.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.229+0000 7f65ddf2c800 20 add_watcher() i=0 2023-12-03T11:24:13.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.229+0000 7f65ddf2c800 20 add_watcher() i=1 2023-12-03T11:24:13.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.229+0000 7f65ddf2c800 20 add_watcher() i=2 2023-12-03T11:24:13.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.229+0000 7f65ddf2c800 20 add_watcher() i=3 2023-12-03T11:24:13.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.229+0000 7f65ddf2c800 20 add_watcher() i=4 2023-12-03T11:24:13.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.229+0000 7f65ddf2c800 20 add_watcher() i=5 2023-12-03T11:24:13.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.229+0000 7f65ddf2c800 20 add_watcher() i=6 2023-12-03T11:24:13.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.230+0000 7f65ddf2c800 20 add_watcher() i=7 2023-12-03T11:24:13.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.230+0000 7f65ddf2c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:13.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.231+0000 7f659f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:13.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.232+0000 7f65ddf2c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:13.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.232+0000 7f65ddf2c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:13.239 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.237+0000 7f65ddf2c800 5 note: GC not initialized 2023-12-03T11:24:13.239 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.238+0000 7f650e7fc640 20 reqs_thread_entry: start 2023-12-03T11:24:13.239 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.238+0000 7f65ddf2c800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:13.239 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.238+0000 7f65ddf2c800 20 Filter name: none 2023-12-03T11:24:13.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.238+0000 7f64fffff640 20 reqs_thread_entry: start 2023-12-03T11:24:13.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.238+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.238+0000 7f65ddf2c800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:13.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.238+0000 7f65ddf2c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.239+0000 7f65ddf2c800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:13.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.239+0000 7f65ddf2c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:13.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.239+0000 7f65ddf2c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:13.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.239+0000 7f65ddf2c800 20 INFO: main: starting shard=0 2023-12-03T11:24:13.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.239+0000 7f65ddf2c800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:13.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.239+0000 7f65ddf2c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:24:13.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.239+0000 7f65ddf2c800 20 INFO: main: done 2023-12-03T11:24:13.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.240+0000 7f659f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:13.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.243+0000 7f65ddf2c800 20 remove_watcher() i=0 2023-12-03T11:24:13.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.243+0000 7f65ddf2c800 2 removed watcher, disabling cache 2023-12-03T11:24:13.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.244+0000 7f65ddf2c800 20 remove_watcher() i=1 2023-12-03T11:24:13.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.245+0000 7f65ddf2c800 20 remove_watcher() i=2 2023-12-03T11:24:13.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.246+0000 7f65ddf2c800 20 remove_watcher() i=3 2023-12-03T11:24:13.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.247+0000 7f65ddf2c800 20 remove_watcher() i=4 2023-12-03T11:24:13.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.248+0000 7f65ddf2c800 20 remove_watcher() i=5 2023-12-03T11:24:13.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.250+0000 7f65ddf2c800 20 remove_watcher() i=6 2023-12-03T11:24:13.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.251+0000 7f65ddf2c800 20 remove_watcher() i=7 2023-12-03T11:24:13.311 INFO:tasks.workunit.client.0.smithi131.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:24:13.313 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object f 2023-12-03T11:24:13.342 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:13.342 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:13.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.354+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.357 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.356+0000 7f40e3f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.357 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.356+0000 7f40e3f26800 20 realm 2023-12-03T11:24:13.357 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.356+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.357 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.356+0000 7f40e3f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.357 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.356+0000 7f40e3f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:13.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.356+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.356+0000 7f40e3f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.356+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.357+0000 7f40e3f26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:13.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.357+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.357+0000 7f40e3f26800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:13.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.357+0000 7f40e3f26800 20 searching for the correct realm 2023-12-03T11:24:13.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.367+0000 7f40e3f26800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:13.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.367+0000 7f40e3f26800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:13.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.367+0000 7f40e3f26800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:13.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.367+0000 7f40e3f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:13.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.367+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e0486640 0 -- 172.21.15.131:0/1382246896 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55709d4d5b60 msgr2=0x55709d4d7f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:13.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:13.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:13.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 20 zone default found 2023-12-03T11:24:13.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 4 Realm: () 2023-12-03T11:24:13.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:13.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:13.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:13.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 20 zonegroup default 2023-12-03T11:24:13.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.368+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.369+0000 7f40e3f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.369+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.369+0000 7f40e3f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.369+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.369+0000 7f40e3f26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:13.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.369+0000 7f40e3f26800 20 started sync module instance, tier type = 2023-12-03T11:24:13.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.369+0000 7f40e3f26800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:13.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.380+0000 7f40dfc85640 0 -- 172.21.15.131:0/1382246896 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7f40c8099330 msgr2=0x7f40c80b18a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:13.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.380+0000 7f40e3f26800 20 add_watcher() i=0 2023-12-03T11:24:13.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.380+0000 7f40e3f26800 20 add_watcher() i=1 2023-12-03T11:24:13.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.380+0000 7f40e3f26800 20 add_watcher() i=2 2023-12-03T11:24:13.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.380+0000 7f40e3f26800 20 add_watcher() i=3 2023-12-03T11:24:13.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.380+0000 7f40e3f26800 20 add_watcher() i=4 2023-12-03T11:24:13.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.380+0000 7f40e3f26800 20 add_watcher() i=5 2023-12-03T11:24:13.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.380+0000 7f40e3f26800 20 add_watcher() i=6 2023-12-03T11:24:13.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.383+0000 7f40e3f26800 20 add_watcher() i=7 2023-12-03T11:24:13.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.383+0000 7f40e3f26800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:13.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.384+0000 7f40a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:13.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.385+0000 7f40e3f26800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:13.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.385+0000 7f40e3f26800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:13.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.390+0000 7f40e3f26800 5 note: GC not initialized 2023-12-03T11:24:13.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.391+0000 7f401cff9640 20 reqs_thread_entry: start 2023-12-03T11:24:13.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.391+0000 7f40e3f26800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:13.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.391+0000 7f40e3f26800 20 Filter name: none 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.391+0000 7f40127fc640 20 reqs_thread_entry: start 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.391+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.391+0000 7f40e3f26800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.391+0000 7f40e3f26800 20 rados->read ofs=0 len=0 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.392+0000 7f40e3f26800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.392+0000 7f40e3f26800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.392+0000 7f40e3f26800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.392+0000 7f40e3f26800 20 INFO: main: starting shard=0 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.392+0000 7f40e3f26800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.392+0000 7f40e3f26800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.392+0000 7f40e3f26800 20 INFO: main: done 2023-12-03T11:24:13.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.393+0000 7f40a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:13.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.395+0000 7f40e3f26800 20 remove_watcher() i=0 2023-12-03T11:24:13.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.395+0000 7f40e3f26800 2 removed watcher, disabling cache 2023-12-03T11:24:13.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.396+0000 7f40e3f26800 20 remove_watcher() i=1 2023-12-03T11:24:13.398 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.397+0000 7f40e3f26800 20 remove_watcher() i=2 2023-12-03T11:24:13.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.398+0000 7f40e3f26800 20 remove_watcher() i=3 2023-12-03T11:24:13.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.399+0000 7f40e3f26800 20 remove_watcher() i=4 2023-12-03T11:24:13.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.400+0000 7f40e3f26800 20 remove_watcher() i=5 2023-12-03T11:24:13.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.401+0000 7f40e3f26800 20 remove_watcher() i=6 2023-12-03T11:24:13.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:13.402+0000 7f40e3f26800 20 remove_watcher() i=7 2023-12-03T11:24:13.413 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-12-03T11:24:13.785 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-12-03T11:24:14.159 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: bucket check unlinked finds unlistable entries 2023-12-03T11:24:14.159 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:14.160 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-12-03T11:24:14.191 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:14.191 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:14.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.204+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.205+0000 7f68fd6c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.205+0000 7f68fd6c0800 20 realm 2023-12-03T11:24:14.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.205+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.206+0000 7f68fd6c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.206+0000 7f68fd6c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:14.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.206+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.206+0000 7f68fd6c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.206+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.207+0000 7f68fd6c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.207+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.207+0000 7f68fd6c0800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:14.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.207+0000 7f68fd6c0800 20 searching for the correct realm 2023-12-03T11:24:14.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.217+0000 7f68fb1c7640 0 -- 172.21.15.131:0/2264460586 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55e4c50af540 msgr2=0x55e4c50b1930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:14.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.218+0000 7f68fd6c0800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:14.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.218+0000 7f68fd6c0800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:14.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.218+0000 7f68fd6c0800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:14.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.218+0000 7f68fd6c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:14.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:14.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 20 zone default found 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 4 Realm: () 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 20 zonegroup default 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.219+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.220+0000 7f68fd6c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.220+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.220+0000 7f68fd6c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.220+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.220+0000 7f68fd6c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.220+0000 7f68fd6c0800 20 started sync module instance, tier type = 2023-12-03T11:24:14.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.220+0000 7f68fd6c0800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:14.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.228+0000 7f68fa9c6640 0 -- 172.21.15.131:0/2264460586 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55e4c50b4570 msgr2=0x55e4c50b6960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:14.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.232+0000 7f68fd6c0800 20 add_watcher() i=0 2023-12-03T11:24:14.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.232+0000 7f68fd6c0800 20 add_watcher() i=1 2023-12-03T11:24:14.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.232+0000 7f68fd6c0800 20 add_watcher() i=2 2023-12-03T11:24:14.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.232+0000 7f68fd6c0800 20 add_watcher() i=3 2023-12-03T11:24:14.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.232+0000 7f68fd6c0800 20 add_watcher() i=4 2023-12-03T11:24:14.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.232+0000 7f68fd6c0800 20 add_watcher() i=5 2023-12-03T11:24:14.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.232+0000 7f68fd6c0800 20 add_watcher() i=6 2023-12-03T11:24:14.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.234+0000 7f68fd6c0800 20 add_watcher() i=7 2023-12-03T11:24:14.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.234+0000 7f68fd6c0800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:14.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.235+0000 7f68c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.236+0000 7f68fd6c0800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:14.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.236+0000 7f68fd6c0800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:14.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.241+0000 7f68fd6c0800 5 note: GC not initialized 2023-12-03T11:24:14.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.242+0000 7f682ffff640 20 reqs_thread_entry: start 2023-12-03T11:24:14.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.242+0000 7f68fd6c0800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:14.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.242+0000 7f68fd6c0800 20 Filter name: none 2023-12-03T11:24:14.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.242+0000 7f682dffb640 20 reqs_thread_entry: start 2023-12-03T11:24:14.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.242+0000 7f68fd6c0800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:24:14.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.242+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.242+0000 7f68fd6c0800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:14.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.242+0000 7f68fd6c0800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:24:14.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.242+0000 7f68fd6c0800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:24:14.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.242+0000 7f68fd6c0800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 : miss 2023-12-03T11:24:14.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.242+0000 7f68fd6c0800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.243+0000 7f68fd6c0800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:14.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.243+0000 7f68fd6c0800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 info.flags=0x17 2023-12-03T11:24:14.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.243+0000 7f68fd6c0800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 to cache LRU end 2023-12-03T11:24:14.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.243+0000 7f68fd6c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:24:14.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.243+0000 7f68fd6c0800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:24:14.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.243+0000 7f68fd6c0800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 2023-12-03T11:24:14.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.243+0000 7f68fd6c0800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.245+0000 7f68fd6c0800 1 NOTICE: finished shard 0 (4 entries found) 2023-12-03T11:24:14.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.245+0000 7f68fd6c0800 1 NOTICE: finished all shards (4 entries found) 2023-12-03T11:24:14.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.245+0000 7f68c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.248+0000 7f68fd6c0800 20 remove_watcher() i=0 2023-12-03T11:24:14.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.248+0000 7f68fd6c0800 2 removed watcher, disabling cache 2023-12-03T11:24:14.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.249+0000 7f68fd6c0800 20 remove_watcher() i=1 2023-12-03T11:24:14.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.250+0000 7f68fd6c0800 20 remove_watcher() i=2 2023-12-03T11:24:14.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.251+0000 7f68fd6c0800 20 remove_watcher() i=3 2023-12-03T11:24:14.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.252+0000 7f68fd6c0800 20 remove_watcher() i=4 2023-12-03T11:24:14.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.253+0000 7f68fd6c0800 20 remove_watcher() i=5 2023-12-03T11:24:14.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.254+0000 7f68fd6c0800 20 remove_watcher() i=6 2023-12-03T11:24:14.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.255+0000 7f68fd6c0800 20 remove_watcher() i=7 2023-12-03T11:24:14.260 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: unlinked entries are not listable 2023-12-03T11:24:14.261 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:14.267 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2023-12-03T11:24:14.267 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:14.356 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: bucket check unlinked fixes unlistable entries 2023-12-03T11:24:14.356 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:14.357 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:24:14.389 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:14.389 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:14.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.402+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.403+0000 7f5c29611800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.403+0000 7f5c29611800 20 realm 2023-12-03T11:24:14.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.403+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.404+0000 7f5c29611800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.404+0000 7f5c29611800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:14.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.404+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.404+0000 7f5c29611800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.404+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.406 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.405+0000 7f5c29611800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.406 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.405+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.406 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.405+0000 7f5c29611800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:14.406 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.405+0000 7f5c29611800 20 searching for the correct realm 2023-12-03T11:24:14.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.415+0000 7f5c24bb1640 0 -- 172.21.15.131:0/3515763097 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55786ac16f20 msgr2=0x55786ac19330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:14.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.416+0000 7f5c29611800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:14.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.416+0000 7f5c29611800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:14.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.416+0000 7f5c29611800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:14.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.416+0000 7f5c29611800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:14.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.416+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.416+0000 7f5c29611800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.416+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.416+0000 7f5c29611800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.416+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:14.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 20 zone default found 2023-12-03T11:24:14.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 4 Realm: () 2023-12-03T11:24:14.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:14.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:14.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:14.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 20 zonegroup default 2023-12-03T11:24:14.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 20 started sync module instance, tier type = 2023-12-03T11:24:14.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.417+0000 7f5c29611800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:14.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.425+0000 7f5c253b2640 0 -- 172.21.15.131:0/3515763097 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f5c0c013030 msgr2=0x7f5c0c02a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:14.428 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.427+0000 7f5c29611800 20 add_watcher() i=0 2023-12-03T11:24:14.428 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.427+0000 7f5c29611800 20 add_watcher() i=1 2023-12-03T11:24:14.428 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.427+0000 7f5c29611800 20 add_watcher() i=2 2023-12-03T11:24:14.428 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.427+0000 7f5c29611800 20 add_watcher() i=3 2023-12-03T11:24:14.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.427+0000 7f5c29611800 20 add_watcher() i=4 2023-12-03T11:24:14.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.427+0000 7f5c29611800 20 add_watcher() i=5 2023-12-03T11:24:14.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.427+0000 7f5c29611800 20 add_watcher() i=6 2023-12-03T11:24:14.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.429+0000 7f5c29611800 20 add_watcher() i=7 2023-12-03T11:24:14.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.429+0000 7f5c29611800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:14.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.431+0000 7f5beb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.431+0000 7f5c29611800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:14.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.431+0000 7f5c29611800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:14.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.437+0000 7f5c29611800 5 note: GC not initialized 2023-12-03T11:24:14.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.437+0000 7f5b5a7fc640 20 reqs_thread_entry: start 2023-12-03T11:24:14.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.437+0000 7f5c29611800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:14.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.437+0000 7f5c29611800 20 Filter name: none 2023-12-03T11:24:14.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.437+0000 7f5b4bfff640 20 reqs_thread_entry: start 2023-12-03T11:24:14.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.437+0000 7f5c29611800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:24:14.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.437+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:14.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:24:14.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:24:14.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 : miss 2023-12-03T11:24:14.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:14.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 info.flags=0x17 2023-12-03T11:24:14.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 to cache LRU end 2023-12-03T11:24:14.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:24:14.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:24:14.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 2023-12-03T11:24:14.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.438+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.439+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.439+0000 7f5c29611800 20 get_obj_state: octx=0x7f5c14070000 obj=check-bucket:c state=0x55786acca7e8 s->prefetch_data=0 2023-12-03T11:24:14.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.440+0000 7f5c29611800 20 get_obj_state: setting s->obj_tag to 7h8rtf0usbnve6j2ht4s3m07gk9mgxga 2023-12-03T11:24:14.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.440+0000 7f5c29611800 20 get_obj_state_impl: setting s->olh_tag to rjeadtho1xj86fzirmu38g18v9fo0v5k 2023-12-03T11:24:14.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.440+0000 7f5c29611800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rjeadtho1xj86fzirmu38g18v9fo0v5k 2023-12-03T11:24:14.442 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.441+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.442+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.443+0000 7f5c29611800 20 olh_log_entry: epoch=3 op=3 key=c[Q78LIpL2YqNU9cuhhuiHVF9TTquECPK] 2023-12-03T11:24:14.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.443+0000 7f5c29611800 20 get_obj_state: octx=0x7f5c14070000 obj=check-bucket:_:Q78LIpL2YqNU9cuhhuiHVF9TTquECPK_c state=0x55786acd42e8 s->prefetch_data=0 2023-12-03T11:24:14.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.443+0000 7f5c29611800 10 manifest: total_size = 22 2023-12-03T11:24:14.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.443+0000 7f5c29611800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.9257481484489657231 2023-12-03T11:24:14.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.443+0000 7f5c29611800 20 get_obj_state: octx=0x7f5c14070000 obj=check-bucket:_:Q78LIpL2YqNU9cuhhuiHVF9TTquECPK_c state=0x55786acd42e8 s->prefetch_data=0 2023-12-03T11:24:14.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.443+0000 7f5c29611800 20 prepare_atomic_modification: state is not atomic. state=0x55786acd42e8 2023-12-03T11:24:14.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.443+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.447+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.448 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.447+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.450+0000 7f5c1abad640 20 handle_completion(): completion ok for obj=c[Q78LIpL2YqNU9cuhhuiHVF9TTquECPK] 2023-12-03T11:24:14.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.450+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.450+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.450+0000 7f5c29611800 20 get_obj_state: octx=0x7f5c14070000 obj=check-bucket:d state=0x55786acca7e8 s->prefetch_data=0 2023-12-03T11:24:14.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.451+0000 7f5c29611800 20 get_obj_state: setting s->obj_tag to wqjspv8hi7g1usjj58frd2mab45i3rku 2023-12-03T11:24:14.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.451+0000 7f5c29611800 20 get_obj_state_impl: setting s->olh_tag to t4xmms9iy5uj93f9vna4bfre1d86zx35 2023-12-03T11:24:14.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.451+0000 7f5c29611800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=t4xmms9iy5uj93f9vna4bfre1d86zx35 2023-12-03T11:24:14.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.453+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.455+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.456+0000 7f5c29611800 20 olh_log_entry: epoch=3 op=3 key=d[APAGUk.XzHibwfSh2I4A0nF3F9qEtRV] 2023-12-03T11:24:14.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.456+0000 7f5c29611800 20 get_obj_state: octx=0x7f5c14070000 obj=check-bucket:_:APAGUk.XzHibwfSh2I4A0nF3F9qEtRV_d state=0x55786acd4278 s->prefetch_data=0 2023-12-03T11:24:14.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.456+0000 7f5c29611800 10 manifest: total_size = 11 2023-12-03T11:24:14.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.456+0000 7f5c29611800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.13648855452905334864 2023-12-03T11:24:14.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.456+0000 7f5c29611800 20 get_obj_state: octx=0x7f5c14070000 obj=check-bucket:_:APAGUk.XzHibwfSh2I4A0nF3F9qEtRV_d state=0x55786acd4278 s->prefetch_data=0 2023-12-03T11:24:14.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.456+0000 7f5c29611800 20 prepare_atomic_modification: state is not atomic. state=0x55786acd4278 2023-12-03T11:24:14.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.456+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.460+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.460+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.461+0000 7f5c1b3ae640 20 handle_completion(): completion ok for obj=d[APAGUk.XzHibwfSh2I4A0nF3F9qEtRV] 2023-12-03T11:24:14.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.462+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.462+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.462+0000 7f5c29611800 20 get_obj_state: octx=0x55786aca9e30 obj=check-bucket:e state=0x55786acca7e8 s->prefetch_data=0 2023-12-03T11:24:14.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.463+0000 7f5c29611800 20 get_obj_state: setting s->obj_tag to x6fszxwlanhi4a86zf0zpwqe3tu85pjv 2023-12-03T11:24:14.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.463+0000 7f5c29611800 20 get_obj_state_impl: setting s->olh_tag to x1edro73ur5tih3k2ur61bk1hgx1m32t 2023-12-03T11:24:14.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.463+0000 7f5c29611800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x1edro73ur5tih3k2ur61bk1hgx1m32t 2023-12-03T11:24:14.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.464+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.465+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.466+0000 7f5c29611800 20 olh_log_entry: epoch=2 op=2 key=e[] 2023-12-03T11:24:14.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.466+0000 7f5c29611800 20 olh_log_entry: epoch=2 op=3 key=e[1GnF1pMaOXOWh9X6sTERJP4RhGSzpgF] 2023-12-03T11:24:14.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.466+0000 7f5c29611800 20 get_obj_state: octx=0x55786aca9e30 obj=check-bucket:_:1GnF1pMaOXOWh9X6sTERJP4RhGSzpgF_e state=0x55786acd1248 s->prefetch_data=0 2023-12-03T11:24:14.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.466+0000 7f5c29611800 10 manifest: total_size = 12 2023-12-03T11:24:14.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.466+0000 7f5c29611800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.1296172275230246275 2023-12-03T11:24:14.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.466+0000 7f5c29611800 20 get_obj_state: octx=0x55786aca9e30 obj=check-bucket:_:1GnF1pMaOXOWh9X6sTERJP4RhGSzpgF_e state=0x55786acd1248 s->prefetch_data=0 2023-12-03T11:24:14.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.466+0000 7f5c29611800 20 prepare_atomic_modification: state is not atomic. state=0x55786acd1248 2023-12-03T11:24:14.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.466+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.473+0000 7f5c29611800 20 get_obj_state: octx=0x55786aca9e30 obj=check-bucket:e state=0x55786acca7e8 s->prefetch_data=0 2023-12-03T11:24:14.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.473+0000 7f5c29611800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x1edro73ur5tih3k2ur61bk1hgx1m32t 2023-12-03T11:24:14.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.473+0000 7f5c1abad640 20 handle_completion(): completion ok for obj=e[1GnF1pMaOXOWh9X6sTERJP4RhGSzpgF] 2023-12-03T11:24:14.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.475+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.476+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.476+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.477+0000 7f5c29611800 20 get_obj_state: octx=0x7f5c0c009400 obj=check-bucket:f state=0x55786acda208 s->prefetch_data=0 2023-12-03T11:24:14.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.477+0000 7f5c29611800 20 get_obj_state: setting s->obj_tag to j3iclf9x1umty82iuyxvddghcy6eiby8 2023-12-03T11:24:14.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.477+0000 7f5c29611800 20 get_obj_state_impl: setting s->olh_tag to 4uad31tk7xhl2idzzhsdmnn2xl2eatz4 2023-12-03T11:24:14.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.477+0000 7f5c29611800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4uad31tk7xhl2idzzhsdmnn2xl2eatz4 2023-12-03T11:24:14.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.478+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.481+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.481+0000 7f5c29611800 20 olh_log_entry: epoch=2 op=2 key=f[] 2023-12-03T11:24:14.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.481+0000 7f5c29611800 20 olh_log_entry: epoch=2 op=3 key=f[amuDPLUXsz2oZm29sn87va5-ltLYIF1] 2023-12-03T11:24:14.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.481+0000 7f5c29611800 20 get_obj_state: octx=0x7f5c0c009400 obj=check-bucket:_:amuDPLUXsz2oZm29sn87va5-ltLYIF1_f state=0x55786acd0238 s->prefetch_data=0 2023-12-03T11:24:14.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.481+0000 7f5c29611800 10 manifest: total_size = 11 2023-12-03T11:24:14.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.481+0000 7f5c29611800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.15420654870059897286 2023-12-03T11:24:14.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.481+0000 7f5c29611800 20 get_obj_state: octx=0x7f5c0c009400 obj=check-bucket:_:amuDPLUXsz2oZm29sn87va5-ltLYIF1_f state=0x55786acd0238 s->prefetch_data=0 2023-12-03T11:24:14.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.481+0000 7f5c29611800 20 prepare_atomic_modification: state is not atomic. state=0x55786acd0238 2023-12-03T11:24:14.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.481+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.485+0000 7f5c29611800 20 get_obj_state: octx=0x7f5c0c009400 obj=check-bucket:f state=0x55786acda208 s->prefetch_data=0 2023-12-03T11:24:14.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.485+0000 7f5c29611800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4uad31tk7xhl2idzzhsdmnn2xl2eatz4 2023-12-03T11:24:14.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.485+0000 7f5c1b3ae640 20 handle_completion(): completion ok for obj=f[amuDPLUXsz2oZm29sn87va5-ltLYIF1] 2023-12-03T11:24:14.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.487+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.488+0000 7f5c29611800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.488+0000 7f5c29611800 1 NOTICE: finished shard 0 (4 entries removed) 2023-12-03T11:24:14.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.488+0000 7f5c29611800 1 NOTICE: finished all shards (4 entries removed) 2023-12-03T11:24:14.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.488+0000 7f5beb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.492 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.491+0000 7f5c29611800 20 remove_watcher() i=0 2023-12-03T11:24:14.492 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.491+0000 7f5c29611800 2 removed watcher, disabling cache 2023-12-03T11:24:14.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.492+0000 7f5c29611800 20 remove_watcher() i=1 2023-12-03T11:24:14.494 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.493+0000 7f5c29611800 20 remove_watcher() i=2 2023-12-03T11:24:14.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.494+0000 7f5c29611800 20 remove_watcher() i=3 2023-12-03T11:24:14.496 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.495+0000 7f5c29611800 20 remove_watcher() i=4 2023-12-03T11:24:14.497 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.496+0000 7f5c29611800 20 remove_watcher() i=5 2023-12-03T11:24:14.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.499+0000 7f5c29611800 20 remove_watcher() i=6 2023-12-03T11:24:14.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.500+0000 7f5c29611800 20 remove_watcher() i=7 2023-12-03T11:24:14.516 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: bucket check unlinked does not affect normal entries 2023-12-03T11:24:14.516 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:14.571 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2023-12-03T11:24:14.571 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:14.572 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2023-12-03T11:24:14.602 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:14.602 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:14.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.615+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.616+0000 7f704400f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.616+0000 7f704400f800 20 realm 2023-12-03T11:24:14.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.616+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.616+0000 7f704400f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.616+0000 7f704400f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:14.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.616+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.617+0000 7f704400f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.617+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.617+0000 7f704400f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.617+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.618+0000 7f704400f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:14.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.618+0000 7f704400f800 20 searching for the correct realm 2023-12-03T11:24:14.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.627+0000 7f703f61a640 0 -- 172.21.15.131:0/1876012778 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f7038016070 msgr2=0x7f7038014430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:14.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.628+0000 7f704400f800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:14.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.628+0000 7f704400f800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:14.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.628+0000 7f704400f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:14.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.628+0000 7f704400f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:14.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.628+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.628+0000 7f704400f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.628+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.628+0000 7f704400f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.628+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:14.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 20 zone default found 2023-12-03T11:24:14.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 4 Realm: () 2023-12-03T11:24:14.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:14.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:14.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:14.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 20 zonegroup default 2023-12-03T11:24:14.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.629+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.630+0000 7f704400f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.630+0000 7f704400f800 20 started sync module instance, tier type = 2023-12-03T11:24:14.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.630+0000 7f704400f800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:14.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.637+0000 7f703f61a640 0 -- 172.21.15.131:0/1876012778 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f7018076b80 msgr2=0x7f7018078fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:14.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.641+0000 7f704400f800 20 add_watcher() i=0 2023-12-03T11:24:14.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.641+0000 7f704400f800 20 add_watcher() i=1 2023-12-03T11:24:14.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.641+0000 7f704400f800 20 add_watcher() i=2 2023-12-03T11:24:14.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.641+0000 7f704400f800 20 add_watcher() i=3 2023-12-03T11:24:14.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.641+0000 7f704400f800 20 add_watcher() i=4 2023-12-03T11:24:14.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.641+0000 7f704400f800 20 add_watcher() i=5 2023-12-03T11:24:14.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.644+0000 7f704400f800 20 add_watcher() i=6 2023-12-03T11:24:14.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.644+0000 7f704400f800 20 add_watcher() i=7 2023-12-03T11:24:14.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.644+0000 7f704400f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:14.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.645+0000 7f70057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.646+0000 7f704400f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:14.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.646+0000 7f704400f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:14.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.651+0000 7f704400f800 5 note: GC not initialized 2023-12-03T11:24:14.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.651+0000 7f6f73fff640 20 reqs_thread_entry: start 2023-12-03T11:24:14.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.652+0000 7f704400f800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:14.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.652+0000 7f704400f800 20 Filter name: none 2023-12-03T11:24:14.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.652+0000 7f6f71ffb640 20 reqs_thread_entry: start 2023-12-03T11:24:14.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.652+0000 7f704400f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:24:14.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.652+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.652+0000 7f704400f800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:14.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.652+0000 7f704400f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:24:14.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.652+0000 7f704400f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:24:14.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.652+0000 7f704400f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 : miss 2023-12-03T11:24:14.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.652+0000 7f704400f800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.653+0000 7f704400f800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:14.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.653+0000 7f704400f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 info.flags=0x17 2023-12-03T11:24:14.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.653+0000 7f704400f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 to cache LRU end 2023-12-03T11:24:14.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.653+0000 7f704400f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:24:14.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.653+0000 7f704400f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:24:14.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.653+0000 7f704400f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 2023-12-03T11:24:14.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.653+0000 7f704400f800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.656 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.653+0000 7f704400f800 1 NOTICE: finished shard 0 (0 entries found) 2023-12-03T11:24:14.656 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.653+0000 7f704400f800 1 NOTICE: finished all shards (0 entries found) 2023-12-03T11:24:14.656 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.654+0000 7f70057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.656+0000 7f704400f800 20 remove_watcher() i=0 2023-12-03T11:24:14.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.656+0000 7f704400f800 2 removed watcher, disabling cache 2023-12-03T11:24:14.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.657+0000 7f704400f800 20 remove_watcher() i=1 2023-12-03T11:24:14.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.658+0000 7f704400f800 20 remove_watcher() i=2 2023-12-03T11:24:14.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.659+0000 7f704400f800 20 remove_watcher() i=3 2023-12-03T11:24:14.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.660+0000 7f704400f800 20 remove_watcher() i=4 2023-12-03T11:24:14.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.661+0000 7f704400f800 20 remove_watcher() i=5 2023-12-03T11:24:14.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.664+0000 7f704400f800 20 remove_watcher() i=6 2023-12-03T11:24:14.666 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.665+0000 7f704400f800 20 remove_watcher() i=7 2023-12-03T11:24:14.708 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:24:14.739 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:14.739 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:14.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.751+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.753+0000 7f139f131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.753+0000 7f139f131800 20 realm 2023-12-03T11:24:14.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.753+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.753+0000 7f139f131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.753+0000 7f139f131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:14.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.753+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.753+0000 7f139f131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.753+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.754+0000 7f139f131800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.754+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.755+0000 7f139f131800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:14.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.755+0000 7f139f131800 20 searching for the correct realm 2023-12-03T11:24:14.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.764+0000 7f139a667640 0 -- 172.21.15.131:0/1104232919 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x557efe18dea0 msgr2=0x557efe190290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:14.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:14.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:14.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:14.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:14.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 zone default found 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 4 Realm: () 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 zonegroup default 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.765+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.766+0000 7f139f131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.766+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.766+0000 7f139f131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.766+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.766+0000 7f139f131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.766+0000 7f139f131800 20 started sync module instance, tier type = 2023-12-03T11:24:14.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.766+0000 7f139f131800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:14.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.774+0000 7f139a667640 0 -- 172.21.15.131:0/1104232919 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x7f1374076c30 msgr2=0x7f1374079060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:14.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.777+0000 7f139f131800 20 add_watcher() i=0 2023-12-03T11:24:14.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.777+0000 7f139f131800 20 add_watcher() i=1 2023-12-03T11:24:14.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.777+0000 7f139f131800 20 add_watcher() i=2 2023-12-03T11:24:14.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.777+0000 7f139f131800 20 add_watcher() i=3 2023-12-03T11:24:14.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.777+0000 7f139f131800 20 add_watcher() i=4 2023-12-03T11:24:14.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.777+0000 7f139f131800 20 add_watcher() i=5 2023-12-03T11:24:14.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.780+0000 7f139f131800 20 add_watcher() i=6 2023-12-03T11:24:14.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.780+0000 7f139f131800 20 add_watcher() i=7 2023-12-03T11:24:14.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.780+0000 7f139f131800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:14.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.781+0000 7f12dbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.782+0000 7f139f131800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:14.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.782+0000 7f139f131800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:14.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.787+0000 7f139f131800 5 note: GC not initialized 2023-12-03T11:24:14.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.787+0000 7f12caffd640 20 reqs_thread_entry: start 2023-12-03T11:24:14.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.788+0000 7f139f131800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:14.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.788+0000 7f139f131800 20 Filter name: none 2023-12-03T11:24:14.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.788+0000 7f12c8ff9640 20 reqs_thread_entry: start 2023-12-03T11:24:14.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.788+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.788+0000 7f139f131800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:14.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.788+0000 7f139f131800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.789+0000 7f139f131800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:14.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.789+0000 7f139f131800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:14.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.789+0000 7f139f131800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:14.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.789+0000 7f139f131800 20 INFO: main: starting shard=0 2023-12-03T11:24:14.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.789+0000 7f139f131800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.789+0000 7f139f131800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2023-12-03T11:24:14.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.789+0000 7f139f131800 20 INFO: main: done 2023-12-03T11:24:14.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.790+0000 7f12dbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.792+0000 7f139f131800 20 remove_watcher() i=0 2023-12-03T11:24:14.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.792+0000 7f139f131800 2 removed watcher, disabling cache 2023-12-03T11:24:14.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.794+0000 7f139f131800 20 remove_watcher() i=1 2023-12-03T11:24:14.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.795+0000 7f139f131800 20 remove_watcher() i=2 2023-12-03T11:24:14.797 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.796+0000 7f139f131800 20 remove_watcher() i=3 2023-12-03T11:24:14.798 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.797+0000 7f139f131800 20 remove_watcher() i=4 2023-12-03T11:24:14.799 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.798+0000 7f139f131800 20 remove_watcher() i=5 2023-12-03T11:24:14.800 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.799+0000 7f139f131800 20 remove_watcher() i=6 2023-12-03T11:24:14.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.800+0000 7f139f131800 20 remove_watcher() i=7 2023-12-03T11:24:14.807 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:24:14.836 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:14.836 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:14.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.849+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.851+0000 7f8467737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.851+0000 7f8467737800 20 realm 2023-12-03T11:24:14.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.851+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.851+0000 7f8467737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.851+0000 7f8467737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:14.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.851+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.851+0000 7f8467737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.851+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.853 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.852+0000 7f8467737800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.853 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.852+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.853 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.852+0000 7f8467737800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:14.853 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.852+0000 7f8467737800 20 searching for the correct realm 2023-12-03T11:24:14.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.861+0000 7f84634cd640 0 -- 172.21.15.131:0/2762523511 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55909d252ad0 msgr2=0x55909d254ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:14.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.862+0000 7f8467737800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:14.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.862+0000 7f8467737800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:14.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.862+0000 7f8467737800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:14.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.862+0000 7f8467737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:14.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.862+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.862+0000 7f8467737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.862+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.863+0000 7f8467737800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.863+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.863+0000 7f8467737800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:14.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.863+0000 7f8467737800 20 zone default found 2023-12-03T11:24:14.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 4 Realm: () 2023-12-03T11:24:14.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:14.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:14.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:14.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 20 zonegroup default 2023-12-03T11:24:14.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.867 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.867 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 20 started sync module instance, tier type = 2023-12-03T11:24:14.867 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.864+0000 7f8467737800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:14.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.870+0000 7f8462ccc640 0 -- 172.21.15.131:0/2762523511 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55909d2576d0 msgr2=0x55909d259ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:24:14.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.875+0000 7f8467737800 20 add_watcher() i=0 2023-12-03T11:24:14.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.875+0000 7f8467737800 20 add_watcher() i=1 2023-12-03T11:24:14.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.875+0000 7f8467737800 20 add_watcher() i=2 2023-12-03T11:24:14.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.875+0000 7f8467737800 20 add_watcher() i=3 2023-12-03T11:24:14.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.875+0000 7f8467737800 20 add_watcher() i=4 2023-12-03T11:24:14.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.875+0000 7f8467737800 20 add_watcher() i=5 2023-12-03T11:24:14.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.875+0000 7f8467737800 20 add_watcher() i=6 2023-12-03T11:24:14.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.875+0000 7f8467737800 20 add_watcher() i=7 2023-12-03T11:24:14.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.875+0000 7f8467737800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:14.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.877+0000 7f84297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.877+0000 7f8467737800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:14.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.877+0000 7f8467737800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:14.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.883+0000 7f8467737800 5 note: GC not initialized 2023-12-03T11:24:14.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.883+0000 7f8397fff640 20 reqs_thread_entry: start 2023-12-03T11:24:14.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.883+0000 7f8467737800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:14.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.883+0000 7f8467737800 20 Filter name: none 2023-12-03T11:24:14.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.884+0000 7f8395ffb640 20 reqs_thread_entry: start 2023-12-03T11:24:14.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.884+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.884+0000 7f8467737800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:14.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.884+0000 7f8467737800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.884+0000 7f8467737800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:14.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.884+0000 7f8467737800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:14.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.884+0000 7f8467737800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:14.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.884+0000 7f8467737800 20 INFO: main: starting shard=0 2023-12-03T11:24:14.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.884+0000 7f8467737800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.885+0000 7f8467737800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2023-12-03T11:24:14.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.885+0000 7f8467737800 20 INFO: main: done 2023-12-03T11:24:14.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.886+0000 7f84297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.888+0000 7f8467737800 20 remove_watcher() i=0 2023-12-03T11:24:14.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.888+0000 7f8467737800 2 removed watcher, disabling cache 2023-12-03T11:24:14.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.889+0000 7f8467737800 20 remove_watcher() i=1 2023-12-03T11:24:14.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.890+0000 7f8467737800 20 remove_watcher() i=2 2023-12-03T11:24:14.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.891+0000 7f8467737800 20 remove_watcher() i=3 2023-12-03T11:24:14.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.891+0000 7f8467737800 20 remove_watcher() i=4 2023-12-03T11:24:14.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.892+0000 7f8467737800 20 remove_watcher() i=5 2023-12-03T11:24:14.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.893+0000 7f8467737800 20 remove_watcher() i=6 2023-12-03T11:24:14.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.894+0000 7f8467737800 20 remove_watcher() i=7 2023-12-03T11:24:14.900 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: bucket check olh finds leftover OLH entries 2023-12-03T11:24:14.900 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:14.902 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2023-12-03T11:24:14.930 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:14.931 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:14.945 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.944+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.945+0000 7f3a75720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.945+0000 7f3a75720800 20 realm 2023-12-03T11:24:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.945+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.945+0000 7f3a75720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.945+0000 7f3a75720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.945+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.945+0000 7f3a75720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.945+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.946+0000 7f3a75720800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.946+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.946+0000 7f3a75720800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:14.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.946+0000 7f3a75720800 20 searching for the correct realm 2023-12-03T11:24:14.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.956+0000 7f3a713c9640 0 -- 172.21.15.131:0/3714060403 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f3a6c05e040 msgr2=0x7f3a6c05fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:14.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.957+0000 7f3a75720800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:14.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.957+0000 7f3a75720800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.957+0000 7f3a75720800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.957+0000 7f3a75720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.957+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.957+0000 7f3a75720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.957+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.957+0000 7f3a75720800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.957+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.957+0000 7f3a75720800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 20 zone default found 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 4 Realm: () 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:14.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 20 zonegroup default 2023-12-03T11:24:14.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:14.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 20 started sync module instance, tier type = 2023-12-03T11:24:14.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.958+0000 7f3a75720800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:14.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.965+0000 7f3a713c9640 0 -- 172.21.15.131:0/3714060403 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f3a4c076c00 msgr2=0x7f3a4c079030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:14.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.969+0000 7f3a75720800 20 add_watcher() i=0 2023-12-03T11:24:14.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.969+0000 7f3a75720800 20 add_watcher() i=1 2023-12-03T11:24:14.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.969+0000 7f3a75720800 20 add_watcher() i=2 2023-12-03T11:24:14.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.969+0000 7f3a75720800 20 add_watcher() i=3 2023-12-03T11:24:14.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.969+0000 7f3a75720800 20 add_watcher() i=4 2023-12-03T11:24:14.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.969+0000 7f3a75720800 20 add_watcher() i=5 2023-12-03T11:24:14.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.972+0000 7f3a75720800 20 add_watcher() i=6 2023-12-03T11:24:14.973 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.972+0000 7f3a75720800 20 add_watcher() i=7 2023-12-03T11:24:14.973 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.972+0000 7f3a75720800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:14.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.973+0000 7f3a36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.973+0000 7f3a75720800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:14.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.973+0000 7f3a75720800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:14.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.979+0000 7f3a75720800 5 note: GC not initialized 2023-12-03T11:24:14.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.979+0000 7f39a5ffb640 20 reqs_thread_entry: start 2023-12-03T11:24:14.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.979+0000 7f3a75720800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:14.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.980+0000 7f3a75720800 20 Filter name: none 2023-12-03T11:24:14.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.980+0000 7f39977fe640 20 reqs_thread_entry: start 2023-12-03T11:24:14.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.980+0000 7f3a75720800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:24:14.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.980+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.980+0000 7f3a75720800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:14.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.980+0000 7f3a75720800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.980+0000 7f3a75720800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.980+0000 7f3a75720800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 : miss 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.980+0000 7f3a75720800 20 rados->read ofs=0 len=0 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.981+0000 7f3a75720800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.981+0000 7f3a75720800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 info.flags=0x17 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.981+0000 7f3a75720800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 to cache LRU end 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.981+0000 7f3a75720800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.981+0000 7f3a75720800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.981+0000 7f3a75720800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.981+0000 7f3a75720800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.981+0000 7f3a75720800 1 NOTICE: finished shard 0 (2 entries found) 2023-12-03T11:24:14.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.981+0000 7f3a75720800 1 NOTICE: finished all shards (2 entries found) 2023-12-03T11:24:14.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.982+0000 7f3a36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:14.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.984+0000 7f3a75720800 20 remove_watcher() i=0 2023-12-03T11:24:14.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.984+0000 7f3a75720800 2 removed watcher, disabling cache 2023-12-03T11:24:14.986 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.985+0000 7f3a75720800 20 remove_watcher() i=1 2023-12-03T11:24:14.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.986+0000 7f3a75720800 20 remove_watcher() i=2 2023-12-03T11:24:14.988 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.987+0000 7f3a75720800 20 remove_watcher() i=3 2023-12-03T11:24:14.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.988+0000 7f3a75720800 20 remove_watcher() i=4 2023-12-03T11:24:14.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.989+0000 7f3a75720800 20 remove_watcher() i=5 2023-12-03T11:24:14.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.990+0000 7f3a75720800 20 remove_watcher() i=6 2023-12-03T11:24:14.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:14.991+0000 7f3a75720800 20 remove_watcher() i=7 2023-12-03T11:24:14.997 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: bucket check olh fixes leftover OLH entries 2023-12-03T11:24:14.997 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:14.998 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:24:15.029 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:15.029 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:15.043 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.042+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.044+0000 7f1d7d3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.044+0000 7f1d7d3af800 20 realm 2023-12-03T11:24:15.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.044+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.044+0000 7f1d7d3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.044+0000 7f1d7d3af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:15.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.044+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.046 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.044+0000 7f1d7d3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.046 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.044+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.046 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.045+0000 7f1d7d3af800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:15.046 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.045+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.047 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.045+0000 7f1d7d3af800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:15.047 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.045+0000 7f1d7d3af800 20 searching for the correct realm 2023-12-03T11:24:15.055 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.054+0000 7f1d7aeb6640 0 -- 172.21.15.131:0/1448143599 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55a441eca1b0 msgr2=0x55a441ecc5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:15.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.055+0000 7f1d7d3af800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:15.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.055+0000 7f1d7d3af800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:15.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.055+0000 7f1d7d3af800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:15.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.055+0000 7f1d7d3af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:15.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.055+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.055+0000 7f1d7d3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.055+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:15.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 20 zone default found 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 4 Realm: () 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 20 zonegroup default 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.056+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.057+0000 7f1d7d3af800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.060 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.057+0000 7f1d7d3af800 20 started sync module instance, tier type = 2023-12-03T11:24:15.060 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.057+0000 7f1d7d3af800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:15.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.064+0000 7f1d7b6b7640 0 -- 172.21.15.131:0/1448143599 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f1d6c05a950 msgr2=0x7f1d6c063900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:15.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.070+0000 7f1d7d3af800 20 add_watcher() i=0 2023-12-03T11:24:15.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.070+0000 7f1d7d3af800 20 add_watcher() i=1 2023-12-03T11:24:15.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.070+0000 7f1d7d3af800 20 add_watcher() i=2 2023-12-03T11:24:15.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.070+0000 7f1d7d3af800 20 add_watcher() i=3 2023-12-03T11:24:15.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.070+0000 7f1d7d3af800 20 add_watcher() i=4 2023-12-03T11:24:15.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.070+0000 7f1d7d3af800 20 add_watcher() i=5 2023-12-03T11:24:15.073 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.072+0000 7f1d7d3af800 20 add_watcher() i=6 2023-12-03T11:24:15.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.073+0000 7f1d7d3af800 20 add_watcher() i=7 2023-12-03T11:24:15.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.073+0000 7f1d7d3af800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:15.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.074+0000 7f1cbbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:15.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.074+0000 7f1d7d3af800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:15.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.074+0000 7f1d7d3af800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:15.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.080+0000 7f1d7d3af800 5 note: GC not initialized 2023-12-03T11:24:15.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.080+0000 7f1caaffd640 20 reqs_thread_entry: start 2023-12-03T11:24:15.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.080+0000 7f1d7d3af800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:15.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.080+0000 7f1d7d3af800 20 Filter name: none 2023-12-03T11:24:15.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.081+0000 7f1ca8ff9640 20 reqs_thread_entry: start 2023-12-03T11:24:15.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.081+0000 7f1d7d3af800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:24:15.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.081+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.081+0000 7f1d7d3af800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:15.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.081+0000 7f1d7d3af800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:24:15.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.081+0000 7f1d7d3af800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:24:15.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.081+0000 7f1d7d3af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 : miss 2023-12-03T11:24:15.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.081+0000 7f1d7d3af800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.082+0000 7f1d7d3af800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:15.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.082+0000 7f1d7d3af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 info.flags=0x17 2023-12-03T11:24:15.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.082+0000 7f1d7d3af800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 to cache LRU end 2023-12-03T11:24:15.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.082+0000 7f1d7d3af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:24:15.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.082+0000 7f1d7d3af800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:24:15.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.082+0000 7f1d7d3af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 2023-12-03T11:24:15.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.082+0000 7f1d7d3af800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:15.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.082+0000 7f1d7d3af800 20 get_obj_state: octx=0x55a441c660f0 obj=check-bucket:c state=0x55a441f7e838 s->prefetch_data=0 2023-12-03T11:24:15.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.083+0000 7f1d7d3af800 20 get_obj_state: setting s->obj_tag to 7h8rtf0usbnve6j2ht4s3m07gk9mgxga 2023-12-03T11:24:15.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.083+0000 7f1d7d3af800 20 get_obj_state_impl: setting s->olh_tag to rjeadtho1xj86fzirmu38g18v9fo0v5k 2023-12-03T11:24:15.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.083+0000 7f1d7d3af800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:15.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.083+0000 7f1d7d3af800 20 olh_log_entry: epoch=4 op=2 key=c[] 2023-12-03T11:24:15.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.083+0000 7f1d7d3af800 20 olh_log_entry: epoch=4 op=3 key=c[LT3FsTdGvh1qXzqwyMb8jr10ScbC9bK] 2023-12-03T11:24:15.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.083+0000 7f1d7d3af800 20 get_obj_state: octx=0x55a441f7ccf0 obj=check-bucket:_:LT3FsTdGvh1qXzqwyMb8jr10ScbC9bK_c state=0x55a441f87308 s->prefetch_data=0 2023-12-03T11:24:15.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.084+0000 7f1d7d3af800 20 get_obj_state: octx=0x55a441f7ccf0 obj=check-bucket:c state=0x55a441f80298 s->prefetch_data=0 2023-12-03T11:24:15.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.085+0000 7f1d7d3af800 20 get_obj_state: setting s->obj_tag to 7h8rtf0usbnve6j2ht4s3m07gk9mgxga 2023-12-03T11:24:15.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.085+0000 7f1d7d3af800 20 get_obj_state_impl: setting s->olh_tag to rjeadtho1xj86fzirmu38g18v9fo0v5k 2023-12-03T11:24:15.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.085+0000 7f1d7d3af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rjeadtho1xj86fzirmu38g18v9fo0v5k 2023-12-03T11:24:15.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.088+0000 7f1d7d3af800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:15.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.091+0000 7f1d7d3af800 20 get_obj_state: octx=0x55a441c660f0 obj=check-bucket:d state=0x55a441f7e838 s->prefetch_data=0 2023-12-03T11:24:15.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.091+0000 7f1d7d3af800 20 get_obj_state: setting s->obj_tag to wqjspv8hi7g1usjj58frd2mab45i3rku 2023-12-03T11:24:15.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.091+0000 7f1d7d3af800 20 get_obj_state_impl: setting s->olh_tag to t4xmms9iy5uj93f9vna4bfre1d86zx35 2023-12-03T11:24:15.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.091+0000 7f1d7d3af800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:15.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.091+0000 7f1d7d3af800 20 olh_log_entry: epoch=4 op=2 key=d[] 2023-12-03T11:24:15.093 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.091+0000 7f1d7d3af800 20 olh_log_entry: epoch=4 op=3 key=d[t91TqIRCSQafMugFDnYM3B7wdjzbort] 2023-12-03T11:24:15.093 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.091+0000 7f1d7d3af800 20 get_obj_state: octx=0x55a441f7ccf0 obj=check-bucket:_:t91TqIRCSQafMugFDnYM3B7wdjzbort_d state=0x55a441f7d808 s->prefetch_data=0 2023-12-03T11:24:15.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.093+0000 7f1d7d3af800 20 get_obj_state: octx=0x55a441f7ccf0 obj=check-bucket:d state=0x55a441f80de8 s->prefetch_data=0 2023-12-03T11:24:15.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.093+0000 7f1d7d3af800 20 get_obj_state: setting s->obj_tag to wqjspv8hi7g1usjj58frd2mab45i3rku 2023-12-03T11:24:15.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.093+0000 7f1d7d3af800 20 get_obj_state_impl: setting s->olh_tag to t4xmms9iy5uj93f9vna4bfre1d86zx35 2023-12-03T11:24:15.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.093+0000 7f1d7d3af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=t4xmms9iy5uj93f9vna4bfre1d86zx35 2023-12-03T11:24:15.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.099+0000 7f1d7d3af800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:15.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.100+0000 7f1d7d3af800 1 NOTICE: finished shard 0 (2 entries removed) 2023-12-03T11:24:15.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.100+0000 7f1d7d3af800 1 NOTICE: finished all shards (2 entries removed) 2023-12-03T11:24:15.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.101+0000 7f1cbbfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:15.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.103+0000 7f1d7d3af800 20 remove_watcher() i=0 2023-12-03T11:24:15.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.103+0000 7f1d7d3af800 2 removed watcher, disabling cache 2023-12-03T11:24:15.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.104+0000 7f1d7d3af800 20 remove_watcher() i=1 2023-12-03T11:24:15.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.107+0000 7f1d7d3af800 20 remove_watcher() i=2 2023-12-03T11:24:15.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.108+0000 7f1d7d3af800 20 remove_watcher() i=3 2023-12-03T11:24:15.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.110+0000 7f1d7d3af800 20 remove_watcher() i=4 2023-12-03T11:24:15.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.111+0000 7f1d7d3af800 20 remove_watcher() i=5 2023-12-03T11:24:15.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.113+0000 7f1d7d3af800 20 remove_watcher() i=6 2023-12-03T11:24:15.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.114+0000 7f1d7d3af800 20 remove_watcher() i=7 2023-12-03T11:24:15.121 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:24:15.151 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:15.151 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:15.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.164+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.166+0000 7f3cec810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.166+0000 7f3cec810800 20 realm 2023-12-03T11:24:15.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.166+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.166+0000 7f3cec810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.166+0000 7f3cec810800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:15.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.166+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.166+0000 7f3cec810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.168 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.166+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.168 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.167+0000 7f3cec810800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:15.168 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.167+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.168 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.167+0000 7f3cec810800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:15.168 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.167+0000 7f3cec810800 20 searching for the correct realm 2023-12-03T11:24:15.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.177+0000 7f3ce7e50640 0 -- 172.21.15.131:0/1186286038 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55b5a17e9cc0 msgr2=0x55b5a17ec0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:15.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:15.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:15.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:15.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:15.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:15.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 zone default found 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 4 Realm: () 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 zonegroup default 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.178+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.179+0000 7f3cec810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.179+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.179+0000 7f3cec810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.179+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.179+0000 7f3cec810800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.179+0000 7f3cec810800 20 started sync module instance, tier type = 2023-12-03T11:24:15.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.179+0000 7f3cec810800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:15.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.189+0000 7f3ce764f640 0 -- 172.21.15.131:0/1186286038 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55b5a17eeb10 msgr2=0x55b5a17f0f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:15.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.194+0000 7f3cec810800 20 add_watcher() i=0 2023-12-03T11:24:15.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.194+0000 7f3cec810800 20 add_watcher() i=1 2023-12-03T11:24:15.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.194+0000 7f3cec810800 20 add_watcher() i=2 2023-12-03T11:24:15.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.194+0000 7f3cec810800 20 add_watcher() i=3 2023-12-03T11:24:15.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.194+0000 7f3cec810800 20 add_watcher() i=4 2023-12-03T11:24:15.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.194+0000 7f3cec810800 20 add_watcher() i=5 2023-12-03T11:24:15.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.194+0000 7f3cec810800 20 add_watcher() i=6 2023-12-03T11:24:15.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.196+0000 7f3cec810800 20 add_watcher() i=7 2023-12-03T11:24:15.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.196+0000 7f3cec810800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:15.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.198+0000 7f3cadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:15.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.198+0000 7f3cec810800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:15.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.198+0000 7f3cec810800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:15.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.204+0000 7f3cec810800 5 note: GC not initialized 2023-12-03T11:24:15.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.204+0000 7f3c24ff9640 20 reqs_thread_entry: start 2023-12-03T11:24:15.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.204+0000 7f3cec810800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:15.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.204+0000 7f3cec810800 20 Filter name: none 2023-12-03T11:24:15.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.204+0000 7f3c1a7fc640 20 reqs_thread_entry: start 2023-12-03T11:24:15.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.204+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.205+0000 7f3cec810800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:15.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.205+0000 7f3cec810800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.205+0000 7f3cec810800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:15.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.205+0000 7f3cec810800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:15.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.205+0000 7f3cec810800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:15.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.205+0000 7f3cec810800 20 INFO: main: starting shard=0 2023-12-03T11:24:15.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.205+0000 7f3cec810800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:15.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.206+0000 7f3cec810800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:24:15.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.206+0000 7f3cec810800 20 INFO: main: done 2023-12-03T11:24:15.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.206+0000 7f3cadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:15.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.208+0000 7f3cec810800 20 remove_watcher() i=0 2023-12-03T11:24:15.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.208+0000 7f3cec810800 2 removed watcher, disabling cache 2023-12-03T11:24:15.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.210+0000 7f3cec810800 20 remove_watcher() i=1 2023-12-03T11:24:15.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.211+0000 7f3cec810800 20 remove_watcher() i=2 2023-12-03T11:24:15.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.212+0000 7f3cec810800 20 remove_watcher() i=3 2023-12-03T11:24:15.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.213+0000 7f3cec810800 20 remove_watcher() i=4 2023-12-03T11:24:15.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.214+0000 7f3cec810800 20 remove_watcher() i=5 2023-12-03T11:24:15.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.216+0000 7f3cec810800 20 remove_watcher() i=6 2023-12-03T11:24:15.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.217+0000 7f3cec810800 20 remove_watcher() i=7 2023-12-03T11:24:15.223 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:24:15.253 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:15.253 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:15.267 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.266+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.268+0000 7f41b668c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.268+0000 7f41b668c800 20 realm 2023-12-03T11:24:15.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.268+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.268+0000 7f41b668c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.268+0000 7f41b668c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:15.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.268+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.268+0000 7f41b668c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.268+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.269+0000 7f41b668c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:15.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.269+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.269+0000 7f41b668c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:15.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.269+0000 7f41b668c800 20 searching for the correct realm 2023-12-03T11:24:15.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.278+0000 7f41b418c640 0 -- 172.21.15.131:0/1502547795 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5589211add50 msgr2=0x5589211b0140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:15.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.280+0000 7f41b668c800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:15.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.280+0000 7f41b668c800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:15.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.280+0000 7f41b668c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:15.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.280+0000 7f41b668c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:15.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.280+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.280+0000 7f41b668c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.280+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:15.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:15.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 20 zone default found 2023-12-03T11:24:15.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 4 Realm: () 2023-12-03T11:24:15.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:15.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:15.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:15.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 20 zonegroup default 2023-12-03T11:24:15.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.281+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.282+0000 7f41b668c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.282+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.282+0000 7f41b668c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.282+0000 7f41b668c800 20 started sync module instance, tier type = 2023-12-03T11:24:15.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.282+0000 7f41b668c800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:15.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.295+0000 7f41b398b640 0 -- 172.21.15.131:0/1502547795 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x5589211b2d80 msgr2=0x5589211b5170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:15.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.297+0000 7f41b668c800 20 add_watcher() i=0 2023-12-03T11:24:15.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.297+0000 7f41b668c800 20 add_watcher() i=1 2023-12-03T11:24:15.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.297+0000 7f41b668c800 20 add_watcher() i=2 2023-12-03T11:24:15.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.297+0000 7f41b668c800 20 add_watcher() i=3 2023-12-03T11:24:15.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.297+0000 7f41b668c800 20 add_watcher() i=4 2023-12-03T11:24:15.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.297+0000 7f41b668c800 20 add_watcher() i=5 2023-12-03T11:24:15.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.297+0000 7f41b668c800 20 add_watcher() i=6 2023-12-03T11:24:15.300 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.299+0000 7f41b668c800 20 add_watcher() i=7 2023-12-03T11:24:15.300 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.299+0000 7f41b668c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:15.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.301+0000 7f417a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:15.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.301+0000 7f41b668c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:15.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.301+0000 7f41b668c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:15.308 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.307+0000 7f41b668c800 5 note: GC not initialized 2023-12-03T11:24:15.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.307+0000 7f40e97fa640 20 reqs_thread_entry: start 2023-12-03T11:24:15.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.307+0000 7f41b668c800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:15.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.307+0000 7f41b668c800 20 Filter name: none 2023-12-03T11:24:15.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.307+0000 7f40e2ffd640 20 reqs_thread_entry: start 2023-12-03T11:24:15.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.307+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.310 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.308+0000 7f41b668c800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:15.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.308+0000 7f41b668c800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.308+0000 7f41b668c800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:15.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.308+0000 7f41b668c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:15.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.308+0000 7f41b668c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:15.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.308+0000 7f41b668c800 20 INFO: main: starting shard=0 2023-12-03T11:24:15.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.308+0000 7f41b668c800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:15.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.309+0000 7f41b668c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:24:15.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.309+0000 7f41b668c800 20 INFO: main: done 2023-12-03T11:24:15.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.309+0000 7f417a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:15.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.312+0000 7f41b668c800 20 remove_watcher() i=0 2023-12-03T11:24:15.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.312+0000 7f41b668c800 2 removed watcher, disabling cache 2023-12-03T11:24:15.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.313+0000 7f41b668c800 20 remove_watcher() i=1 2023-12-03T11:24:15.315 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.314+0000 7f41b668c800 20 remove_watcher() i=2 2023-12-03T11:24:15.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.316+0000 7f41b668c800 20 remove_watcher() i=3 2023-12-03T11:24:15.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.317+0000 7f41b668c800 20 remove_watcher() i=4 2023-12-03T11:24:15.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.318+0000 7f41b668c800 20 remove_watcher() i=5 2023-12-03T11:24:15.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.319+0000 7f41b668c800 20 remove_watcher() i=6 2023-12-03T11:24:15.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.320+0000 7f41b668c800 20 remove_watcher() i=7 2023-12-03T11:24:15.326 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2023-12-03T11:24:15.326 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:15.327 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2023-12-03T11:24:15.357 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:15.357 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:15.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.369+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.371+0000 7f85ce935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.371+0000 7f85ce935800 20 realm 2023-12-03T11:24:15.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.371+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.373 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.371+0000 7f85ce935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.373 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.371+0000 7f85ce935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:15.373 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.371+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.373 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.371+0000 7f85ce935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.373 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.371+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.372+0000 7f85ce935800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:15.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.372+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.372+0000 7f85ce935800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:15.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.372+0000 7f85ce935800 20 searching for the correct realm 2023-12-03T11:24:15.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.382+0000 7f85caddf640 0 -- 172.21.15.131:0/80274403 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f85b4073440 msgr2=0x7f85b40738a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:15.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.382+0000 7f85ce935800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:15.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.382+0000 7f85ce935800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:15.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.382+0000 7f85ce935800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:15.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.382+0000 7f85ce935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:15.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.382+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.382+0000 7f85ce935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.382+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.382+0000 7f85ce935800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:15.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.382+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:15.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 20 zone default found 2023-12-03T11:24:15.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 4 Realm: () 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 20 zonegroup default 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 20 started sync module instance, tier type = 2023-12-03T11:24:15.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.383+0000 7f85ce935800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:15.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.394+0000 7f85c1ddd640 0 -- 172.21.15.131:0/80274403 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x7f85b4073440 msgr2=0x7f85a407b9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:15.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.598+0000 7f85ce935800 20 add_watcher() i=0 2023-12-03T11:24:15.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.598+0000 7f85ce935800 20 add_watcher() i=1 2023-12-03T11:24:15.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.598+0000 7f85ce935800 20 add_watcher() i=2 2023-12-03T11:24:15.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.598+0000 7f85ce935800 20 add_watcher() i=3 2023-12-03T11:24:15.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.598+0000 7f85ce935800 20 add_watcher() i=4 2023-12-03T11:24:15.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.598+0000 7f85ce935800 20 add_watcher() i=5 2023-12-03T11:24:15.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.598+0000 7f85ce935800 20 add_watcher() i=6 2023-12-03T11:24:15.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.599+0000 7f85ce935800 20 add_watcher() i=7 2023-12-03T11:24:15.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.599+0000 7f85ce935800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:15.601 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.601+0000 7f858ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:15.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.601+0000 7f85ce935800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:15.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.601+0000 7f85ce935800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:15.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.607+0000 7f85ce935800 5 note: GC not initialized 2023-12-03T11:24:15.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.607+0000 7f84feffd640 20 reqs_thread_entry: start 2023-12-03T11:24:15.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.607+0000 7f85ce935800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:15.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.607+0000 7f85ce935800 20 Filter name: none 2023-12-03T11:24:15.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.607+0000 7f84fcff9640 20 reqs_thread_entry: start 2023-12-03T11:24:15.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.607+0000 7f85ce935800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:24:15.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.607+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:15.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:24:15.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:24:15.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 : miss 2023-12-03T11:24:15.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 20 rados->read ofs=0 len=0 2023-12-03T11:24:15.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:15.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 info.flags=0x17 2023-12-03T11:24:15.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 to cache LRU end 2023-12-03T11:24:15.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:24:15.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:24:15.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 2023-12-03T11:24:15.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.608+0000 7f85ce935800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:15.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.609+0000 7f85ce935800 1 NOTICE: finished shard 0 (0 entries found) 2023-12-03T11:24:15.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.609+0000 7f85ce935800 1 NOTICE: finished all shards (0 entries found) 2023-12-03T11:24:15.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.610+0000 7f858ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:15.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.612+0000 7f85ce935800 20 remove_watcher() i=0 2023-12-03T11:24:15.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.612+0000 7f85ce935800 2 removed watcher, disabling cache 2023-12-03T11:24:15.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.613+0000 7f85ce935800 20 remove_watcher() i=1 2023-12-03T11:24:15.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.614+0000 7f85ce935800 20 remove_watcher() i=2 2023-12-03T11:24:15.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.615+0000 7f85ce935800 20 remove_watcher() i=3 2023-12-03T11:24:15.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.616+0000 7f85ce935800 20 remove_watcher() i=4 2023-12-03T11:24:15.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.617+0000 7f85ce935800 20 remove_watcher() i=5 2023-12-03T11:24:15.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.618+0000 7f85ce935800 20 remove_watcher() i=6 2023-12-03T11:24:15.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:15.619+0000 7f85ce935800 20 remove_watcher() i=7 2023-12-03T11:24:15.624 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: verify that bucket check fixes do not affect null version objects 2023-12-03T11:24:15.625 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:15.676 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2023-12-03T11:24:15.676 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:24:15.891 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-12-03T11:24:16.265 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-12-03T11:24:17.690 INFO:tasks.workunit.client.0.smithi131.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:24:17.692 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object c 2023-12-03T11:24:17.722 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:17.723 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:17.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.736+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.738+0000 7f261d332800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.738+0000 7f261d332800 20 realm 2023-12-03T11:24:17.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.738+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.738+0000 7f261d332800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.738+0000 7f261d332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:17.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.738+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.739+0000 7f261d332800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.739+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.740+0000 7f261d332800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:17.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.740+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.740+0000 7f261d332800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:17.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.740+0000 7f261d332800 20 searching for the correct realm 2023-12-03T11:24:17.751 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.750+0000 7f2618f62640 0 -- 172.21.15.131:0/2587198663 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55bfcd06dcd0 msgr2=0x55bfcd0700c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:17.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.751+0000 7f261d332800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:17.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.751+0000 7f261d332800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:17.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.751+0000 7f261d332800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:17.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.751+0000 7f261d332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:17.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.751+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.752+0000 7f261d332800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.752+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.752+0000 7f261d332800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:17.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.752+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.752+0000 7f261d332800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:17.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.752+0000 7f261d332800 20 zone default found 2023-12-03T11:24:17.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.752+0000 7f261d332800 4 Realm: () 2023-12-03T11:24:17.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.752+0000 7f261d332800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:17.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.752+0000 7f261d332800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:17.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.752+0000 7f261d332800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:17.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.752+0000 7f261d332800 20 zonegroup default 2023-12-03T11:24:17.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.753+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.753+0000 7f261d332800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.753+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.753+0000 7f261d332800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.753+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.753+0000 7f261d332800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.753+0000 7f261d332800 20 started sync module instance, tier type = 2023-12-03T11:24:17.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.753+0000 7f261d332800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:17.762 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.761+0000 7f2610761640 0 -- 172.21.15.131:0/2587198663 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55bfcd072d00 msgr2=0x55bfcd0750f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:24:17.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.764+0000 7f261d332800 20 add_watcher() i=0 2023-12-03T11:24:17.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.764+0000 7f261d332800 20 add_watcher() i=1 2023-12-03T11:24:17.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.764+0000 7f261d332800 20 add_watcher() i=2 2023-12-03T11:24:17.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.764+0000 7f261d332800 20 add_watcher() i=3 2023-12-03T11:24:17.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.764+0000 7f261d332800 20 add_watcher() i=4 2023-12-03T11:24:17.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.764+0000 7f261d332800 20 add_watcher() i=5 2023-12-03T11:24:17.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.764+0000 7f261d332800 20 add_watcher() i=6 2023-12-03T11:24:17.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.765+0000 7f261d332800 20 add_watcher() i=7 2023-12-03T11:24:17.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.765+0000 7f261d332800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:17.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.767+0000 7f25df7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:17.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.767+0000 7f261d332800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:17.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.767+0000 7f261d332800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:17.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.773+0000 7f261d332800 5 note: GC not initialized 2023-12-03T11:24:17.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.773+0000 7f254e7fc640 20 reqs_thread_entry: start 2023-12-03T11:24:17.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.773+0000 7f261d332800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:17.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.773+0000 7f261d332800 20 Filter name: none 2023-12-03T11:24:17.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.774+0000 7f253ffff640 20 reqs_thread_entry: start 2023-12-03T11:24:17.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.774+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.774+0000 7f261d332800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:17.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.774+0000 7f261d332800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.774+0000 7f261d332800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:17.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.774+0000 7f261d332800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:17.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.774+0000 7f261d332800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:17.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.774+0000 7f261d332800 20 INFO: main: starting shard=0 2023-12-03T11:24:17.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.774+0000 7f261d332800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:17.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.775+0000 7f261d332800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:24:17.777 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.775+0000 7f261d332800 20 INFO: main: done 2023-12-03T11:24:17.777 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.776+0000 7f25df7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:17.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.778+0000 7f261d332800 20 remove_watcher() i=0 2023-12-03T11:24:17.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.778+0000 7f261d332800 2 removed watcher, disabling cache 2023-12-03T11:24:17.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.779+0000 7f261d332800 20 remove_watcher() i=1 2023-12-03T11:24:17.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.781+0000 7f261d332800 20 remove_watcher() i=2 2023-12-03T11:24:17.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.782+0000 7f261d332800 20 remove_watcher() i=3 2023-12-03T11:24:17.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.783+0000 7f261d332800 20 remove_watcher() i=4 2023-12-03T11:24:17.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.784+0000 7f261d332800 20 remove_watcher() i=5 2023-12-03T11:24:17.787 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.786+0000 7f261d332800 20 remove_watcher() i=6 2023-12-03T11:24:17.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.787+0000 7f261d332800 20 remove_watcher() i=7 2023-12-03T11:24:17.848 INFO:tasks.workunit.client.0.smithi131.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:24:17.849 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object d 2023-12-03T11:24:17.878 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:17.878 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:17.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.891+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.892+0000 7fd75d120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.892+0000 7fd75d120800 20 realm 2023-12-03T11:24:17.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.892+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.893+0000 7fd75d120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.893+0000 7fd75d120800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:17.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.893+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.893+0000 7fd75d120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.893+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.894+0000 7fd75d120800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:17.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.894+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.894+0000 7fd75d120800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:17.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.894+0000 7fd75d120800 20 searching for the correct realm 2023-12-03T11:24:17.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.904+0000 7fd758dc9640 0 -- 172.21.15.131:0/2618284625 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55c792df62d0 msgr2=0x55c792df86c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:17.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.905+0000 7fd75d120800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:17.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.905+0000 7fd75d120800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:17.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.905+0000 7fd75d120800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:17.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.905+0000 7fd75d120800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:17.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.905+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:17.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:17.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 20 zone default found 2023-12-03T11:24:17.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 4 Realm: () 2023-12-03T11:24:17.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:17.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 20 zonegroup default 2023-12-03T11:24:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.906+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.907+0000 7fd75d120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.907+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.907+0000 7fd75d120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.907+0000 7fd75d120800 20 started sync module instance, tier type = 2023-12-03T11:24:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.907+0000 7fd75d120800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:17.913 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.912+0000 7fd7595ca640 0 -- 172.21.15.131:0/2618284625 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x55c792df62d0 msgr2=0x7fd73407bc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:17.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.917+0000 7fd75d120800 20 add_watcher() i=0 2023-12-03T11:24:17.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:17.917+0000 7fd75d120800 20 add_watcher() i=1 2023-12-03T11:24:18.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.114+0000 7fd75d120800 20 add_watcher() i=2 2023-12-03T11:24:18.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.114+0000 7fd75d120800 20 add_watcher() i=3 2023-12-03T11:24:18.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.114+0000 7fd75d120800 20 add_watcher() i=4 2023-12-03T11:24:18.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.114+0000 7fd75d120800 20 add_watcher() i=5 2023-12-03T11:24:18.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.114+0000 7fd75d120800 20 add_watcher() i=6 2023-12-03T11:24:18.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.114+0000 7fd75d120800 20 add_watcher() i=7 2023-12-03T11:24:18.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.114+0000 7fd75d120800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:18.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.117+0000 7fd71efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:18.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.117+0000 7fd75d120800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:18.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.117+0000 7fd75d120800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:18.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.123+0000 7fd75d120800 5 note: GC not initialized 2023-12-03T11:24:18.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.123+0000 7fd68dffb640 20 reqs_thread_entry: start 2023-12-03T11:24:18.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.124+0000 7fd75d120800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:18.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.124+0000 7fd75d120800 20 Filter name: none 2023-12-03T11:24:18.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.124+0000 7fd67f7fe640 20 reqs_thread_entry: start 2023-12-03T11:24:18.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.124+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.124+0000 7fd75d120800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:18.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.124+0000 7fd75d120800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.125+0000 7fd75d120800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:18.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.125+0000 7fd75d120800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:18.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.125+0000 7fd75d120800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:18.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.125+0000 7fd75d120800 20 INFO: main: starting shard=0 2023-12-03T11:24:18.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.125+0000 7fd75d120800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:18.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.125+0000 7fd75d120800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2023-12-03T11:24:18.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.126+0000 7fd75d120800 20 INFO: main: done 2023-12-03T11:24:18.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.126+0000 7fd71efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:18.130 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.129+0000 7fd75d120800 20 remove_watcher() i=0 2023-12-03T11:24:18.130 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.129+0000 7fd75d120800 2 removed watcher, disabling cache 2023-12-03T11:24:18.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.130+0000 7fd75d120800 20 remove_watcher() i=1 2023-12-03T11:24:18.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.131+0000 7fd75d120800 20 remove_watcher() i=2 2023-12-03T11:24:18.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.132+0000 7fd75d120800 20 remove_watcher() i=3 2023-12-03T11:24:18.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.134+0000 7fd75d120800 20 remove_watcher() i=4 2023-12-03T11:24:18.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.135+0000 7fd75d120800 20 remove_watcher() i=5 2023-12-03T11:24:18.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.136+0000 7fd75d120800 20 remove_watcher() i=6 2023-12-03T11:24:18.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.137+0000 7fd75d120800 20 remove_watcher() i=7 2023-12-03T11:24:18.195 INFO:tasks.workunit.client.0.smithi131.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:24:18.197 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object e 2023-12-03T11:24:18.225 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:18.225 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:18.239 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.238+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.239+0000 7fb38753a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.239+0000 7fb38753a800 20 realm 2023-12-03T11:24:18.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.239+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.239+0000 7fb38753a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.239+0000 7fb38753a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:18.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.240+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.240+0000 7fb38753a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.240+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.241+0000 7fb38753a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:18.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.241+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.241+0000 7fb38753a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:18.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.241+0000 7fb38753a800 20 searching for the correct realm 2023-12-03T11:24:18.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.251+0000 7fb38320d640 0 -- 172.21.15.131:0/1535298589 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x556fa4de6fe0 msgr2=0x556fa4de93f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:18.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.252+0000 7fb38753a800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:18.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.252+0000 7fb38753a800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:18.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.252+0000 7fb38753a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:18.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.252+0000 7fb38753a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:18.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.252+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.252+0000 7fb38753a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.252+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:18.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:18.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 20 zone default found 2023-12-03T11:24:18.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 4 Realm: () 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 20 zonegroup default 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.253+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.254+0000 7fb38753a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.254+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.254+0000 7fb38753a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.254+0000 7fb38753a800 20 started sync module instance, tier type = 2023-12-03T11:24:18.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.254+0000 7fb38753a800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:18.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.261+0000 7fb383a0e640 0 -- 172.21.15.131:0/1535298589 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7fb3780724d0 msgr2=0x7fb378073410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:18.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.268+0000 7fb38753a800 20 add_watcher() i=0 2023-12-03T11:24:18.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.268+0000 7fb38753a800 20 add_watcher() i=1 2023-12-03T11:24:18.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.268+0000 7fb38753a800 20 add_watcher() i=2 2023-12-03T11:24:18.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.268+0000 7fb38753a800 20 add_watcher() i=3 2023-12-03T11:24:18.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.268+0000 7fb38753a800 20 add_watcher() i=4 2023-12-03T11:24:18.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.268+0000 7fb38753a800 20 add_watcher() i=5 2023-12-03T11:24:18.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.268+0000 7fb38753a800 20 add_watcher() i=6 2023-12-03T11:24:18.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.269+0000 7fb38753a800 20 add_watcher() i=7 2023-12-03T11:24:18.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.269+0000 7fb38753a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:18.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.270+0000 7fb3497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:18.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.271+0000 7fb38753a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:18.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.271+0000 7fb38753a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:18.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.277+0000 7fb38753a800 5 note: GC not initialized 2023-12-03T11:24:18.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.277+0000 7fb2b7fff640 20 reqs_thread_entry: start 2023-12-03T11:24:18.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.277+0000 7fb38753a800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:18.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.277+0000 7fb38753a800 20 Filter name: none 2023-12-03T11:24:18.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.277+0000 7fb2b5ffb640 20 reqs_thread_entry: start 2023-12-03T11:24:18.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.277+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.277+0000 7fb38753a800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:18.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.277+0000 7fb38753a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.278+0000 7fb38753a800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:18.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.278+0000 7fb38753a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:18.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.278+0000 7fb38753a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:18.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.278+0000 7fb38753a800 20 INFO: main: starting shard=0 2023-12-03T11:24:18.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.278+0000 7fb38753a800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:18.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.278+0000 7fb38753a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:24:18.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.278+0000 7fb38753a800 20 INFO: main: done 2023-12-03T11:24:18.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.279+0000 7fb3497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:18.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.282+0000 7fb38753a800 20 remove_watcher() i=0 2023-12-03T11:24:18.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.282+0000 7fb38753a800 2 removed watcher, disabling cache 2023-12-03T11:24:18.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.283+0000 7fb38753a800 20 remove_watcher() i=1 2023-12-03T11:24:18.286 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.286+0000 7fb38753a800 20 remove_watcher() i=2 2023-12-03T11:24:18.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.287+0000 7fb38753a800 20 remove_watcher() i=3 2023-12-03T11:24:18.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.288+0000 7fb38753a800 20 remove_watcher() i=4 2023-12-03T11:24:18.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.289+0000 7fb38753a800 20 remove_watcher() i=5 2023-12-03T11:24:18.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.292+0000 7fb38753a800 20 remove_watcher() i=6 2023-12-03T11:24:18.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.293+0000 7fb38753a800 20 remove_watcher() i=7 2023-12-03T11:24:18.352 INFO:tasks.workunit.client.0.smithi131.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:24:18.353 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket check-bucket --object f 2023-12-03T11:24:18.384 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:18.384 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:18.398 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.397+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.398+0000 7f61dd13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.398+0000 7f61dd13a800 20 realm 2023-12-03T11:24:18.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.398+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.399+0000 7f61dd13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.399+0000 7f61dd13a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:18.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.399+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.399+0000 7f61dd13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.399+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.400+0000 7f61dd13a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:18.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.400+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.400+0000 7f61dd13a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:18.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.400+0000 7f61dd13a800 20 searching for the correct realm 2023-12-03T11:24:18.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.410+0000 7f61d060c640 0 -- 172.21.15.131:0/2319361664 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x5588388fe770 msgr2=0x558838900b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:18.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.411+0000 7f61dd13a800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:18.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.411+0000 7f61dd13a800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:18.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.411+0000 7f61dd13a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:18.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.411+0000 7f61dd13a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:18.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.411+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.411+0000 7f61dd13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.411+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:18.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 20 zone default found 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 4 Realm: () 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 20 zonegroup default 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.412+0000 7f61dd13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.413+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.413+0000 7f61dd13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.413+0000 7f61dd13a800 20 started sync module instance, tier type = 2023-12-03T11:24:18.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.413+0000 7f61dd13a800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:18.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.428+0000 7f61d060c640 0 -- 172.21.15.131:0/2319361664 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x7f61b0076c00 msgr2=0x7f61b0079030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:18.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.430+0000 7f61dd13a800 20 add_watcher() i=0 2023-12-03T11:24:18.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.430+0000 7f61dd13a800 20 add_watcher() i=1 2023-12-03T11:24:18.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.430+0000 7f61dd13a800 20 add_watcher() i=2 2023-12-03T11:24:18.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.430+0000 7f61dd13a800 20 add_watcher() i=3 2023-12-03T11:24:18.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.430+0000 7f61dd13a800 20 add_watcher() i=4 2023-12-03T11:24:18.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.435+0000 7f61dd13a800 20 add_watcher() i=5 2023-12-03T11:24:18.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.435+0000 7f61dd13a800 20 add_watcher() i=6 2023-12-03T11:24:18.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.435+0000 7f61dd13a800 20 add_watcher() i=7 2023-12-03T11:24:18.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.435+0000 7f61dd13a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:18.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.437+0000 7f619f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:18.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.438+0000 7f61dd13a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:18.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.438+0000 7f61dd13a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:18.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.443+0000 7f61dd13a800 5 note: GC not initialized 2023-12-03T11:24:18.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.443+0000 7f610e7fc640 20 reqs_thread_entry: start 2023-12-03T11:24:18.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.443+0000 7f61dd13a800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:18.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.444+0000 7f61dd13a800 20 Filter name: none 2023-12-03T11:24:18.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.444+0000 7f60fffff640 20 reqs_thread_entry: start 2023-12-03T11:24:18.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.444+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.444+0000 7f61dd13a800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:18.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.444+0000 7f61dd13a800 20 rados->read ofs=0 len=0 2023-12-03T11:24:18.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.445+0000 7f61dd13a800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:18.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.445+0000 7f61dd13a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:18.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.445+0000 7f61dd13a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2023-12-03T11:24:18.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.445+0000 7f61dd13a800 20 INFO: main: starting shard=0 2023-12-03T11:24:18.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.445+0000 7f61dd13a800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:18.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.445+0000 7f61dd13a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:24:18.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.445+0000 7f61dd13a800 20 INFO: main: done 2023-12-03T11:24:18.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.446+0000 7f619f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:18.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.448+0000 7f61dd13a800 20 remove_watcher() i=0 2023-12-03T11:24:18.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.448+0000 7f61dd13a800 2 removed watcher, disabling cache 2023-12-03T11:24:18.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.450+0000 7f61dd13a800 20 remove_watcher() i=1 2023-12-03T11:24:18.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.451+0000 7f61dd13a800 20 remove_watcher() i=2 2023-12-03T11:24:18.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.453+0000 7f61dd13a800 20 remove_watcher() i=3 2023-12-03T11:24:18.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.454+0000 7f61dd13a800 20 remove_watcher() i=4 2023-12-03T11:24:18.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.455+0000 7f61dd13a800 20 remove_watcher() i=5 2023-12-03T11:24:18.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.457+0000 7f61dd13a800 20 remove_watcher() i=6 2023-12-03T11:24:18.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:18.458+0000 7f61dd13a800 20 remove_watcher() i=7 2023-12-03T11:24:18.470 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-12-03T11:24:18.841 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-12-03T11:24:19.224 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2023-12-03T11:24:19.251 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:19.252 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:19.266 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.265+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.268 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.267+0000 7fb21fb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.268 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.267+0000 7fb21fb37800 20 realm 2023-12-03T11:24:19.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.267+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.267+0000 7fb21fb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.267+0000 7fb21fb37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:19.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.267+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.267+0000 7fb21fb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.267+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.268+0000 7fb21fb37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:19.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.268+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.268+0000 7fb21fb37800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:19.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.268+0000 7fb21fb37800 20 searching for the correct realm 2023-12-03T11:24:19.277 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.276+0000 7fb21c070640 0 -- 172.21.15.131:0/3994440659 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55bac1101920 msgr2=0x55bac1103d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:24:19.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.280+0000 7fb21fb37800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:19.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.280+0000 7fb21fb37800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:19.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.280+0000 7fb21fb37800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:19.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.280+0000 7fb21fb37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:19.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.280+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.280+0000 7fb21fb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.280+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.280+0000 7fb21fb37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:19.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.280+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:19.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 20 zone default found 2023-12-03T11:24:19.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 4 Realm: () 2023-12-03T11:24:19.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:19.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:19.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:19.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 20 zonegroup default 2023-12-03T11:24:19.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.281+0000 7fb21306e640 0 -- 172.21.15.131:0/3994440659 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55bac110a6d0 msgr2=0x55bac110cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:24:19.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.282+0000 7fb21fb37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.282+0000 7fb21fb37800 20 started sync module instance, tier type = 2023-12-03T11:24:19.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.282+0000 7fb21fb37800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:19.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.294+0000 7fb21fb37800 20 add_watcher() i=0 2023-12-03T11:24:19.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.294+0000 7fb21fb37800 20 add_watcher() i=1 2023-12-03T11:24:19.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.294+0000 7fb21fb37800 20 add_watcher() i=2 2023-12-03T11:24:19.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.294+0000 7fb21fb37800 20 add_watcher() i=3 2023-12-03T11:24:19.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.294+0000 7fb21fb37800 20 add_watcher() i=4 2023-12-03T11:24:19.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.294+0000 7fb21fb37800 20 add_watcher() i=5 2023-12-03T11:24:19.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.295+0000 7fb21fb37800 20 add_watcher() i=6 2023-12-03T11:24:19.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.295+0000 7fb21fb37800 20 add_watcher() i=7 2023-12-03T11:24:19.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.295+0000 7fb21fb37800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:19.298 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.297+0000 7fb1e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:19.298 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.297+0000 7fb21fb37800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:19.298 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.297+0000 7fb21fb37800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:19.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.303+0000 7fb21fb37800 5 note: GC not initialized 2023-12-03T11:24:19.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.303+0000 7fb158ff9640 20 reqs_thread_entry: start 2023-12-03T11:24:19.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.303+0000 7fb21fb37800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:19.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.303+0000 7fb21fb37800 20 Filter name: none 2023-12-03T11:24:19.305 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.303+0000 7fb14e7fc640 20 reqs_thread_entry: start 2023-12-03T11:24:19.305 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.303+0000 7fb21fb37800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:24:19.305 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.303+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:19.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:24:19.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:24:19.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 : miss 2023-12-03T11:24:19.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:19.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 info.flags=0x17 2023-12-03T11:24:19.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 to cache LRU end 2023-12-03T11:24:19.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:24:19.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:24:19.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 2023-12-03T11:24:19.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:24:19.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:24:19.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:24:19.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:24:19.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:24:19.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.304+0000 7fb21fb37800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:24:19.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.308+0000 7fb1e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:19.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.310+0000 7fb21fb37800 20 remove_watcher() i=0 2023-12-03T11:24:19.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.310+0000 7fb21fb37800 2 removed watcher, disabling cache 2023-12-03T11:24:19.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.311+0000 7fb21fb37800 20 remove_watcher() i=1 2023-12-03T11:24:19.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.312+0000 7fb21fb37800 20 remove_watcher() i=2 2023-12-03T11:24:19.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.313+0000 7fb21fb37800 20 remove_watcher() i=3 2023-12-03T11:24:19.315 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.314+0000 7fb21fb37800 20 remove_watcher() i=4 2023-12-03T11:24:19.316 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.315+0000 7fb21fb37800 20 remove_watcher() i=5 2023-12-03T11:24:19.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.318+0000 7fb21fb37800 20 remove_watcher() i=6 2023-12-03T11:24:19.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.319+0000 7fb21fb37800 20 remove_watcher() i=7 2023-12-03T11:24:19.326 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:24:19.358 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:19.359 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:19.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.371+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.373+0000 7f548f726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.373+0000 7f548f726800 20 realm 2023-12-03T11:24:19.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.373+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.373+0000 7f548f726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.373+0000 7f548f726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:19.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.373+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.375 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.373+0000 7f548f726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.375 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.373+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.375 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.374+0000 7f548f726800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:19.375 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.374+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.375 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.374+0000 7f548f726800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:19.375 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.374+0000 7f548f726800 20 searching for the correct realm 2023-12-03T11:24:19.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.384+0000 7f548b485640 0 -- 172.21.15.131:0/1138739058 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55d242796b80 msgr2=0x55d242798f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:19.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.385+0000 7f548f726800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:19.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.385+0000 7f548f726800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:19.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.385+0000 7f548f726800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:19.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.385+0000 7f548f726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:19.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.385+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.385+0000 7f548f726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.385+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.385+0000 7f548f726800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:19.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.385+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.385+0000 7f548f726800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:19.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 20 zone default found 2023-12-03T11:24:19.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 4 Realm: () 2023-12-03T11:24:19.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:19.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:19.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:19.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 20 zonegroup default 2023-12-03T11:24:19.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 20 started sync module instance, tier type = 2023-12-03T11:24:19.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.386+0000 7f548f726800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:19.398 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.397+0000 7f5482c84640 0 -- 172.21.15.131:0/1138739058 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55d24279bb40 msgr2=0x55d24279df30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:19.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.398+0000 7f548f726800 20 add_watcher() i=0 2023-12-03T11:24:19.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.398+0000 7f548f726800 20 add_watcher() i=1 2023-12-03T11:24:19.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.398+0000 7f548f726800 20 add_watcher() i=2 2023-12-03T11:24:19.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.398+0000 7f548f726800 20 add_watcher() i=3 2023-12-03T11:24:19.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.398+0000 7f548f726800 20 add_watcher() i=4 2023-12-03T11:24:19.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.398+0000 7f548f726800 20 add_watcher() i=5 2023-12-03T11:24:19.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.398+0000 7f548f726800 20 add_watcher() i=6 2023-12-03T11:24:19.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.399+0000 7f548f726800 20 add_watcher() i=7 2023-12-03T11:24:19.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.399+0000 7f548f726800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:19.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.401+0000 7f54517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:19.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.401+0000 7f548f726800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:19.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.401+0000 7f548f726800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:19.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.407+0000 7f548f726800 5 note: GC not initialized 2023-12-03T11:24:19.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.407+0000 7f53bffff640 20 reqs_thread_entry: start 2023-12-03T11:24:19.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.407+0000 7f548f726800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:19.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.407+0000 7f548f726800 20 Filter name: none 2023-12-03T11:24:19.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.407+0000 7f53bdffb640 20 reqs_thread_entry: start 2023-12-03T11:24:19.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.407+0000 7f548f726800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2023-12-03T11:24:19.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.407+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:19.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2023-12-03T11:24:19.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2023-12-03T11:24:19.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 : miss 2023-12-03T11:24:19.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:19.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 info.flags=0x17 2023-12-03T11:24:19.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 to cache LRU end 2023-12-03T11:24:19.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:24:19.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 10 updating xattr: name=user.rgw.acl bl.length()=179 2023-12-03T11:24:19.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1 2023-12-03T11:24:19.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.408+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.409+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.409+0000 7f548f726800 20 get_obj_state: octx=0x7f5484063000 obj=check-bucket:c state=0x55d2428497f8 s->prefetch_data=0 2023-12-03T11:24:19.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.409+0000 7f548f726800 20 get_obj_state: setting s->obj_tag to xrz6zi5gr4ui85kosam0uab0i4qvd597 2023-12-03T11:24:19.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.409+0000 7f548f726800 20 get_obj_state_impl: setting s->olh_tag to 5hgac9hf6n0w6wgrr47xk9ruhyak2irm 2023-12-03T11:24:19.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.409+0000 7f548f726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5hgac9hf6n0w6wgrr47xk9ruhyak2irm 2023-12-03T11:24:19.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.411+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.412+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.412+0000 7f548f726800 20 olh_log_entry: epoch=3 op=3 key=c[utW4nWatXengxM81sI7tGhKxI-kPW2n] 2023-12-03T11:24:19.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.412+0000 7f548f726800 20 get_obj_state: octx=0x7f5484063000 obj=check-bucket:_:utW4nWatXengxM81sI7tGhKxI-kPW2n_c state=0x55d2428532f8 s->prefetch_data=0 2023-12-03T11:24:19.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.413+0000 7f548f726800 10 manifest: total_size = 22 2023-12-03T11:24:19.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.413+0000 7f548f726800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.2897464457849562723 2023-12-03T11:24:19.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.413+0000 7f548f726800 20 get_obj_state: octx=0x7f5484063000 obj=check-bucket:_:utW4nWatXengxM81sI7tGhKxI-kPW2n_c state=0x55d2428532f8 s->prefetch_data=0 2023-12-03T11:24:19.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.413+0000 7f548f726800 20 prepare_atomic_modification: state is not atomic. state=0x55d2428532f8 2023-12-03T11:24:19.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.413+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.416+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.416+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.416+0000 7f5481481640 20 handle_completion(): completion ok for obj=c[utW4nWatXengxM81sI7tGhKxI-kPW2n] 2023-12-03T11:24:19.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.417+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.418+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.418+0000 7f548f726800 20 get_obj_state: octx=0x55d2428281e0 obj=check-bucket:d state=0x55d2428497f8 s->prefetch_data=0 2023-12-03T11:24:19.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.418+0000 7f548f726800 20 get_obj_state: setting s->obj_tag to kbebl8fne3qat9vzaq7780qioc0h4nei 2023-12-03T11:24:19.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.418+0000 7f548f726800 20 get_obj_state_impl: setting s->olh_tag to qfrq3h9rwfi3zwvsf9osa8a6msa3sm84 2023-12-03T11:24:19.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.418+0000 7f548f726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qfrq3h9rwfi3zwvsf9osa8a6msa3sm84 2023-12-03T11:24:19.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.419+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.421+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.421+0000 7f548f726800 20 olh_log_entry: epoch=3 op=3 key=d[cZRGRisvjpr6BoO3sxDd4BaridTNVC5] 2023-12-03T11:24:19.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.421+0000 7f548f726800 20 get_obj_state: octx=0x55d2428281e0 obj=check-bucket:_:cZRGRisvjpr6BoO3sxDd4BaridTNVC5_d state=0x55d242853c98 s->prefetch_data=0 2023-12-03T11:24:19.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.422+0000 7f548f726800 10 manifest: total_size = 22 2023-12-03T11:24:19.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.422+0000 7f548f726800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.12889322209790661476 2023-12-03T11:24:19.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.422+0000 7f548f726800 20 get_obj_state: octx=0x55d2428281e0 obj=check-bucket:_:cZRGRisvjpr6BoO3sxDd4BaridTNVC5_d state=0x55d242853c98 s->prefetch_data=0 2023-12-03T11:24:19.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.422+0000 7f548f726800 20 prepare_atomic_modification: state is not atomic. state=0x55d242853c98 2023-12-03T11:24:19.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.422+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.425+0000 7f5481481640 20 handle_completion(): completion ok for obj=d[cZRGRisvjpr6BoO3sxDd4BaridTNVC5] 2023-12-03T11:24:19.427 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.426+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.427 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.426+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.428 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.427+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.428 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.427+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.427+0000 7f548f726800 20 get_obj_state: octx=0x7f547c06bd40 obj=check-bucket:e state=0x55d2428497f8 s->prefetch_data=0 2023-12-03T11:24:19.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.427+0000 7f548f726800 20 get_obj_state: setting s->obj_tag to fwpazc725n2azrrjsul8tzatpurplnr2 2023-12-03T11:24:19.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.427+0000 7f548f726800 20 get_obj_state_impl: setting s->olh_tag to d5lzioxvs7uzelyzmahwwz9uzzth3vj8 2023-12-03T11:24:19.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.427+0000 7f548f726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=d5lzioxvs7uzelyzmahwwz9uzzth3vj8 2023-12-03T11:24:19.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.428+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.430+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.430+0000 7f548f726800 20 olh_log_entry: epoch=2 op=2 key=e[] 2023-12-03T11:24:19.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.430+0000 7f548f726800 20 olh_log_entry: epoch=2 op=3 key=e[harLVNUbStlPFJlALfj9LQsUnOs3bJD] 2023-12-03T11:24:19.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.430+0000 7f548f726800 20 get_obj_state: octx=0x7f547c06bd40 obj=check-bucket:_:harLVNUbStlPFJlALfj9LQsUnOs3bJD_e state=0x55d242850c68 s->prefetch_data=0 2023-12-03T11:24:19.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.430+0000 7f548f726800 10 manifest: total_size = 11 2023-12-03T11:24:19.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.430+0000 7f548f726800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.15448748737277813670 2023-12-03T11:24:19.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.430+0000 7f548f726800 20 get_obj_state: octx=0x7f547c06bd40 obj=check-bucket:_:harLVNUbStlPFJlALfj9LQsUnOs3bJD_e state=0x55d242850c68 s->prefetch_data=0 2023-12-03T11:24:19.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.430+0000 7f548f726800 20 prepare_atomic_modification: state is not atomic. state=0x55d242850c68 2023-12-03T11:24:19.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.430+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.434+0000 7f548f726800 20 get_obj_state: octx=0x7f547c06bd40 obj=check-bucket:e state=0x55d2428497f8 s->prefetch_data=0 2023-12-03T11:24:19.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.434+0000 7f548f726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=d5lzioxvs7uzelyzmahwwz9uzzth3vj8 2023-12-03T11:24:19.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.434+0000 7f5481481640 20 handle_completion(): completion ok for obj=e[harLVNUbStlPFJlALfj9LQsUnOs3bJD] 2023-12-03T11:24:19.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.438+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.439+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.439+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.440+0000 7f548f726800 20 get_obj_state: octx=0x7f547c04af60 obj=check-bucket:f state=0x55d2428497f8 s->prefetch_data=0 2023-12-03T11:24:19.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.440+0000 7f548f726800 20 get_obj_state: setting s->obj_tag to 1v5m4wt27je732araopho9mlg606bhoe 2023-12-03T11:24:19.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.440+0000 7f548f726800 20 get_obj_state_impl: setting s->olh_tag to upcx87arub8896cqx5zn6leowp90cf4c 2023-12-03T11:24:19.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.440+0000 7f548f726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=upcx87arub8896cqx5zn6leowp90cf4c 2023-12-03T11:24:19.442 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.441+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.443+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.443+0000 7f548f726800 20 olh_log_entry: epoch=2 op=2 key=f[] 2023-12-03T11:24:19.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.443+0000 7f548f726800 20 olh_log_entry: epoch=2 op=3 key=f[a3ybJfc2wE4NQkJGY3hkcv3n3h0Wf9U] 2023-12-03T11:24:19.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.443+0000 7f548f726800 20 get_obj_state: octx=0x7f547c04af60 obj=check-bucket:_:a3ybJfc2wE4NQkJGY3hkcv3n3h0Wf9U_f state=0x55d24284fc58 s->prefetch_data=0 2023-12-03T11:24:19.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.443+0000 7f548f726800 10 manifest: total_size = 12 2023-12-03T11:24:19.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.443+0000 7f548f726800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16533827176911387657 2023-12-03T11:24:19.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.443+0000 7f548f726800 20 get_obj_state: octx=0x7f547c04af60 obj=check-bucket:_:a3ybJfc2wE4NQkJGY3hkcv3n3h0Wf9U_f state=0x55d24284fc58 s->prefetch_data=0 2023-12-03T11:24:19.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.443+0000 7f548f726800 20 prepare_atomic_modification: state is not atomic. state=0x55d24284fc58 2023-12-03T11:24:19.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.444+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.448+0000 7f548f726800 20 get_obj_state: octx=0x7f547c04af60 obj=check-bucket:f state=0x55d2428497f8 s->prefetch_data=0 2023-12-03T11:24:19.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.448+0000 7f548f726800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=upcx87arub8896cqx5zn6leowp90cf4c 2023-12-03T11:24:19.450 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.449+0000 7f5481c82640 20 handle_completion(): completion ok for obj=f[a3ybJfc2wE4NQkJGY3hkcv3n3h0Wf9U] 2023-12-03T11:24:19.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.453+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.454+0000 7f548f726800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.1.0 2023-12-03T11:24:19.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.454+0000 7f548f726800 1 NOTICE: finished shard 0 (4 entries removed) 2023-12-03T11:24:19.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.454+0000 7f548f726800 1 NOTICE: finished all shards (4 entries removed) 2023-12-03T11:24:19.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.454+0000 7f54517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:19.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.456+0000 7f548f726800 20 remove_watcher() i=0 2023-12-03T11:24:19.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.456+0000 7f548f726800 2 removed watcher, disabling cache 2023-12-03T11:24:19.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.458+0000 7f548f726800 20 remove_watcher() i=1 2023-12-03T11:24:19.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.459+0000 7f548f726800 20 remove_watcher() i=2 2023-12-03T11:24:19.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.460+0000 7f548f726800 20 remove_watcher() i=3 2023-12-03T11:24:19.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.461+0000 7f548f726800 20 remove_watcher() i=4 2023-12-03T11:24:19.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.462+0000 7f548f726800 20 remove_watcher() i=5 2023-12-03T11:24:19.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.463+0000 7f548f726800 20 remove_watcher() i=6 2023-12-03T11:24:19.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.464+0000 7f548f726800 20 remove_watcher() i=7 2023-12-03T11:24:19.524 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket check-bucket 2023-12-03T11:24:19.554 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:24:19.554 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:24:19.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.564+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.566+0000 7f4132925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.566+0000 7f4132925800 20 realm 2023-12-03T11:24:19.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.566+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.566+0000 7f4132925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.566+0000 7f4132925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:24:19.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.566+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.566+0000 7f4132925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.566+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.567+0000 7f4132925800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:19.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.567+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.567+0000 7f4132925800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:24:19.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.567+0000 7f4132925800 20 searching for the correct realm 2023-12-03T11:24:19.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.576+0000 7f412e6e5640 0 -- 172.21.15.131:0/2730020531 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f4128057500 msgr2=0x7f4128056200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:24:19.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.577+0000 7f4132925800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:24:19.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.577+0000 7f4132925800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:24:19.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.577+0000 7f4132925800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:24:19.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.577+0000 7f4132925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:24:19.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.577+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:24:19.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:24:19.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 20 zone default found 2023-12-03T11:24:19.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 4 Realm: () 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 20 zonegroup default 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.578+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.579+0000 7f4132925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.579+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.579+0000 7f4132925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.579+0000 7f4132925800 20 started sync module instance, tier type = 2023-12-03T11:24:19.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.579+0000 7f4132925800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:24:19.590 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.589+0000 7f412e6e5640 0 -- 172.21.15.131:0/2730020531 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f4108076c00 msgr2=0x7f4108079030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:24:19.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.603+0000 7f4132925800 20 add_watcher() i=0 2023-12-03T11:24:19.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.603+0000 7f4132925800 20 add_watcher() i=1 2023-12-03T11:24:19.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.603+0000 7f4132925800 20 add_watcher() i=2 2023-12-03T11:24:19.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.603+0000 7f4132925800 20 add_watcher() i=3 2023-12-03T11:24:19.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.603+0000 7f4132925800 20 add_watcher() i=4 2023-12-03T11:24:19.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.603+0000 7f4132925800 20 add_watcher() i=5 2023-12-03T11:24:19.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.603+0000 7f4132925800 20 add_watcher() i=6 2023-12-03T11:24:19.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.606+0000 7f4132925800 20 add_watcher() i=7 2023-12-03T11:24:19.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.606+0000 7f4132925800 2 all 8 watchers are set, enabling cache 2023-12-03T11:24:19.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.609+0000 7f40f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:19.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.609+0000 7f4132925800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:24:19.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.609+0000 7f4132925800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:24:19.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.615+0000 7f4132925800 5 note: GC not initialized 2023-12-03T11:24:19.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.615+0000 7f4062ffd640 20 reqs_thread_entry: start 2023-12-03T11:24:19.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.615+0000 7f4132925800 20 init_complete bucket index max shards: 1 2023-12-03T11:24:19.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.615+0000 7f4132925800 20 Filter name: none 2023-12-03T11:24:19.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.615+0000 7f4060ff9640 20 reqs_thread_entry: start 2023-12-03T11:24:19.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.615+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.616+0000 7f4132925800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:19.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.616+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.616+0000 7f4132925800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:19.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.616+0000 7f4132925800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:19.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.616+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.616+0000 7f4132925800 20 rados_obj.operate() r=0 bl.length=190 2023-12-03T11:24:19.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.616+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.617+0000 7f4132925800 20 rados_obj.operate() r=0 bl.length=368 2023-12-03T11:24:19.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.617+0000 7f4132925800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:24:19.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.617+0000 7f4132925800 20 rados->read ofs=0 len=0 2023-12-03T11:24:19.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.617+0000 7f4132925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:24:19.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.618+0000 7f40f3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:24:19.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.620+0000 7f4132925800 20 remove_watcher() i=0 2023-12-03T11:24:19.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.620+0000 7f4132925800 2 removed watcher, disabling cache 2023-12-03T11:24:19.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.622+0000 7f4132925800 20 remove_watcher() i=1 2023-12-03T11:24:19.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.625+0000 7f4132925800 20 remove_watcher() i=2 2023-12-03T11:24:19.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.626+0000 7f4132925800 20 remove_watcher() i=3 2023-12-03T11:24:19.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.627+0000 7f4132925800 20 remove_watcher() i=4 2023-12-03T11:24:19.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.628+0000 7f4132925800 20 remove_watcher() i=5 2023-12-03T11:24:19.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.630+0000 7f4132925800 20 remove_watcher() i=6 2023-12-03T11:24:19.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:24:19.631+0000 7f4132925800 20 remove_watcher() i=7 2023-12-03T11:24:19.637 INFO:tasks.workunit.client.0.smithi131.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2023-12-03T11:24:19.637 INFO:tasks.workunit.client.0.smithi131.stderr:Deleting bucket check-bucket 2023-12-03T11:24:19.655 INFO:tasks.workunit.client.0.smithi131.stderr:Completed bucket check tests 2023-12-03T11:24:19.656 INFO:tasks.workunit.client.0.smithi131.stdout:connected to http://localhost:80 2023-12-03T11:24:19.711 INFO:tasks.workunit.client.0.smithi131.stderr:+ deactivate 2023-12-03T11:24:19.712 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2023-12-03T11:24:19.712 INFO:tasks.workunit.client.0.smithi131.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:24:19.712 INFO:tasks.workunit.client.0.smithi131.stderr:+ export PATH 2023-12-03T11:24:19.712 INFO:tasks.workunit.client.0.smithi131.stderr:+ unset _OLD_VIRTUAL_PATH 2023-12-03T11:24:19.712 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' -n '' ']' 2023-12-03T11:24:19.712 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:24:19.712 INFO:tasks.workunit.client.0.smithi131.stderr:+ hash -r 2023-12-03T11:24:19.712 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' -n '' ']' 2023-12-03T11:24:19.712 INFO:tasks.workunit.client.0.smithi131.stderr:+ unset VIRTUAL_ENV 2023-12-03T11:24:19.712 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' '!' '' = nondestructive ']' 2023-12-03T11:24:19.712 INFO:tasks.workunit.client.0.smithi131.stderr:+ unset -f deactivate 2023-12-03T11:24:19.713 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo OK. 2023-12-03T11:24:19.713 INFO:tasks.workunit.client.0.smithi131.stdout:OK. 2023-12-03T11:24:19.714 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:24:19.714 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:24:19.779 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2023-12-03T11:24:19.780 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:24:20.106 DEBUG:teuthology.parallel:result is None 2023-12-03T11:24:20.107 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:24:20.133 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:24:20.133 DEBUG:teuthology.orchestra.run.smithi131:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:24:20.197 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:24:20.197 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:24:20.212 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:24:20.212 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:24:20.212 DEBUG:teuthology.orchestra.run.smithi131:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:24:20.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:24:20.252 INFO:teuthology.orchestra.run.smithi131.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:24:20.252 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:24:20.306 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:24:20.307 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:24:20.361 INFO:tasks.workunit:timeout=3h 2023-12-03T11:24:20.361 INFO:tasks.workunit:cleanup=True 2023-12-03T11:24:20.361 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:24:20.416 INFO:tasks.workunit.client.0.smithi131.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:25:25.122 INFO:tasks.workunit.client.0.smithi131.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:25:25.122 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:25:25.122 INFO:tasks.workunit.client.0.smithi131.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr: git switch -c 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr:Or undo this operation with: 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr: git switch - 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:25:25.123 INFO:tasks.workunit.client.0.smithi131.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:25:25.125 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:25:25.180 INFO:tasks.workunit.client.0.smithi131.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:25:25.182 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:25:25.182 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:25:25.231 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:25:25.280 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:25:25.320 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:25:25.321 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:25:25.321 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:25:25.360 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:25:25.362 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:25:25.363 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:25:25.418 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2023-12-03T11:25:25.419 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2023-12-03T11:25:25.419 DEBUG:teuthology.orchestra.run.smithi131:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2023-12-03T11:25:25.486 INFO:tasks.workunit.client.0.smithi131.stdout:Running main() from gmock_main.cc 2023-12-03T11:25:25.486 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 11 tests from 1 test suite. 2023-12-03T11:25:25.486 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:25:25.486 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 11 tests from ClsLock 2023-12-03T11:25:25.487 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] ClsLock.TestMultiLocking 2023-12-03T11:25:27.315 INFO:tasks.workunit.client.0.smithi131.stdout:lock: mylock 2023-12-03T11:25:27.315 INFO:tasks.workunit.client.0.smithi131.stdout: lock_type: exclusive 2023-12-03T11:25:27.316 INFO:tasks.workunit.client.0.smithi131.stdout: tag: 2023-12-03T11:25:27.316 INFO:tasks.workunit.client.0.smithi131.stdout: lockers: 2023-12-03T11:25:27.316 INFO:tasks.workunit.client.0.smithi131.stdout: client.5090 expiration=2023-12-03T11:27:27.311661+0000 addr=v1:172.21.15.131:0/66632037 cookie= 2023-12-03T11:25:27.319 INFO:tasks.workunit.client.0.smithi131.stdout:lock: mylock 2023-12-03T11:25:27.320 INFO:tasks.workunit.client.0.smithi131.stdout: lock_type: shared 2023-12-03T11:25:27.320 INFO:tasks.workunit.client.0.smithi131.stdout: tag: 2023-12-03T11:25:27.320 INFO:tasks.workunit.client.0.smithi131.stdout: lockers: 2023-12-03T11:25:27.320 INFO:tasks.workunit.client.0.smithi131.stdout: client.5090 expiration=2023-12-03T11:27:27.318389+0000 addr=v1:172.21.15.131:0/66632037 cookie= 2023-12-03T11:25:27.320 INFO:tasks.workunit.client.0.smithi131.stdout: client.5271 expiration=0.000000 addr=v1:172.21.15.131:0/828808493 cookie= 2023-12-03T11:25:27.321 INFO:tasks.workunit.client.0.smithi131.stdout:lock: mylock 2023-12-03T11:25:27.321 INFO:tasks.workunit.client.0.smithi131.stdout: lock_type: shared 2023-12-03T11:25:27.321 INFO:tasks.workunit.client.0.smithi131.stdout: tag: 2023-12-03T11:25:27.321 INFO:tasks.workunit.client.0.smithi131.stdout: lockers: 2023-12-03T11:25:27.321 INFO:tasks.workunit.client.0.smithi131.stdout: client.5271 expiration=0.000000 addr=v1:172.21.15.131:0/828808493 cookie= 2023-12-03T11:25:28.285 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] ClsLock.TestMultiLocking (2798 ms) 2023-12-03T11:25:28.285 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] ClsLock.TestMeta 2023-12-03T11:25:30.726 INFO:tasks.workunit.client.0.smithi131.stdout:lock: mylock 2023-12-03T11:25:30.726 INFO:tasks.workunit.client.0.smithi131.stdout: lock_type: shared 2023-12-03T11:25:30.726 INFO:tasks.workunit.client.0.smithi131.stdout: tag: 2023-12-03T11:25:30.726 INFO:tasks.workunit.client.0.smithi131.stdout: lockers: 2023-12-03T11:25:30.726 INFO:tasks.workunit.client.0.smithi131.stdout: client.5108 expiration=0.000000 addr=v1:172.21.15.131:0/808865444 cookie= 2023-12-03T11:25:30.729 INFO:tasks.workunit.client.0.smithi131.stdout:lock: mylock 2023-12-03T11:25:30.729 INFO:tasks.workunit.client.0.smithi131.stdout: lock_type: exclusive 2023-12-03T11:25:30.729 INFO:tasks.workunit.client.0.smithi131.stdout: tag: new_tag 2023-12-03T11:25:30.729 INFO:tasks.workunit.client.0.smithi131.stdout: lockers: 2023-12-03T11:25:30.729 INFO:tasks.workunit.client.0.smithi131.stdout: client.5102 expiration=0.000000 addr=v1:172.21.15.131:0/3012106408 cookie= 2023-12-03T11:25:31.305 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] ClsLock.TestMeta (3021 ms) 2023-12-03T11:25:31.305 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] ClsLock.TestCookie 2023-12-03T11:25:33.329 INFO:tasks.workunit.client.0.smithi131.stdout:lock: mylock 2023-12-03T11:25:33.329 INFO:tasks.workunit.client.0.smithi131.stdout: lock_type: exclusive 2023-12-03T11:25:33.329 INFO:tasks.workunit.client.0.smithi131.stdout: tag: 2023-12-03T11:25:33.329 INFO:tasks.workunit.client.0.smithi131.stdout: lockers: 2023-12-03T11:25:33.333 INFO:tasks.workunit.client.0.smithi131.stdout:lock: mylock 2023-12-03T11:25:33.333 INFO:tasks.workunit.client.0.smithi131.stdout: lock_type: shared 2023-12-03T11:25:33.333 INFO:tasks.workunit.client.0.smithi131.stdout: tag: 2023-12-03T11:25:33.333 INFO:tasks.workunit.client.0.smithi131.stdout: lockers: 2023-12-03T11:25:33.333 INFO:tasks.workunit.client.0.smithi131.stdout: client.5114 expiration=0.000000 addr=v1:172.21.15.131:0/2743534203 cookie= 2023-12-03T11:25:33.334 INFO:tasks.workunit.client.0.smithi131.stdout: client.5114 expiration=0.000000 addr=v1:172.21.15.131:0/2743534203 cookie=new cookie 2023-12-03T11:25:34.317 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] ClsLock.TestCookie (3012 ms) 2023-12-03T11:25:34.317 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] ClsLock.TestMultipleLocks 2023-12-03T11:25:37.345 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] ClsLock.TestMultipleLocks (3028 ms) 2023-12-03T11:25:37.345 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] ClsLock.TestLockDuration 2023-12-03T11:25:44.437 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] ClsLock.TestLockDuration (7091 ms) 2023-12-03T11:25:44.437 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] ClsLock.TestAssertLocked 2023-12-03T11:25:47.459 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] ClsLock.TestAssertLocked (3022 ms) 2023-12-03T11:25:47.459 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] ClsLock.TestSetCookie 2023-12-03T11:25:50.472 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] ClsLock.TestSetCookie (3013 ms) 2023-12-03T11:25:50.472 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] ClsLock.TestRenew 2023-12-03T11:26:11.174 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] ClsLock.TestRenew (20702 ms) 2023-12-03T11:26:11.174 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2023-12-03T11:26:18.205 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7032 ms) 2023-12-03T11:26:18.205 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2023-12-03T11:26:26.248 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8043 ms) 2023-12-03T11:26:26.249 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2023-12-03T11:26:34.291 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8043 ms) 2023-12-03T11:26:34.291 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 11 tests from ClsLock (68805 ms total) 2023-12-03T11:26:34.291 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:26:34.292 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:26:34.292 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 11 tests from 1 test suite ran. (68805 ms total) 2023-12-03T11:26:34.292 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 11 tests. 2023-12-03T11:26:34.295 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:26:34.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:26:34.365 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2023-12-03T11:26:34.367 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2023-12-03T11:26:34.367 DEBUG:teuthology.orchestra.run.smithi131:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2023-12-03T11:26:34.437 INFO:tasks.workunit.client.0.smithi131.stdout:Running main() from gmock_main.cc 2023-12-03T11:26:34.437 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 4 tests from 1 test suite. 2023-12-03T11:26:34.437 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:26:34.437 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 4 tests from cls_log 2023-12-03T11:26:34.437 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_log.test_log_add_same_time 2023-12-03T11:26:37.309 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_log.test_log_add_same_time (2872 ms) 2023-12-03T11:26:37.310 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_log.test_log_add_different_time 2023-12-03T11:26:40.345 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_log.test_log_add_different_time (3035 ms) 2023-12-03T11:26:40.345 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_log.trim_by_time 2023-12-03T11:26:43.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_log.trim_by_time (3015 ms) 2023-12-03T11:26:43.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_log.trim_by_marker 2023-12-03T11:26:46.399 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_log.trim_by_marker (3039 ms) 2023-12-03T11:26:46.399 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 4 tests from cls_log (11961 ms total) 2023-12-03T11:26:46.399 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:26:46.399 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:26:46.399 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 4 tests from 1 test suite ran. (11961 ms total) 2023-12-03T11:26:46.399 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 4 tests. 2023-12-03T11:26:46.401 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:26:46.402 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:26:46.472 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2023-12-03T11:26:46.473 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2023-12-03T11:26:46.473 DEBUG:teuthology.orchestra.run.smithi131:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2023-12-03T11:26:46.543 INFO:tasks.workunit.client.0.smithi131.stdout:Running main() from gmock_main.cc 2023-12-03T11:26:46.543 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 10 tests from 1 test suite. 2023-12-03T11:26:46.543 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:26:46.543 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 10 tests from cls_refcount 2023-12-03T11:26:46.543 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_refcount.test_implicit 2023-12-03T11:26:49.413 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_refcount.test_implicit (2870 ms) 2023-12-03T11:26:49.414 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2023-12-03T11:26:52.427 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3013 ms) 2023-12-03T11:26:52.427 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_refcount.test_put_snap 2023-12-03T11:27:01.470 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_refcount.test_put_snap (9043 ms) 2023-12-03T11:27:01.470 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_refcount.test_explicit 2023-12-03T11:27:04.494 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_refcount.test_explicit (3025 ms) 2023-12-03T11:27:04.494 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_refcount.set 2023-12-03T11:27:07.521 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_refcount.set (3026 ms) 2023-12-03T11:27:07.522 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_refcount.test_implicit_ec 2023-12-03T11:27:14.569 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_refcount.test_implicit_ec (7048 ms) 2023-12-03T11:27:14.569 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2023-12-03T11:27:21.583 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7015 ms) 2023-12-03T11:27:21.584 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2023-12-03T11:27:34.187 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_refcount.test_put_snap_ec (12604 ms) 2023-12-03T11:27:34.188 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_refcount.test_explicit_ec 2023-12-03T11:27:41.218 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_refcount.test_explicit_ec (7031 ms) 2023-12-03T11:27:41.218 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_refcount.set_ec 2023-12-03T11:27:48.233 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_refcount.set_ec (7015 ms) 2023-12-03T11:27:48.233 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 10 tests from cls_refcount (61690 ms total) 2023-12-03T11:27:48.233 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:27:48.234 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:27:48.234 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 10 tests from 1 test suite ran. (61691 ms total) 2023-12-03T11:27:48.234 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 10 tests. 2023-12-03T11:27:48.236 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:27:48.236 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:27:48.306 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2023-12-03T11:27:48.308 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2023-12-03T11:27:48.308 DEBUG:teuthology.orchestra.run.smithi131:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2023-12-03T11:27:48.378 INFO:tasks.workunit.client.0.smithi131.stdout:Running main() from gmock_main.cc 2023-12-03T11:27:48.378 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 16 tests from 1 test suite. 2023-12-03T11:27:48.378 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:27:48.378 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 16 tests from cls_rgw 2023-12-03T11:27:50.255 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.index_basic 2023-12-03T11:27:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.index_basic (40 ms) 2023-12-03T11:27:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2023-12-03T11:27:50.325 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (30 ms) 2023-12-03T11:27:50.325 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.index_remove_object 2023-12-03T11:27:50.369 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.index_remove_object (45 ms) 2023-12-03T11:27:50.370 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.index_suggest 2023-12-03T11:27:51.830 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.index_suggest (1460 ms) 2023-12-03T11:27:51.830 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.index_suggest_complete 2023-12-03T11:27:51.836 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.index_suggest_complete (6 ms) 2023-12-03T11:27:51.836 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.index_list 2023-12-03T11:27:51.858 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.index_list (22 ms) 2023-12-03T11:27:51.858 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.index_list_delimited 2023-12-03T11:28:11.032 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.index_list_delimited (19173 ms) 2023-12-03T11:28:11.032 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.bi_list 2023-12-03T11:28:11.105 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.bi_list (74 ms) 2023-12-03T11:28:11.106 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.gc_set 2023-12-03T11:28:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2023-12-03T11:28:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.gc_list 2023-12-03T11:28:11.124 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.gc_list (9 ms) 2023-12-03T11:28:11.125 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.gc_defer 2023-12-03T11:28:18.329 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.gc_defer (7204 ms) 2023-12-03T11:28:18.329 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.usage_basic 2023-12-03T11:28:18.433 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.usage_basic (105 ms) 2023-12-03T11:28:18.433 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2023-12-03T11:28:18.434 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2023-12-03T11:28:18.434 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.usage_clear 2023-12-03T11:28:18.581 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.usage_clear (147 ms) 2023-12-03T11:28:18.581 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.bi_log_trim 2023-12-03T11:28:18.622 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.bi_log_trim (40 ms) 2023-12-03T11:28:18.622 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw.index_racing_removes 2023-12-03T11:28:18.635 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw.index_racing_removes (13 ms) 2023-12-03T11:28:19.326 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 16 tests from cls_rgw (28380 ms total) 2023-12-03T11:28:19.326 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:28:19.326 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:28:19.326 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 16 tests from 1 test suite ran. (30948 ms total) 2023-12-03T11:28:19.326 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 16 tests. 2023-12-03T11:28:19.329 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:28:19.329 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:28:19.397 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2023-12-03T11:28:19.398 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2023-12-03T11:28:19.398 DEBUG:teuthology.orchestra.run.smithi131:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2023-12-03T11:28:19.467 INFO:tasks.workunit.client.0.smithi131.stdout:Running main() from gmock_main.cc 2023-12-03T11:28:19.467 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 9 tests from 1 test suite. 2023-12-03T11:28:19.467 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:28:19.467 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 9 tests from cls_rgw_gc 2023-12-03T11:28:19.467 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw_gc.init 2023-12-03T11:28:21.343 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw_gc.init (1876 ms) 2023-12-03T11:28:21.343 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2023-12-03T11:28:21.367 INFO:tasks.workunit.client.0.smithi131.stderr:[ ] list info tag = chain-0 2023-12-03T11:28:21.368 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (25 ms) 2023-12-03T11:28:21.368 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2023-12-03T11:28:21.373 INFO:tasks.workunit.client.0.smithi131.stderr:[ ] next_marker is: = 0/4263 2023-12-03T11:28:21.374 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (6 ms) 2023-12-03T11:28:21.374 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2023-12-03T11:28:21.382 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (9 ms) 2023-12-03T11:28:21.382 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2023-12-03T11:28:21.392 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (10 ms) 2023-12-03T11:28:21.392 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2023-12-03T11:28:21.737 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (345 ms) 2023-12-03T11:28:21.737 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2023-12-03T11:28:21.749 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (12 ms) 2023-12-03T11:28:21.749 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2023-12-03T11:28:21.757 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (8 ms) 2023-12-03T11:28:21.757 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw_gc.finalize 2023-12-03T11:28:22.350 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw_gc.finalize (592 ms) 2023-12-03T11:28:22.350 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 9 tests from cls_rgw_gc (2883 ms total) 2023-12-03T11:28:22.350 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:28:22.350 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:28:22.350 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 9 tests from 1 test suite ran. (2883 ms total) 2023-12-03T11:28:22.350 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 9 tests. 2023-12-03T11:28:22.352 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:28:22.353 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:28:22.425 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2023-12-03T11:28:22.426 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2023-12-03T11:28:22.426 DEBUG:teuthology.orchestra.run.smithi131:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2023-12-03T11:28:22.504 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:28:22.505 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:28:22.505 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 1 test from 1 test suite. 2023-12-03T11:28:22.505 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:28:24.358 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 1 test from cls_rgw_stats 2023-12-03T11:28:24.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] cls_rgw_stats.simulate 2023-12-03T11:28:24.377 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.376+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=CWV2Q1SJYDKH type=write size=842593 2023-12-03T11:28:24.379 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.378+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=9BAOJDH2AFGU type=del size=2918294 2023-12-03T11:28:24.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.379+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=3HGTE0I3PAGN type=del size=307755 2023-12-03T11:28:24.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.381+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=JOVJZFCKOM51 type=del size=2476586 2023-12-03T11:28:24.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.383+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~APUQ7TXM9022.0 size=1048576 2023-12-03T11:28:24.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.384+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~APUQ7TXM9022.1 size=175049 2023-12-03T11:28:24.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.384+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=APUQ7TXM9022 tag=IHD57672J4IN type=write size=2272201 2023-12-03T11:28:24.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.387+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~S9725IUMYMTT.0 size=1048576 2023-12-03T11:28:24.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.387+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~S9725IUMYMTT.1 size=1048576 2023-12-03T11:28:24.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.389+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~S9725IUMYMTT.2 size=868639 2023-12-03T11:28:24.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.389+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=S9725IUMYMTT tag=DPZ9HGBU1CW7 type=write size=4014367 2023-12-03T11:28:24.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.391+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~6GW2S2EIR5OZ.0 size=1048576 2023-12-03T11:28:24.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.392+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~6GW2S2EIR5OZ.1 size=773339 2023-12-03T11:28:24.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.392+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=6GW2S2EIR5OZ tag=AL96DFFSYZP9 type=write size=2870491 2023-12-03T11:28:24.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.393+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=C8C2HTBDKZE6 type=del size=2356852 2023-12-03T11:28:24.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.395+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=AMUNFTOWW4V4 type=del size=785253 2023-12-03T11:28:24.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.396+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=FYJEBVUDVMIA type=del size=3923150 2023-12-03T11:28:24.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.398+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~QAFOKRX5UVI4.0 size=1048576 2023-12-03T11:28:24.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.399+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~QAFOKRX5UVI4.1 size=461833 2023-12-03T11:28:24.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.399+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=QAFOKRX5UVI4 tag=CDT3NYTXQY0D type=write size=2558985 2023-12-03T11:28:24.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.401+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=XKTZCSPQJUIO type=del size=2956001 2023-12-03T11:28:24.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.402+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=W8XJDUQHEA5L type=del size=592579 2023-12-03T11:28:24.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.404+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=SK79JJ5XLUIH type=del size=300142 2023-12-03T11:28:24.406 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.405+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=PWSIZ3C60EJA type=del size=868302 2023-12-03T11:28:24.407 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.406+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=KXVO2XT8WU1M type=del size=1980510 2023-12-03T11:28:24.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.408+0000 7fe67fa49780 1 < completed write operation key=DDHGOWEI7WEI tag=CWV2Q1SJYDKH type=write size=842593 2023-12-03T11:28:24.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.409+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=CZA6CSLUZS82 type=del size=3546959 2023-12-03T11:28:24.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.412+0000 7fe67fa49780 1 < suggested remove operation key=6LQ18VAE3ZN6 tag=9BAOJDH2AFGU type=del 2023-12-03T11:28:24.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.413+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=P7OSVLX0P22M type=del size=2082420 2023-12-03T11:28:24.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.416+0000 7fe67fa49780 1 < suggested update operation key=CIB1NZHJGO46 tag=3HGTE0I3PAGN type=del size=307755 2023-12-03T11:28:24.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.419+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~8TNFI7CDWPFN.0 size=125834 2023-12-03T11:28:24.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.419+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=8TNFI7CDWPFN tag=OXK4XRUQ8J5P type=write size=1174410 2023-12-03T11:28:24.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.420+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=JOVJZFCKOM51 type=del 2023-12-03T11:28:24.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.423+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~O94AAAFJ6PZ0.0 size=1048576 2023-12-03T11:28:24.425 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.424+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~O94AAAFJ6PZ0.1 size=1048576 2023-12-03T11:28:24.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.425+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~O94AAAFJ6PZ0.2 size=114134 2023-12-03T11:28:24.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.425+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=O94AAAFJ6PZ0 tag=QR9OX49TCQME type=write size=3259862 2023-12-03T11:28:24.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.425+0000 7fe67fa49780 1 < canceled part key=_multipart_P05UIP1IU4Z7.2~APUQ7TXM9022.0 size=1048576 2023-12-03T11:28:24.427 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.426+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~APUQ7TXM9022.1 size=175049 2023-12-03T11:28:24.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.428+0000 7fe67fa49780 1 < canceled multipart upload key=P05UIP1IU4Z7 upload=APUQ7TXM9022 tag=IHD57672J4IN type=write size=2272201 2023-12-03T11:28:24.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.430+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~HGGJ4BHEVOHT.0 size=1048576 2023-12-03T11:28:24.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.431+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~HGGJ4BHEVOHT.1 size=1048576 2023-12-03T11:28:24.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.432+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~HGGJ4BHEVOHT.2 size=330989 2023-12-03T11:28:24.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.432+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=HGGJ4BHEVOHT tag=ZWM1Q9M7VEQF type=write size=3476717 2023-12-03T11:28:24.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.433+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~S9725IUMYMTT.0 size=1048576 2023-12-03T11:28:24.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.435+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~S9725IUMYMTT.1 size=1048576 2023-12-03T11:28:24.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.436+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~S9725IUMYMTT.2 size=868639 2023-12-03T11:28:24.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.438+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=S9725IUMYMTT tag=DPZ9HGBU1CW7 type=write size=4014367 2023-12-03T11:28:24.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.440+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=CA7WAXGAYQVN type=write size=2323 2023-12-03T11:28:24.442 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.441+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~6GW2S2EIR5OZ.0 size=1048576 2023-12-03T11:28:24.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.442+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~6GW2S2EIR5OZ.1 size=773339 2023-12-03T11:28:24.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.445+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=6GW2S2EIR5OZ tag=AL96DFFSYZP9 type=write size=2870491 2023-12-03T11:28:24.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.446+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=C681J02KS21Z type=write size=431661 2023-12-03T11:28:24.448 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.447+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=C8C2HTBDKZE6 type=del 2023-12-03T11:28:24.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.450+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~0IIPV24MJ60Z.0 size=1048576 2023-12-03T11:28:24.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.451+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~0IIPV24MJ60Z.1 size=223671 2023-12-03T11:28:24.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.451+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=0IIPV24MJ60Z tag=972NLI0GZZPP type=write size=2320823 2023-12-03T11:28:24.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.453+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=AMUNFTOWW4V4 type=del 2023-12-03T11:28:24.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.454+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=63HYNGA1DIVO type=write size=708473 2023-12-03T11:28:24.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.455+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=FYJEBVUDVMIA type=del 2023-12-03T11:28:24.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.456+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=F8J11O01SV4F type=del size=3358894 2023-12-03T11:28:24.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.458+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~QAFOKRX5UVI4.0 size=1048576 2023-12-03T11:28:24.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.458+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~QAFOKRX5UVI4.1 size=461833 2023-12-03T11:28:24.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.460+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=QAFOKRX5UVI4 tag=CDT3NYTXQY0D type=write size=2558985 2023-12-03T11:28:24.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.462+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~9MZJEEIAW1E8.0 size=605627 2023-12-03T11:28:24.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.462+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=9MZJEEIAW1E8 tag=K742WV8WNX0M type=write size=1654203 2023-12-03T11:28:24.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.464+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=XKTZCSPQJUIO type=del 2023-12-03T11:28:24.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.466+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~14PNL7H89JTW.0 size=1048576 2023-12-03T11:28:24.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.467+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~14PNL7H89JTW.1 size=1048576 2023-12-03T11:28:24.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.468+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~14PNL7H89JTW.2 size=342942 2023-12-03T11:28:24.470 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.468+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=14PNL7H89JTW tag=4722FC3FW54G type=write size=3488670 2023-12-03T11:28:24.472 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.471+0000 7fe67fa49780 1 < suggested update operation key=A7GOX2W0WB83 tag=W8XJDUQHEA5L type=del size=592579 2023-12-03T11:28:24.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.473+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~TFFEY2222R9I.0 size=1048576 2023-12-03T11:28:24.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.474+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~TFFEY2222R9I.1 size=138561 2023-12-03T11:28:24.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.474+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=TFFEY2222R9I tag=BXICF4UL6VUV type=write size=2235713 2023-12-03T11:28:24.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.477+0000 7fe67fa49780 1 < suggested remove operation key=V9ZVWHO8IF8L tag=SK79JJ5XLUIH type=del 2023-12-03T11:28:24.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.479+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=6WNXYZL08JH3 type=del size=1207386 2023-12-03T11:28:24.481 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.480+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=PWSIZ3C60EJA type=del 2023-12-03T11:28:24.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.481+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=B8C0B0EV2RTF type=del size=3461482 2023-12-03T11:28:24.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.482+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=KXVO2XT8WU1M type=del 2023-12-03T11:28:24.484 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.483+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=SVYK1DBPBQC4 type=write size=442059 2023-12-03T11:28:24.485 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.484+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=CZA6CSLUZS82 type=del 2023-12-03T11:28:24.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.486+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=I6T7YIWZDSM8 type=del size=2111955 2023-12-03T11:28:24.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.488+0000 7fe67fa49780 1 < suggested remove operation key=P05UIP1IU4Z7 tag=P7OSVLX0P22M type=del 2023-12-03T11:28:24.491 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.490+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~6JF8JR6SB829.0 size=611590 2023-12-03T11:28:24.491 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.490+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=6JF8JR6SB829 tag=OYZ9L31G7EQX type=write size=1660166 2023-12-03T11:28:24.492 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.491+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~8TNFI7CDWPFN.0 size=125834 2023-12-03T11:28:24.494 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.493+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=8TNFI7CDWPFN tag=OXK4XRUQ8J5P type=write size=1174410 2023-12-03T11:28:24.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.494+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=1GE4MQ9A3FOT type=del size=949858 2023-12-03T11:28:24.496 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.495+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~O94AAAFJ6PZ0.0 size=1048576 2023-12-03T11:28:24.497 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.496+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~O94AAAFJ6PZ0.1 size=1048576 2023-12-03T11:28:24.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.497+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~O94AAAFJ6PZ0.2 size=114134 2023-12-03T11:28:24.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.499+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=O94AAAFJ6PZ0 tag=QR9OX49TCQME type=write size=3259862 2023-12-03T11:28:24.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.500+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=ZG6PI4P4DEVK type=del size=1367884 2023-12-03T11:28:24.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.501+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~HGGJ4BHEVOHT.0 size=1048576 2023-12-03T11:28:24.503 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.502+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~HGGJ4BHEVOHT.1 size=1048576 2023-12-03T11:28:24.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.503+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~HGGJ4BHEVOHT.2 size=330989 2023-12-03T11:28:24.506 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.505+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=HGGJ4BHEVOHT tag=ZWM1Q9M7VEQF type=write size=3476717 2023-12-03T11:28:24.508 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.507+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=MTONMSPJ6CN3 type=del size=3643488 2023-12-03T11:28:24.509 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.509+0000 7fe67fa49780 1 < completed write operation key=9AUO0SRFTAUJ tag=CA7WAXGAYQVN type=write size=2323 2023-12-03T11:28:24.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.510+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=COZ3TR29D2UJ type=del size=636011 2023-12-03T11:28:24.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.511+0000 7fe67fa49780 1 < completed write operation key=XZHCD4R4EVZR tag=C681J02KS21Z type=write size=431661 2023-12-03T11:28:24.514 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.513+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~VO6HGG701H56.0 size=1048576 2023-12-03T11:28:24.515 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.514+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~VO6HGG701H56.1 size=86137 2023-12-03T11:28:24.515 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.514+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=VO6HGG701H56 tag=5G1GI3L173HG type=write size=2183289 2023-12-03T11:28:24.516 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.515+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~0IIPV24MJ60Z.0 size=1048576 2023-12-03T11:28:24.517 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.516+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~0IIPV24MJ60Z.1 size=223671 2023-12-03T11:28:24.519 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.518+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=0IIPV24MJ60Z tag=972NLI0GZZPP type=write size=2320823 2023-12-03T11:28:24.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.519+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=41YLJVQGRBTJ type=del size=1159385 2023-12-03T11:28:24.521 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.520+0000 7fe67fa49780 1 < completed write operation key=URVD2U16EW75 tag=63HYNGA1DIVO type=write size=708473 2023-12-03T11:28:24.523 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.522+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~DPRQHF7R6KS8.0 size=1048576 2023-12-03T11:28:24.524 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.523+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~DPRQHF7R6KS8.1 size=349806 2023-12-03T11:28:24.524 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.523+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=DPRQHF7R6KS8 tag=17FVP1I8DXQD type=write size=2446958 2023-12-03T11:28:24.525 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.524+0000 7fe67fa49780 1 < canceled operation key=0G8KNJBJ9K1Z tag=F8J11O01SV4F type=del size=3358894 2023-12-03T11:28:24.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.525+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=EGA10BXULG8I type=del size=3859482 2023-12-03T11:28:24.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.527+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~9MZJEEIAW1E8.0 size=605627 2023-12-03T11:28:24.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.528+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=9MZJEEIAW1E8 tag=K742WV8WNX0M type=write size=1654203 2023-12-03T11:28:24.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.530+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=9LPZVCPPJ0NL type=del size=1124747 2023-12-03T11:28:24.532 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.531+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~14PNL7H89JTW.0 size=1048576 2023-12-03T11:28:24.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.532+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~14PNL7H89JTW.1 size=1048576 2023-12-03T11:28:24.534 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.533+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~14PNL7H89JTW.2 size=342942 2023-12-03T11:28:24.536 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.535+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=14PNL7H89JTW tag=4722FC3FW54G type=write size=3488670 2023-12-03T11:28:24.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.536+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=1GCR2C5LNXD6 type=write size=753351 2023-12-03T11:28:24.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.537+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~TFFEY2222R9I.0 size=1048576 2023-12-03T11:28:24.539 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.538+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~TFFEY2222R9I.1 size=138561 2023-12-03T11:28:24.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.540+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=TFFEY2222R9I tag=BXICF4UL6VUV type=write size=2235713 2023-12-03T11:28:24.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.542+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=OL6EI6HZH93I type=del size=1228903 2023-12-03T11:28:24.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.543+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=6WNXYZL08JH3 type=del 2023-12-03T11:28:24.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.544+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=Q3B3PHJS0VHQ type=del size=1973004 2023-12-03T11:28:24.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.545+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=B8C0B0EV2RTF type=del 2023-12-03T11:28:24.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.547+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=77HMFLIR3JHK type=del size=3851788 2023-12-03T11:28:24.549 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.548+0000 7fe67fa49780 1 < completed write operation key=PFBGR7OF7JQG tag=SVYK1DBPBQC4 type=write size=442059 2023-12-03T11:28:24.551 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.550+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~PJX1LEB4259J.0 size=760074 2023-12-03T11:28:24.551 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.550+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=PJX1LEB4259J tag=HCSXKZ2CUM83 type=write size=1808650 2023-12-03T11:28:24.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.552+0000 7fe67fa49780 1 < suggested remove operation key=006X4CSXV0KA tag=I6T7YIWZDSM8 type=del 2023-12-03T11:28:24.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.554+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=GOMFCIEM1OZN type=del size=3888817 2023-12-03T11:28:24.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.555+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~6JF8JR6SB829.0 size=611590 2023-12-03T11:28:24.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.557+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=6JF8JR6SB829 tag=OYZ9L31G7EQX type=write size=1660166 2023-12-03T11:28:24.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.558+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=LQ43L2TTFGGJ type=del size=193413 2023-12-03T11:28:24.560 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.559+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=1GE4MQ9A3FOT type=del 2023-12-03T11:28:24.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.560+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=JISAQX95XJ8S type=write size=957711 2023-12-03T11:28:24.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.562+0000 7fe67fa49780 1 < suggested update operation key=YEMPVKMDANPG tag=ZG6PI4P4DEVK type=del size=1367884 2023-12-03T11:28:24.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.565+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~Q1O1239OI32I.0 size=1048576 2023-12-03T11:28:24.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.566+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~Q1O1239OI32I.1 size=1048576 2023-12-03T11:28:24.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.568+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~Q1O1239OI32I.2 size=148926 2023-12-03T11:28:24.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.568+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=Q1O1239OI32I tag=0D951FYR6H9N type=write size=3294654 2023-12-03T11:28:24.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.571+0000 7fe67fa49780 1 < suggested remove operation key=URVD2U16EW75 tag=MTONMSPJ6CN3 type=del 2023-12-03T11:28:24.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.572+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=R6TUFKZ1VD8M type=del size=4115812 2023-12-03T11:28:24.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.574+0000 7fe67fa49780 1 < suggested remove operation key=Q6GBIBMIJRKV tag=COZ3TR29D2UJ type=del 2023-12-03T11:28:24.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.576+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~ISJKEYZYUBHU.0 size=1048576 2023-12-03T11:28:24.578 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.577+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~ISJKEYZYUBHU.1 size=681719 2023-12-03T11:28:24.578 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.577+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=ISJKEYZYUBHU tag=KS37JMRXJ0E2 type=write size=2778871 2023-12-03T11:28:24.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.578+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~VO6HGG701H56.0 size=1048576 2023-12-03T11:28:24.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.579+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~VO6HGG701H56.1 size=86137 2023-12-03T11:28:24.582 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.581+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=VO6HGG701H56 tag=5G1GI3L173HG type=write size=2183289 2023-12-03T11:28:24.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.584+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~DK5TFQ015V8P.0 size=1048576 2023-12-03T11:28:24.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.584+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~DK5TFQ015V8P.1 size=1048576 2023-12-03T11:28:24.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.585+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~DK5TFQ015V8P.2 size=775154 2023-12-03T11:28:24.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.585+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=DK5TFQ015V8P tag=QIB9OUNJ2N5F type=write size=3920882 2023-12-03T11:28:24.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.587+0000 7fe67fa49780 -1 < failed to complete operation key=Q6GBIBMIJRKV tag=41YLJVQGRBTJ type=del size=1159385: (22) Invalid argument 2023-12-03T11:28:24.590 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.589+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~OJ736228481M.0 size=1048576 2023-12-03T11:28:24.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.590+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~OJ736228481M.1 size=1048576 2023-12-03T11:28:24.592 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.591+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~OJ736228481M.2 size=1022337 2023-12-03T11:28:24.592 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.591+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=OJ736228481M tag=F1QB3IDU53SK type=write size=4168065 2023-12-03T11:28:24.593 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.592+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~DPRQHF7R6KS8.0 size=1048576 2023-12-03T11:28:24.594 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.593+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~DPRQHF7R6KS8.1 size=349806 2023-12-03T11:28:24.596 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.595+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=DPRQHF7R6KS8 tag=17FVP1I8DXQD type=write size=2446958 2023-12-03T11:28:24.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.596+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=IP59FL26O501 type=del size=507803 2023-12-03T11:28:24.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.597+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=EGA10BXULG8I type=del 2023-12-03T11:28:24.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.599+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=VAEJW2QW0FYX type=write size=699472 2023-12-03T11:28:24.601 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.600+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=9LPZVCPPJ0NL type=del 2023-12-03T11:28:24.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.601+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=QG32T39HGG5I type=del size=1699346 2023-12-03T11:28:24.604 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.603+0000 7fe67fa49780 1 < suggested update operation key=N87KA638VE01 tag=1GCR2C5LNXD6 type=write size=753351 2023-12-03T11:28:24.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.604+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=SKIA4WS7FD8J type=del size=1031368 2023-12-03T11:28:24.606 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.605+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=OL6EI6HZH93I type=del 2023-12-03T11:28:24.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.607+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=LRPO0HBGXR5Z type=del size=3446028 2023-12-03T11:28:24.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.608+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=Q3B3PHJS0VHQ type=del 2023-12-03T11:28:24.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.610+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~HNTA9LCVS282.0 size=555678 2023-12-03T11:28:24.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.610+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=HNTA9LCVS282 tag=ECLCTQB26F90 type=write size=1604254 2023-12-03T11:28:24.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.611+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=77HMFLIR3JHK type=del 2023-12-03T11:28:24.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.613+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~Y0OWGJ6WYCUG.0 size=1048576 2023-12-03T11:28:24.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.614+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~Y0OWGJ6WYCUG.1 size=328864 2023-12-03T11:28:24.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.614+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=Y0OWGJ6WYCUG tag=D5G04Y4ULA42 type=write size=2426016 2023-12-03T11:28:24.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.615+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~PJX1LEB4259J.0 size=760074 2023-12-03T11:28:24.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.617+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=PJX1LEB4259J tag=HCSXKZ2CUM83 type=write size=1808650 2023-12-03T11:28:24.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.620+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~W6WBMCK8RESR.0 size=620145 2023-12-03T11:28:24.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.620+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=W6WBMCK8RESR tag=4HFDX3XQX87R type=write size=1668721 2023-12-03T11:28:24.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.622+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=GOMFCIEM1OZN type=del 2023-12-03T11:28:24.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.623+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=L9HQVTZMXWBB type=del size=2839005 2023-12-03T11:28:24.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.624+0000 7fe67fa49780 -1 < failed to complete operation key=URVD2U16EW75 tag=LQ43L2TTFGGJ type=del size=193413: (22) Invalid argument 2023-12-03T11:28:24.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.625+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=9E5MHJRGR0RX type=del size=644189 2023-12-03T11:28:24.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.628+0000 7fe67fa49780 1 < suggested remove operation key=983BDZLASC3S tag=JISAQX95XJ8S type=write 2023-12-03T11:28:24.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.629+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=NB04TY2M8TOQ type=del size=440289 2023-12-03T11:28:24.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.630+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~Q1O1239OI32I.0 size=1048576 2023-12-03T11:28:24.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.631+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~Q1O1239OI32I.1 size=1048576 2023-12-03T11:28:24.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.631+0000 7fe67fa49780 1 < canceled part key=_multipart_Y0VRZR6S8FP6.2~Q1O1239OI32I.2 size=148926 2023-12-03T11:28:24.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.633+0000 7fe67fa49780 1 < canceled multipart upload key=Y0VRZR6S8FP6 upload=Q1O1239OI32I tag=0D951FYR6H9N type=write size=3294654 2023-12-03T11:28:24.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.634+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=XAVP6OATM4G4 type=del size=1422298 2023-12-03T11:28:24.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.637+0000 7fe67fa49780 1 < suggested update operation key=KMC5YD2M3I45 tag=R6TUFKZ1VD8M type=del size=4115812 2023-12-03T11:28:24.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.638+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=IXCST3HWKMZ2 type=del size=1025453 2023-12-03T11:28:24.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.639+0000 7fe67fa49780 1 < canceled part key=_multipart_P05UIP1IU4Z7.2~ISJKEYZYUBHU.0 size=1048576 2023-12-03T11:28:24.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.640+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~ISJKEYZYUBHU.1 size=681719 2023-12-03T11:28:24.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.642+0000 7fe67fa49780 1 < canceled multipart upload key=P05UIP1IU4Z7 upload=ISJKEYZYUBHU tag=KS37JMRXJ0E2 type=write size=2778871 2023-12-03T11:28:24.644 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.643+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=R3LL9JSQGTKT type=write size=704517 2023-12-03T11:28:24.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.644+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~DK5TFQ015V8P.0 size=1048576 2023-12-03T11:28:24.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.644+0000 7fe67fa49780 1 < canceled part key=_multipart_A7GOX2W0WB83.2~DK5TFQ015V8P.1 size=1048576 2023-12-03T11:28:24.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.645+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~DK5TFQ015V8P.2 size=775154 2023-12-03T11:28:24.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.647+0000 7fe67fa49780 1 < canceled multipart upload key=A7GOX2W0WB83 upload=DK5TFQ015V8P tag=QIB9OUNJ2N5F type=write size=3920882 2023-12-03T11:28:24.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.650+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~FPRQPM6LBDTV.0 size=1048576 2023-12-03T11:28:24.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.651+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~FPRQPM6LBDTV.1 size=909922 2023-12-03T11:28:24.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.651+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=FPRQPM6LBDTV tag=BWSD3D79WH6H type=write size=3007074 2023-12-03T11:28:24.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.652+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~OJ736228481M.0 size=1048576 2023-12-03T11:28:24.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.653+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~OJ736228481M.1 size=1048576 2023-12-03T11:28:24.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.654+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~OJ736228481M.2 size=1022337 2023-12-03T11:28:24.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.656+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=OJ736228481M tag=F1QB3IDU53SK type=write size=4168065 2023-12-03T11:28:24.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.658+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~YS54RZ6TXFQS.0 size=333478 2023-12-03T11:28:24.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.658+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=YS54RZ6TXFQS tag=D7FXX4WBPI0B type=write size=1382054 2023-12-03T11:28:24.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.661+0000 7fe67fa49780 1 < suggested remove operation key=SIES92K9QVJV tag=IP59FL26O501 type=del 2023-12-03T11:28:24.663 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.662+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=LC3ENUUEKLFX type=write size=80272 2023-12-03T11:28:24.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.663+0000 7fe67fa49780 1 < canceled operation key=CC1X1OP7L6BJ tag=VAEJW2QW0FYX type=write size=699472 2023-12-03T11:28:24.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.664+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=J6926NJH7TBG type=del size=2972062 2023-12-03T11:28:24.666 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.665+0000 7fe67fa49780 -1 < failed to complete operation key=N87KA638VE01 tag=QG32T39HGG5I type=del size=1699346: (22) Invalid argument 2023-12-03T11:28:24.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.667+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=DE8Z74ODJO7P type=del size=815012 2023-12-03T11:28:24.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.668+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=SKIA4WS7FD8J type=del 2023-12-03T11:28:24.671 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.670+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~0OL6UWA144GA.0 size=1048576 2023-12-03T11:28:24.672 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.671+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~0OL6UWA144GA.1 size=1009135 2023-12-03T11:28:24.672 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.671+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=0OL6UWA144GA tag=YH89XIDTGFSZ type=write size=3106287 2023-12-03T11:28:24.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.672+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=LRPO0HBGXR5Z type=del 2023-12-03T11:28:24.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.674+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=X7S80TKFMFO3 type=del size=1431087 2023-12-03T11:28:24.676 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.675+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~HNTA9LCVS282.0 size=555678 2023-12-03T11:28:24.678 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.677+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=HNTA9LCVS282 tag=ECLCTQB26F90 type=write size=1604254 2023-12-03T11:28:24.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.679+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~9YWBGTJHQ0CM.0 size=1048576 2023-12-03T11:28:24.681 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.680+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~9YWBGTJHQ0CM.1 size=975905 2023-12-03T11:28:24.681 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.680+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=9YWBGTJHQ0CM tag=UK4S78UOC1C3 type=write size=3073057 2023-12-03T11:28:24.682 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.681+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~Y0OWGJ6WYCUG.0 size=1048576 2023-12-03T11:28:24.683 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.682+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~Y0OWGJ6WYCUG.1 size=328864 2023-12-03T11:28:24.685 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.684+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=Y0OWGJ6WYCUG tag=D5G04Y4ULA42 type=write size=2426016 2023-12-03T11:28:24.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.685+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=XJ72Z0R368CR type=del size=1871550 2023-12-03T11:28:24.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.686+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~W6WBMCK8RESR.0 size=620145 2023-12-03T11:28:24.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.688+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=W6WBMCK8RESR tag=4HFDX3XQX87R type=write size=1668721 2023-12-03T11:28:24.690 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.689+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=BTCNWU822BHH type=write size=314977 2023-12-03T11:28:24.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.691+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=L9HQVTZMXWBB type=del 2023-12-03T11:28:24.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.692+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=81X6SIHNTZ28 type=del size=1859660 2023-12-03T11:28:24.695 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.694+0000 7fe67fa49780 1 < suggested remove operation key=A7GOX2W0WB83 tag=9E5MHJRGR0RX type=del 2023-12-03T11:28:24.697 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.696+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~OC3M8UWAGYRA.0 size=1048576 2023-12-03T11:28:24.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.697+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~OC3M8UWAGYRA.1 size=1048576 2023-12-03T11:28:24.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.698+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~OC3M8UWAGYRA.2 size=430781 2023-12-03T11:28:24.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.698+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=OC3M8UWAGYRA tag=7ONKL4N7ML44 type=write size=3576509 2023-12-03T11:28:24.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.699+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=NB04TY2M8TOQ type=del 2023-12-03T11:28:24.702 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.701+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~HVI85Z8A7U4Q.0 size=1048576 2023-12-03T11:28:24.703 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.702+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~HVI85Z8A7U4Q.1 size=1048576 2023-12-03T11:28:24.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.703+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~HVI85Z8A7U4Q.2 size=357349 2023-12-03T11:28:24.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.703+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=HVI85Z8A7U4Q tag=547GYYLUDIOT type=write size=3503077 2023-12-03T11:28:24.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.704+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=XAVP6OATM4G4 type=del 2023-12-03T11:28:24.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.706+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~8W7SSSMKPZPU.0 size=1048576 2023-12-03T11:28:24.708 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.707+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~8W7SSSMKPZPU.1 size=671272 2023-12-03T11:28:24.708 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.707+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=8W7SSSMKPZPU tag=V821JJS8383J type=write size=2768424 2023-12-03T11:28:24.709 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.708+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=IXCST3HWKMZ2 type=del 2023-12-03T11:28:24.710 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.709+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=LXIWTC2EL48Z type=del size=3238349 2023-12-03T11:28:24.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.710+0000 7fe67fa49780 1 < canceled operation key=IIW1Y6QYEODQ tag=R3LL9JSQGTKT type=write size=704517 2023-12-03T11:28:24.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.711+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=1ZCPCBD5ZC98 type=del size=1264823 2023-12-03T11:28:24.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.712+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~FPRQPM6LBDTV.0 size=1048576 2023-12-03T11:28:24.714 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.713+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~FPRQPM6LBDTV.1 size=909922 2023-12-03T11:28:24.716 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.715+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=FPRQPM6LBDTV tag=BWSD3D79WH6H type=write size=3007074 2023-12-03T11:28:24.718 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.717+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~DL47KMLANYW9.0 size=1048576 2023-12-03T11:28:24.719 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.718+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~DL47KMLANYW9.1 size=572714 2023-12-03T11:28:24.719 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.718+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=DL47KMLANYW9 tag=1VK6QZHYJF3Z type=write size=2669866 2023-12-03T11:28:24.720 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.719+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~YS54RZ6TXFQS.0 size=333478 2023-12-03T11:28:24.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.721+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=YS54RZ6TXFQS tag=D7FXX4WBPI0B type=write size=1382054 2023-12-03T11:28:24.723 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.722+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=XGJXMG8N0AZ2 type=del size=2759247 2023-12-03T11:28:24.724 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.723+0000 7fe67fa49780 1 < completed write operation key=ASODFGLQ5VNY tag=LC3ENUUEKLFX type=write size=80272 2023-12-03T11:28:24.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.725+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=KRZB5DY05CSS type=del size=1073454 2023-12-03T11:28:24.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.726+0000 7fe67fa49780 1 < canceled operation key=9OD4G28SDLB4 tag=J6926NJH7TBG type=del size=2972062 2023-12-03T11:28:24.729 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.728+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~XCLLKAK2BLES.0 size=250164 2023-12-03T11:28:24.729 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.728+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=XCLLKAK2BLES tag=CGHUNZOLNEKI type=write size=1298740 2023-12-03T11:28:24.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.730+0000 7fe67fa49780 1 < canceled operation key=0G8KNJBJ9K1Z tag=DE8Z74ODJO7P type=del size=815012 2023-12-03T11:28:24.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.731+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=E1Y3OGK6BB69 type=write size=234901 2023-12-03T11:28:24.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.732+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~0OL6UWA144GA.0 size=1048576 2023-12-03T11:28:24.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.733+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~0OL6UWA144GA.1 size=1009135 2023-12-03T11:28:24.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.735+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=0OL6UWA144GA tag=YH89XIDTGFSZ type=write size=3106287 2023-12-03T11:28:24.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.736+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=J33H6C1PK6UH type=write size=98277 2023-12-03T11:28:24.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.737+0000 7fe67fa49780 1 < canceled operation key=OH2XUEEYL9JO tag=X7S80TKFMFO3 type=del size=1431087 2023-12-03T11:28:24.739 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.738+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=B4OZ4RRXHNE5 type=del size=1479071 2023-12-03T11:28:24.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.740+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~9YWBGTJHQ0CM.0 size=1048576 2023-12-03T11:28:24.742 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.741+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~9YWBGTJHQ0CM.1 size=975905 2023-12-03T11:28:24.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.743+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=9YWBGTJHQ0CM tag=UK4S78UOC1C3 type=write size=3073057 2023-12-03T11:28:24.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.744+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=HSDCC9SVTES1 type=del size=3931207 2023-12-03T11:28:24.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.745+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=XJ72Z0R368CR type=del 2023-12-03T11:28:24.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.746+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=TMJQU89GO7Q5 type=del size=1034218 2023-12-03T11:28:24.750 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.749+0000 7fe67fa49780 1 < suggested update operation key=URVD2U16EW75 tag=BTCNWU822BHH type=write size=314977 2023-12-03T11:28:24.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.751+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~89TMG0B9HEPR.0 size=876845 2023-12-03T11:28:24.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.751+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=89TMG0B9HEPR tag=UOO9I0SOOMC5 type=write size=1925421 2023-12-03T11:28:24.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.754+0000 7fe67fa49780 1 < suggested remove operation key=CC1X1OP7L6BJ tag=81X6SIHNTZ28 type=del 2023-12-03T11:28:24.757 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.756+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~DYLBWNT30QW1.0 size=863667 2023-12-03T11:28:24.757 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.756+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=DYLBWNT30QW1 tag=P8HSPDLCZK86 type=write size=1912243 2023-12-03T11:28:24.758 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.757+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~OC3M8UWAGYRA.0 size=1048576 2023-12-03T11:28:24.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.758+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~OC3M8UWAGYRA.1 size=1048576 2023-12-03T11:28:24.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.759+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~OC3M8UWAGYRA.2 size=430781 2023-12-03T11:28:24.762 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.761+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=OC3M8UWAGYRA tag=7ONKL4N7ML44 type=write size=3576509 2023-12-03T11:28:24.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.763+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~5NDKWRUNQK6M.0 size=1048576 2023-12-03T11:28:24.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.764+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~5NDKWRUNQK6M.1 size=371864 2023-12-03T11:28:24.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.764+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=5NDKWRUNQK6M tag=BQZQDX24YVA5 type=write size=2469016 2023-12-03T11:28:24.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.765+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~HVI85Z8A7U4Q.0 size=1048576 2023-12-03T11:28:24.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.767+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~HVI85Z8A7U4Q.1 size=1048576 2023-12-03T11:28:24.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.767+0000 7fe67fa49780 1 < canceled part key=_multipart_N87KA638VE01.2~HVI85Z8A7U4Q.2 size=357349 2023-12-03T11:28:24.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.769+0000 7fe67fa49780 1 < canceled multipart upload key=N87KA638VE01 upload=HVI85Z8A7U4Q tag=547GYYLUDIOT type=write size=3503077 2023-12-03T11:28:24.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.771+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~COZ3ZONYY1V8.0 size=1005092 2023-12-03T11:28:24.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.771+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=COZ3ZONYY1V8 tag=N01IOB7W6H0N type=write size=2053668 2023-12-03T11:28:24.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.773+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~8W7SSSMKPZPU.0 size=1048576 2023-12-03T11:28:24.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.773+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~8W7SSSMKPZPU.1 size=671272 2023-12-03T11:28:24.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.775+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=8W7SSSMKPZPU tag=V821JJS8383J type=write size=2768424 2023-12-03T11:28:24.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.777+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~EQXFSIQ750HX.0 size=1048576 2023-12-03T11:28:24.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.778+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~EQXFSIQ750HX.1 size=711871 2023-12-03T11:28:24.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.778+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=EQXFSIQ750HX tag=78IC9J4KNYE7 type=write size=2809023 2023-12-03T11:28:24.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.779+0000 7fe67fa49780 1 < canceled operation key=XZHCD4R4EVZR tag=LXIWTC2EL48Z type=del size=3238349 2023-12-03T11:28:24.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.781+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=20GID1OCUPPS type=write size=543865 2023-12-03T11:28:24.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.782+0000 7fe67fa49780 1 < canceled operation key=UL24DVOA31Y7 tag=1ZCPCBD5ZC98 type=del size=1264823 2023-12-03T11:28:24.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.783+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=135VUM1LACS3 type=del size=3817147 2023-12-03T11:28:24.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.784+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~DL47KMLANYW9.0 size=1048576 2023-12-03T11:28:24.786 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.785+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~DL47KMLANYW9.1 size=572714 2023-12-03T11:28:24.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.787+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=DL47KMLANYW9 tag=1VK6QZHYJF3Z type=write size=2669866 2023-12-03T11:28:24.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.788+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=39SAWZLTSIC9 type=del size=1837588 2023-12-03T11:28:24.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.789+0000 7fe67fa49780 1 < canceled operation key=A7GOX2W0WB83 tag=XGJXMG8N0AZ2 type=del size=2759247 2023-12-03T11:28:24.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.790+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=6PDXAEF4D8GH type=del size=2681459 2023-12-03T11:28:24.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.792+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=KRZB5DY05CSS type=del 2023-12-03T11:28:24.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.793+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=Q5FEGLTJ5GXS type=del size=980993 2023-12-03T11:28:24.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.794+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~XCLLKAK2BLES.0 size=250164 2023-12-03T11:28:24.797 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.796+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=XCLLKAK2BLES tag=CGHUNZOLNEKI type=write size=1298740 2023-12-03T11:28:24.798 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.797+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=12ZSMBTCRVKT type=del size=19777 2023-12-03T11:28:24.799 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.798+0000 7fe67fa49780 1 < canceled operation key=CIB1NZHJGO46 tag=E1Y3OGK6BB69 type=write size=234901 2023-12-03T11:28:24.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.800+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~QVCBB04EH4XF.0 size=1048576 2023-12-03T11:28:24.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.801+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~QVCBB04EH4XF.1 size=428970 2023-12-03T11:28:24.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.801+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=QVCBB04EH4XF tag=IOZ2VJ0OLNXL type=write size=2526122 2023-12-03T11:28:24.803 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.802+0000 7fe67fa49780 1 < completed write operation key=TXVHRE03Z3DA tag=J33H6C1PK6UH type=write size=98277 2023-12-03T11:28:24.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.804+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=ILAIHS7FMEGR type=del size=1191433 2023-12-03T11:28:24.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.805+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=B4OZ4RRXHNE5 type=del 2023-12-03T11:28:24.807 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.806+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=2PN827K4XU14 type=del size=3639365 2023-12-03T11:28:24.808 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.807+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=HSDCC9SVTES1 type=del 2023-12-03T11:28:24.811 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.810+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~JIHJYWEZVG85.0 size=1048576 2023-12-03T11:28:24.811 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.811+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~JIHJYWEZVG85.1 size=340370 2023-12-03T11:28:24.812 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.811+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=JIHJYWEZVG85 tag=YQ4AE58LG0S7 type=write size=2437522 2023-12-03T11:28:24.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.812+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=TMJQU89GO7Q5 type=del 2023-12-03T11:28:24.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.813+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=NF1HIJSJVY2C type=del size=1507265 2023-12-03T11:28:24.815 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.814+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~89TMG0B9HEPR.0 size=876845 2023-12-03T11:28:24.817 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.816+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=89TMG0B9HEPR tag=UOO9I0SOOMC5 type=write size=1925421 2023-12-03T11:28:24.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.818+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~AI6XYGCEPEAG.0 size=1048576 2023-12-03T11:28:24.822 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.819+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~AI6XYGCEPEAG.1 size=1048576 2023-12-03T11:28:24.822 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.820+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~AI6XYGCEPEAG.2 size=756301 2023-12-03T11:28:24.822 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.820+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=AI6XYGCEPEAG tag=EJD2847J5PEM type=write size=3902029 2023-12-03T11:28:24.822 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.821+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~DYLBWNT30QW1.0 size=863667 2023-12-03T11:28:24.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.823+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=DYLBWNT30QW1 tag=P8HSPDLCZK86 type=write size=1912243 2023-12-03T11:28:24.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.825+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~LPF0OH8JXKZC.0 size=336035 2023-12-03T11:28:24.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.825+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=LPF0OH8JXKZC tag=Q5TM6E6YLJ02 type=write size=1384611 2023-12-03T11:28:24.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.826+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~5NDKWRUNQK6M.0 size=1048576 2023-12-03T11:28:24.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.827+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~5NDKWRUNQK6M.1 size=371864 2023-12-03T11:28:24.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.829+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=5NDKWRUNQK6M tag=BQZQDX24YVA5 type=write size=2469016 2023-12-03T11:28:24.831 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.831+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~9SNJDYAWFSQB.0 size=1048576 2023-12-03T11:28:24.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.831+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~9SNJDYAWFSQB.1 size=156274 2023-12-03T11:28:24.833 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.831+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=9SNJDYAWFSQB tag=97DNL2EZPA48 type=write size=2253426 2023-12-03T11:28:24.833 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.832+0000 7fe67fa49780 1 < canceled part key=_multipart_983BDZLASC3S.2~COZ3ZONYY1V8.0 size=1005092 2023-12-03T11:28:24.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.833+0000 7fe67fa49780 1 < canceled multipart upload key=983BDZLASC3S upload=COZ3ZONYY1V8 tag=N01IOB7W6H0N type=write size=2053668 2023-12-03T11:28:24.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.835+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=HZVKUSDA2PSD type=del size=3953438 2023-12-03T11:28:24.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.836+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~EQXFSIQ750HX.0 size=1048576 2023-12-03T11:28:24.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.837+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~EQXFSIQ750HX.1 size=711871 2023-12-03T11:28:24.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.839+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=EQXFSIQ750HX tag=78IC9J4KNYE7 type=write size=2809023 2023-12-03T11:28:24.841 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.840+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=RX6JGXZLX2BJ type=del size=3697101 2023-12-03T11:28:24.843 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.842+0000 7fe67fa49780 1 < completed write operation key=006X4CSXV0KA tag=20GID1OCUPPS type=write size=543865 2023-12-03T11:28:24.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.844+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~OD0SFV3PDUWW.0 size=377981 2023-12-03T11:28:24.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.844+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=OD0SFV3PDUWW tag=V5OBENSFXF6E type=write size=1426557 2023-12-03T11:28:24.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.846+0000 7fe67fa49780 1 < suggested update operation key=TXVHRE03Z3DA tag=135VUM1LACS3 type=del size=3817147 2023-12-03T11:28:24.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.847+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=VQWOVE5O10KV type=del size=1925396 2023-12-03T11:28:24.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.850+0000 7fe67fa49780 1 < suggested update operation key=SIES92K9QVJV tag=39SAWZLTSIC9 type=del size=1837588 2023-12-03T11:28:24.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.851+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=XXCX2P2AHCI8 type=del size=808786 2023-12-03T11:28:24.853 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.852+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=6PDXAEF4D8GH type=del 2023-12-03T11:28:24.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.853+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=UXSOEP3UKHFM type=del size=810412 2023-12-03T11:28:24.855 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.854+0000 7fe67fa49780 -1 < failed to complete operation key=TXVHRE03Z3DA tag=Q5FEGLTJ5GXS type=del size=980993: (22) Invalid argument 2023-12-03T11:28:24.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.855+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=CZUFQ98O0JC7 type=del size=2848286 2023-12-03T11:28:24.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.857+0000 7fe67fa49780 1 < canceled operation key=006X4CSXV0KA tag=12ZSMBTCRVKT type=del size=19777 2023-12-03T11:28:24.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.859+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~CPECT85UBVHI.0 size=237509 2023-12-03T11:28:24.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.859+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=CPECT85UBVHI tag=DLGFPP0K0OCZ type=write size=1286085 2023-12-03T11:28:24.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.860+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~QVCBB04EH4XF.0 size=1048576 2023-12-03T11:28:24.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.861+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~QVCBB04EH4XF.1 size=428970 2023-12-03T11:28:24.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.863+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=QVCBB04EH4XF tag=IOZ2VJ0OLNXL type=write size=2526122 2023-12-03T11:28:24.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.864+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=HOPHDB1YW4BN type=del size=3324451 2023-12-03T11:28:24.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.865+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=ILAIHS7FMEGR type=del 2023-12-03T11:28:24.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.867+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~UA5D6LXFPJGY.0 size=1048576 2023-12-03T11:28:24.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.868+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~UA5D6LXFPJGY.1 size=338536 2023-12-03T11:28:24.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.868+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=UA5D6LXFPJGY tag=BCEQNVIUTF39 type=write size=2435688 2023-12-03T11:28:24.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.869+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=2PN827K4XU14 type=del 2023-12-03T11:28:24.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.871+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~XOC7KPM1WSIH.0 size=1048576 2023-12-03T11:28:24.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.873+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~XOC7KPM1WSIH.1 size=1048576 2023-12-03T11:28:24.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.874+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~XOC7KPM1WSIH.2 size=470313 2023-12-03T11:28:24.875 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.874+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=XOC7KPM1WSIH tag=W8IK1VGJ9Z0B type=write size=3616041 2023-12-03T11:28:24.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.875+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~JIHJYWEZVG85.0 size=1048576 2023-12-03T11:28:24.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.876+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~JIHJYWEZVG85.1 size=340370 2023-12-03T11:28:24.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.877+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=JIHJYWEZVG85 tag=YQ4AE58LG0S7 type=write size=2437522 2023-12-03T11:28:24.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.879+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=R8DLO0T1U3B4 type=del size=1057893 2023-12-03T11:28:24.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.880+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=NF1HIJSJVY2C type=del 2023-12-03T11:28:24.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.881+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=94P3WZ8NEQDY type=del size=3962321 2023-12-03T11:28:24.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.882+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~AI6XYGCEPEAG.0 size=1048576 2023-12-03T11:28:24.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.883+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~AI6XYGCEPEAG.1 size=1048576 2023-12-03T11:28:24.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.884+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~AI6XYGCEPEAG.2 size=756301 2023-12-03T11:28:24.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.886+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=AI6XYGCEPEAG tag=EJD2847J5PEM type=write size=3902029 2023-12-03T11:28:24.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.888+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~TRSW2MB1KRAI.0 size=1048576 2023-12-03T11:28:24.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.889+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~TRSW2MB1KRAI.1 size=1048576 2023-12-03T11:28:24.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.890+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~TRSW2MB1KRAI.2 size=1017736 2023-12-03T11:28:24.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.890+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=TRSW2MB1KRAI tag=QULCXZOI3KZI type=write size=4163464 2023-12-03T11:28:24.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.891+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~LPF0OH8JXKZC.0 size=336035 2023-12-03T11:28:24.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.893+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=LPF0OH8JXKZC tag=Q5TM6E6YLJ02 type=write size=1384611 2023-12-03T11:28:24.896 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.895+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=6NVPH0SZ68PU type=del size=3906929 2023-12-03T11:28:24.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.896+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~9SNJDYAWFSQB.0 size=1048576 2023-12-03T11:28:24.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.896+0000 7fe67fa49780 1 < canceled part key=_multipart_SXVBDBJ5B09V.2~9SNJDYAWFSQB.1 size=156274 2023-12-03T11:28:24.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.898+0000 7fe67fa49780 1 < canceled multipart upload key=SXVBDBJ5B09V upload=9SNJDYAWFSQB tag=97DNL2EZPA48 type=write size=2253426 2023-12-03T11:28:24.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.899+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=X2XFQO0P7L4T type=del size=4184088 2023-12-03T11:28:24.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.900+0000 7fe67fa49780 -1 < failed to complete operation key=SIES92K9QVJV tag=HZVKUSDA2PSD type=del size=3953438: (22) Invalid argument 2023-12-03T11:28:24.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.903+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~R3POY2QVOV20.0 size=1048576 2023-12-03T11:28:24.904 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.904+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~R3POY2QVOV20.1 size=872425 2023-12-03T11:28:24.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.904+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=R3POY2QVOV20 tag=LRIGHG864MXG type=write size=2969577 2023-12-03T11:28:24.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.906+0000 7fe67fa49780 1 < suggested update operation key=XZHCD4R4EVZR tag=RX6JGXZLX2BJ type=del size=3697101 2023-12-03T11:28:24.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.908+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~Q6CA6RT17P2T.0 size=1048576 2023-12-03T11:28:24.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.909+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~Q6CA6RT17P2T.1 size=905966 2023-12-03T11:28:24.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.909+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=Q6CA6RT17P2T tag=Q3TCBTR49XVN type=write size=3003118 2023-12-03T11:28:24.911 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.910+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~OD0SFV3PDUWW.0 size=377981 2023-12-03T11:28:24.913 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.912+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=OD0SFV3PDUWW tag=V5OBENSFXF6E type=write size=1426557 2023-12-03T11:28:24.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.913+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=TP8RO26GA2ZQ type=del size=2990205 2023-12-03T11:28:24.916 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.915+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=VQWOVE5O10KV type=del 2023-12-03T11:28:24.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.917+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~RV1HEZIENJDD.0 size=1048576 2023-12-03T11:28:24.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.918+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~RV1HEZIENJDD.1 size=1048576 2023-12-03T11:28:24.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.919+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~RV1HEZIENJDD.2 size=503390 2023-12-03T11:28:24.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.919+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=RV1HEZIENJDD tag=REFUEZ7YPGV9 type=write size=3649118 2023-12-03T11:28:24.921 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.920+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=XXCX2P2AHCI8 type=del 2023-12-03T11:28:24.922 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.921+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=GOCYVPA9MP03 type=del size=2123615 2023-12-03T11:28:24.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.922+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=UXSOEP3UKHFM type=del 2023-12-03T11:28:24.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.924+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~CUILS9JQ2V4J.0 size=1048576 2023-12-03T11:28:24.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.925+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~CUILS9JQ2V4J.1 size=724522 2023-12-03T11:28:24.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.925+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=CUILS9JQ2V4J tag=QQZRQ3XK67WI type=write size=2821674 2023-12-03T11:28:24.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.927+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=CZUFQ98O0JC7 type=del 2023-12-03T11:28:24.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.928+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=W1H4J6WQK4PR type=del size=147443 2023-12-03T11:28:24.930 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.929+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~CPECT85UBVHI.0 size=237509 2023-12-03T11:28:24.932 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.931+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=CPECT85UBVHI tag=DLGFPP0K0OCZ type=write size=1286085 2023-12-03T11:28:24.934 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.933+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=U51LNCDGF9XR type=del size=4119634 2023-12-03T11:28:24.935 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.934+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=HOPHDB1YW4BN type=del 2023-12-03T11:28:24.936 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.935+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=91NWAZ5OUATN type=del size=2467047 2023-12-03T11:28:24.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.937+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~UA5D6LXFPJGY.0 size=1048576 2023-12-03T11:28:24.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.937+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~UA5D6LXFPJGY.1 size=338536 2023-12-03T11:28:24.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.939+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=UA5D6LXFPJGY tag=BCEQNVIUTF39 type=write size=2435688 2023-12-03T11:28:24.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.941+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~6EOJY8X2OY8P.0 size=1048576 2023-12-03T11:28:24.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.942+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~6EOJY8X2OY8P.1 size=1048576 2023-12-03T11:28:24.944 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.943+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~6EOJY8X2OY8P.2 size=517907 2023-12-03T11:28:24.944 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.943+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=6EOJY8X2OY8P tag=T8802EU4AC6V type=write size=3663635 2023-12-03T11:28:24.945 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.945+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~XOC7KPM1WSIH.0 size=1048576 2023-12-03T11:28:24.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.945+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~XOC7KPM1WSIH.1 size=1048576 2023-12-03T11:28:24.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.946+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~XOC7KPM1WSIH.2 size=470313 2023-12-03T11:28:24.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.949+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=XOC7KPM1WSIH tag=W8IK1VGJ9Z0B type=write size=3616041 2023-12-03T11:28:24.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.950+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=0PGQ92CD1FJK type=del size=3379879 2023-12-03T11:28:24.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.951+0000 7fe67fa49780 1 < canceled operation key=SIES92K9QVJV tag=R8DLO0T1U3B4 type=del size=1057893 2023-12-03T11:28:24.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.953+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=8XENKTWKYIN2 type=del size=2076637 2023-12-03T11:28:24.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.954+0000 7fe67fa49780 1 < canceled operation key=0G8KNJBJ9K1Z tag=94P3WZ8NEQDY type=del size=3962321 2023-12-03T11:28:24.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.955+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=1R0XQ8YGPBXG type=del size=79448 2023-12-03T11:28:24.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.956+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~TRSW2MB1KRAI.0 size=1048576 2023-12-03T11:28:24.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.956+0000 7fe67fa49780 1 < canceled part key=_multipart_H8MBLWXG7BCZ.2~TRSW2MB1KRAI.1 size=1048576 2023-12-03T11:28:24.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.957+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~TRSW2MB1KRAI.2 size=1017736 2023-12-03T11:28:24.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.959+0000 7fe67fa49780 1 < canceled multipart upload key=H8MBLWXG7BCZ upload=TRSW2MB1KRAI tag=QULCXZOI3KZI type=write size=4163464 2023-12-03T11:28:24.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.961+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~5M5PTJKS6B3G.0 size=1048576 2023-12-03T11:28:24.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.962+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~5M5PTJKS6B3G.1 size=348095 2023-12-03T11:28:24.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.962+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=5M5PTJKS6B3G tag=32NCQOQEOK0D type=write size=2445247 2023-12-03T11:28:24.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.964+0000 7fe67fa49780 1 < suggested remove operation key=XZHCD4R4EVZR tag=6NVPH0SZ68PU type=del 2023-12-03T11:28:24.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.966+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~NTWGHI52RQ3T.0 size=1048576 2023-12-03T11:28:24.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.967+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~NTWGHI52RQ3T.1 size=757738 2023-12-03T11:28:24.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.967+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=NTWGHI52RQ3T tag=BE9NGKBMI990 type=write size=2854890 2023-12-03T11:28:24.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.968+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=X2XFQO0P7L4T type=del 2023-12-03T11:28:24.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.970+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=KY1L43TF3XM3 type=write size=205165 2023-12-03T11:28:24.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.971+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~R3POY2QVOV20.0 size=1048576 2023-12-03T11:28:24.973 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.972+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~R3POY2QVOV20.1 size=872425 2023-12-03T11:28:24.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.974+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=R3POY2QVOV20 tag=LRIGHG864MXG type=write size=2969577 2023-12-03T11:28:24.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.975+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=SS8LTJ0P333F type=del size=3132186 2023-12-03T11:28:24.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.976+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~Q6CA6RT17P2T.0 size=1048576 2023-12-03T11:28:24.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.977+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~Q6CA6RT17P2T.1 size=905966 2023-12-03T11:28:24.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.979+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=Q6CA6RT17P2T tag=Q3TCBTR49XVN type=write size=3003118 2023-12-03T11:28:24.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.981+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~6QTW4VWWLSHQ.0 size=1048576 2023-12-03T11:28:24.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.982+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~6QTW4VWWLSHQ.1 size=1048576 2023-12-03T11:28:24.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.983+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~6QTW4VWWLSHQ.2 size=452530 2023-12-03T11:28:24.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.983+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=6QTW4VWWLSHQ tag=TJGM1KCN3JNH type=write size=3598258 2023-12-03T11:28:24.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.984+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=TP8RO26GA2ZQ type=del 2023-12-03T11:28:24.986 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.985+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=JFWRTXV52CSB type=del size=92220 2023-12-03T11:28:24.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.987+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~RV1HEZIENJDD.0 size=1048576 2023-12-03T11:28:24.988 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.987+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~RV1HEZIENJDD.1 size=1048576 2023-12-03T11:28:24.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.988+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~RV1HEZIENJDD.2 size=503390 2023-12-03T11:28:24.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.990+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=RV1HEZIENJDD tag=REFUEZ7YPGV9 type=write size=3649118 2023-12-03T11:28:24.993 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.992+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=UQS0NWE7FTBJ type=del size=660285 2023-12-03T11:28:24.994 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.993+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=GOCYVPA9MP03 type=del 2023-12-03T11:28:24.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.995+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~6H17HH18HZ4A.0 size=1048576 2023-12-03T11:28:24.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.996+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~6H17HH18HZ4A.1 size=320523 2023-12-03T11:28:24.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.996+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=6H17HH18HZ4A tag=NMB6ERHPXGLX type=write size=2417675 2023-12-03T11:28:24.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.997+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~CUILS9JQ2V4J.0 size=1048576 2023-12-03T11:28:24.999 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:24.998+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~CUILS9JQ2V4J.1 size=724522 2023-12-03T11:28:25.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.000+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=CUILS9JQ2V4J tag=QQZRQ3XK67WI type=write size=2821674 2023-12-03T11:28:25.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.001+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=KB1VK6BFS947 type=del size=20317 2023-12-03T11:28:25.004 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.004+0000 7fe67fa49780 1 < suggested remove operation key=Q6GBIBMIJRKV tag=W1H4J6WQK4PR type=del 2023-12-03T11:28:25.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.005+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=LJC8S3JPSSDV type=write size=726881 2023-12-03T11:28:25.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.006+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=U51LNCDGF9XR type=del 2023-12-03T11:28:25.008 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.007+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=EFXSAIEUNHX1 type=del size=1462038 2023-12-03T11:28:25.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.009+0000 7fe67fa49780 1 < canceled operation key=2GX6IWVZH25N tag=91NWAZ5OUATN type=del size=2467047 2023-12-03T11:28:25.012 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.011+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~SJKIJNBZ93FT.0 size=1048576 2023-12-03T11:28:25.013 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.012+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~SJKIJNBZ93FT.1 size=1048576 2023-12-03T11:28:25.014 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.013+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~SJKIJNBZ93FT.2 size=743397 2023-12-03T11:28:25.014 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.013+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=SJKIJNBZ93FT tag=JRPZULBUUK9H type=write size=3889125 2023-12-03T11:28:25.015 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.014+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~6EOJY8X2OY8P.0 size=1048576 2023-12-03T11:28:25.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.015+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~6EOJY8X2OY8P.1 size=1048576 2023-12-03T11:28:25.017 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.016+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~6EOJY8X2OY8P.2 size=517907 2023-12-03T11:28:25.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.018+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=6EOJY8X2OY8P tag=T8802EU4AC6V type=write size=3663635 2023-12-03T11:28:25.020 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.019+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=QSA4R9N2UYZE type=del size=2680210 2023-12-03T11:28:25.021 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.020+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=0PGQ92CD1FJK type=del 2023-12-03T11:28:25.022 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.021+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=AU45NC478JGZ type=del size=841463 2023-12-03T11:28:25.024 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.024+0000 7fe67fa49780 1 < suggested remove operation key=Z1NFEIZNYYO2 tag=8XENKTWKYIN2 type=del 2023-12-03T11:28:25.026 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.025+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~9JLOSVLNZ6WR.0 size=1048576 2023-12-03T11:28:25.029 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.026+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~9JLOSVLNZ6WR.1 size=1048576 2023-12-03T11:28:25.029 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.027+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~9JLOSVLNZ6WR.2 size=260482 2023-12-03T11:28:25.029 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.027+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=9JLOSVLNZ6WR tag=3RJFTJ7X6DYH type=write size=3406210 2023-12-03T11:28:25.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.028+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=1R0XQ8YGPBXG type=del 2023-12-03T11:28:25.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.030+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=YE7E4FHFECPQ type=del size=3813620 2023-12-03T11:28:25.032 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.031+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~5M5PTJKS6B3G.0 size=1048576 2023-12-03T11:28:25.033 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.032+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~5M5PTJKS6B3G.1 size=348095 2023-12-03T11:28:25.034 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.034+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=5M5PTJKS6B3G tag=32NCQOQEOK0D type=write size=2445247 2023-12-03T11:28:25.036 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.035+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=3WNZDT27Q9MD type=del size=251551 2023-12-03T11:28:25.036 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.035+0000 7fe67fa49780 1 < canceled part key=_multipart_IIW1Y6QYEODQ.2~NTWGHI52RQ3T.0 size=1048576 2023-12-03T11:28:25.036 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.035+0000 7fe67fa49780 1 < canceled part key=_multipart_IIW1Y6QYEODQ.2~NTWGHI52RQ3T.1 size=757738 2023-12-03T11:28:25.038 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.037+0000 7fe67fa49780 1 < canceled multipart upload key=IIW1Y6QYEODQ upload=NTWGHI52RQ3T tag=BE9NGKBMI990 type=write size=2854890 2023-12-03T11:28:25.040 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.039+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~8APKBXVOZ8T2.0 size=1048576 2023-12-03T11:28:25.041 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.040+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~8APKBXVOZ8T2.1 size=1048576 2023-12-03T11:28:25.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.041+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~8APKBXVOZ8T2.2 size=525143 2023-12-03T11:28:25.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.041+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=8APKBXVOZ8T2 tag=Z9DTRBAQMDO4 type=write size=3670871 2023-12-03T11:28:25.043 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.042+0000 7fe67fa49780 1 < completed write operation key=XZHCD4R4EVZR tag=KY1L43TF3XM3 type=write size=205165 2023-12-03T11:28:25.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.043+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=17QO9GJ1CRFD type=del size=515846 2023-12-03T11:28:25.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.044+0000 7fe67fa49780 1 < canceled operation key=9OD4G28SDLB4 tag=SS8LTJ0P333F type=del size=3132186 2023-12-03T11:28:25.047 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.046+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~LNDA1OTBY24S.0 size=461418 2023-12-03T11:28:25.047 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.046+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=LNDA1OTBY24S tag=DAQCMDD4JC5Z type=write size=1509994 2023-12-03T11:28:25.048 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.047+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~6QTW4VWWLSHQ.0 size=1048576 2023-12-03T11:28:25.049 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.048+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~6QTW4VWWLSHQ.1 size=1048576 2023-12-03T11:28:25.049 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.048+0000 7fe67fa49780 1 < canceled part key=_multipart_0GQZY07Y2PVI.2~6QTW4VWWLSHQ.2 size=452530 2023-12-03T11:28:25.051 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.050+0000 7fe67fa49780 1 < canceled multipart upload key=0GQZY07Y2PVI upload=6QTW4VWWLSHQ tag=TJGM1KCN3JNH type=write size=3598258 2023-12-03T11:28:25.053 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.053+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~NEM2XH69D26Z.0 size=1048576 2023-12-03T11:28:25.054 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.054+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~NEM2XH69D26Z.1 size=223905 2023-12-03T11:28:25.055 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.054+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=NEM2XH69D26Z tag=GSSZAZLEW791 type=write size=2321057 2023-12-03T11:28:25.057 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.056+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=JFWRTXV52CSB type=del 2023-12-03T11:28:25.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.057+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=MF8SCXUQ11T9 type=del size=3994849 2023-12-03T11:28:25.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.058+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=UQS0NWE7FTBJ type=del 2023-12-03T11:28:25.060 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.059+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=PZ7MR27JUQD1 type=del size=2714667 2023-12-03T11:28:25.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.061+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~6H17HH18HZ4A.0 size=1048576 2023-12-03T11:28:25.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.062+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~6H17HH18HZ4A.1 size=320523 2023-12-03T11:28:25.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.064+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=6H17HH18HZ4A tag=NMB6ERHPXGLX type=write size=2417675 2023-12-03T11:28:25.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.065+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=96BXNBCSL89A type=write size=296288 2023-12-03T11:28:25.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.067+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=KB1VK6BFS947 type=del 2023-12-03T11:28:25.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.068+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=I9Q3FTS4NTGH type=del size=1985935 2023-12-03T11:28:25.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.071+0000 7fe67fa49780 1 < suggested remove operation key=OH2XUEEYL9JO tag=LJC8S3JPSSDV type=write 2023-12-03T11:28:25.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.073+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~2AK0Y5TF3DJE.0 size=388274 2023-12-03T11:28:25.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.073+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=2AK0Y5TF3DJE tag=39L1TTEJQROW type=write size=1436850 2023-12-03T11:28:25.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.074+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=EFXSAIEUNHX1 type=del 2023-12-03T11:28:25.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.075+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=KPTQ079ICTNX type=del size=3894809 2023-12-03T11:28:25.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.076+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~SJKIJNBZ93FT.0 size=1048576 2023-12-03T11:28:25.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.076+0000 7fe67fa49780 1 < canceled part key=_multipart_P05UIP1IU4Z7.2~SJKIJNBZ93FT.1 size=1048576 2023-12-03T11:28:25.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.077+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~SJKIJNBZ93FT.2 size=743397 2023-12-03T11:28:25.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.080+0000 7fe67fa49780 1 < canceled multipart upload key=P05UIP1IU4Z7 upload=SJKIJNBZ93FT tag=JRPZULBUUK9H type=write size=3889125 2023-12-03T11:28:25.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.081+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=1C3M0ETZB1RA type=del size=2790404 2023-12-03T11:28:25.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.082+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=QSA4R9N2UYZE type=del 2023-12-03T11:28:25.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.083+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=HXLA7BPF7MIQ type=del size=3216135 2023-12-03T11:28:25.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.086+0000 7fe67fa49780 1 < suggested remove operation key=DDHGOWEI7WEI tag=AU45NC478JGZ type=del 2023-12-03T11:28:25.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.088+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~LAXRTIEFK0Q8.0 size=1048576 2023-12-03T11:28:25.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.089+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~LAXRTIEFK0Q8.1 size=1048576 2023-12-03T11:28:25.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.090+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~LAXRTIEFK0Q8.2 size=351774 2023-12-03T11:28:25.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.090+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=LAXRTIEFK0Q8 tag=6SIQUGHM4N9D type=write size=3497502 2023-12-03T11:28:25.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.091+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~9JLOSVLNZ6WR.0 size=1048576 2023-12-03T11:28:25.093 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.092+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~9JLOSVLNZ6WR.1 size=1048576 2023-12-03T11:28:25.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.093+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~9JLOSVLNZ6WR.2 size=260482 2023-12-03T11:28:25.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.095+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=9JLOSVLNZ6WR tag=3RJFTJ7X6DYH type=write size=3406210 2023-12-03T11:28:25.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.096+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=J2RZME95JJFB type=del size=1399663 2023-12-03T11:28:25.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.098+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=YE7E4FHFECPQ type=del 2023-12-03T11:28:25.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.099+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=SPAEL233O6Z6 type=del size=370479 2023-12-03T11:28:25.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.100+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=3WNZDT27Q9MD type=del 2023-12-03T11:28:25.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.101+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=SSR5KBV6T793 type=write size=700397 2023-12-03T11:28:25.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.101+0000 7fe67fa49780 1 < canceled part key=_multipart_PFBGR7OF7JQG.2~8APKBXVOZ8T2.0 size=1048576 2023-12-03T11:28:25.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.102+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~8APKBXVOZ8T2.1 size=1048576 2023-12-03T11:28:25.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.103+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~8APKBXVOZ8T2.2 size=525143 2023-12-03T11:28:25.106 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.105+0000 7fe67fa49780 1 < canceled multipart upload key=PFBGR7OF7JQG upload=8APKBXVOZ8T2 tag=Z9DTRBAQMDO4 type=write size=3670871 2023-12-03T11:28:25.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.106+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=N4Z0XHPKVI0I type=del size=1713999 2023-12-03T11:28:25.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.108+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=17QO9GJ1CRFD type=del 2023-12-03T11:28:25.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.109+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=7JTRR2H74F06 type=write size=366688 2023-12-03T11:28:25.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.110+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~LNDA1OTBY24S.0 size=461418 2023-12-03T11:28:25.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.112+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=LNDA1OTBY24S tag=DAQCMDD4JC5Z type=write size=1509994 2023-12-03T11:28:25.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.115+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~UBQGIILP6YUB.0 size=1048576 2023-12-03T11:28:25.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.116+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~UBQGIILP6YUB.1 size=698837 2023-12-03T11:28:25.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.116+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=UBQGIILP6YUB tag=APYFHWLPQDMI type=write size=2795989 2023-12-03T11:28:25.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.117+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~NEM2XH69D26Z.0 size=1048576 2023-12-03T11:28:25.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.118+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~NEM2XH69D26Z.1 size=223905 2023-12-03T11:28:25.121 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.120+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=NEM2XH69D26Z tag=GSSZAZLEW791 type=write size=2321057 2023-12-03T11:28:25.122 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.121+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=G0U0C6YIR86C type=write size=525165 2023-12-03T11:28:25.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.124+0000 7fe67fa49780 1 < suggested remove operation key=KMC5YD2M3I45 tag=MF8SCXUQ11T9 type=del 2023-12-03T11:28:25.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.125+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=0RYV19UNAQE1 type=write size=193718 2023-12-03T11:28:25.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.126+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=PZ7MR27JUQD1 type=del 2023-12-03T11:28:25.129 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.128+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~0ZAPROIQEDD0.0 size=1048576 2023-12-03T11:28:25.130 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.129+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~0ZAPROIQEDD0.1 size=1048576 2023-12-03T11:28:25.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.130+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~0ZAPROIQEDD0.2 size=839888 2023-12-03T11:28:25.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.130+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=0ZAPROIQEDD0 tag=E10SEW0H3UI4 type=write size=3985616 2023-12-03T11:28:25.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.131+0000 7fe67fa49780 -1 < failed to complete operation key=DDHGOWEI7WEI tag=96BXNBCSL89A type=write size=296288: (22) Invalid argument 2023-12-03T11:28:25.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.133+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=F2UXTJ4N22R7 type=del size=3315220 2023-12-03T11:28:25.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.134+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=I9Q3FTS4NTGH type=del 2023-12-03T11:28:25.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.136+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~B1VKREVQ7HJS.0 size=1048576 2023-12-03T11:28:25.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.137+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~B1VKREVQ7HJS.1 size=1048576 2023-12-03T11:28:25.139 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.138+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~B1VKREVQ7HJS.2 size=349636 2023-12-03T11:28:25.139 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.138+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=B1VKREVQ7HJS tag=SD30YTJ709FZ type=write size=3495364 2023-12-03T11:28:25.140 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.139+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~2AK0Y5TF3DJE.0 size=388274 2023-12-03T11:28:25.142 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.141+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=2AK0Y5TF3DJE tag=39L1TTEJQROW type=write size=1436850 2023-12-03T11:28:25.144 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.143+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=R5IEHASR3PQF type=del size=1481196 2023-12-03T11:28:25.146 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.144+0000 7fe67fa49780 -1 < failed to complete operation key=DDHGOWEI7WEI tag=KPTQ079ICTNX type=del size=3894809: (22) Invalid argument 2023-12-03T11:28:25.147 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.145+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=SI2ETLG0C4EC type=del size=3953918 2023-12-03T11:28:25.147 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.146+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=1C3M0ETZB1RA type=del 2023-12-03T11:28:25.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.148+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=9S4PNU5CV2E3 type=del size=307428 2023-12-03T11:28:25.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.149+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=HXLA7BPF7MIQ type=del 2023-12-03T11:28:25.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.151+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~U7PD669PLDB3.0 size=1048576 2023-12-03T11:28:25.153 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.152+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~U7PD669PLDB3.1 size=184572 2023-12-03T11:28:25.153 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.152+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=U7PD669PLDB3 tag=FT39AVV2C772 type=write size=2281724 2023-12-03T11:28:25.155 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.154+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~LAXRTIEFK0Q8.0 size=1048576 2023-12-03T11:28:25.156 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.155+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~LAXRTIEFK0Q8.1 size=1048576 2023-12-03T11:28:25.157 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.156+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~LAXRTIEFK0Q8.2 size=351774 2023-12-03T11:28:25.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.158+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=LAXRTIEFK0Q8 tag=6SIQUGHM4N9D type=write size=3497502 2023-12-03T11:28:25.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.159+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=3IM63EOX29CS type=del size=1603216 2023-12-03T11:28:25.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.161+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=J2RZME95JJFB type=del 2023-12-03T11:28:25.163 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.162+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=EY1DAH7GQE1M type=del size=718157 2023-12-03T11:28:25.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.164+0000 7fe67fa49780 1 < suggested update operation key=A7GOX2W0WB83 tag=SPAEL233O6Z6 type=del size=370479 2023-12-03T11:28:25.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.165+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=IGI3LAPP3DUJ type=write size=948291 2023-12-03T11:28:25.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.166+0000 7fe67fa49780 1 < completed write operation key=Q6GBIBMIJRKV tag=SSR5KBV6T793 type=write size=700397 2023-12-03T11:28:25.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.169+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~CH834XJ16FFF.0 size=1048576 2023-12-03T11:28:25.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.170+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~CH834XJ16FFF.1 size=387281 2023-12-03T11:28:25.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.170+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=CH834XJ16FFF tag=F5ZJTSVBWY7U type=write size=2484433 2023-12-03T11:28:25.172 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.172+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=N4Z0XHPKVI0I type=del 2023-12-03T11:28:25.174 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.173+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=DE13WS6YWIF0 type=write size=552695 2023-12-03T11:28:25.175 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.174+0000 7fe67fa49780 1 < completed write operation key=9AUO0SRFTAUJ tag=7JTRR2H74F06 type=write size=366688 2023-12-03T11:28:25.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.175+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=7EZNXXCUO4RM type=del size=3746304 2023-12-03T11:28:25.177 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.176+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~UBQGIILP6YUB.0 size=1048576 2023-12-03T11:28:25.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.177+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~UBQGIILP6YUB.1 size=698837 2023-12-03T11:28:25.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.179+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=UBQGIILP6YUB tag=APYFHWLPQDMI type=write size=2795989 2023-12-03T11:28:25.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.181+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~1FMQ1BJ6IO9E.0 size=1048576 2023-12-03T11:28:25.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.182+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~1FMQ1BJ6IO9E.1 size=645509 2023-12-03T11:28:25.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.182+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=1FMQ1BJ6IO9E tag=0GEDDYSVUFMS type=write size=2742661 2023-12-03T11:28:25.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.183+0000 7fe67fa49780 1 < completed write operation key=IIW1Y6QYEODQ tag=G0U0C6YIR86C type=write size=525165 2023-12-03T11:28:25.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.185+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=U66EHLGK4TMN type=del size=607458 2023-12-03T11:28:25.187 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.186+0000 7fe67fa49780 1 < completed write operation key=URVD2U16EW75 tag=0RYV19UNAQE1 type=write size=193718 2023-12-03T11:28:25.189 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.188+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~W103X6X3A0J3.0 size=1048576 2023-12-03T11:28:25.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.189+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~W103X6X3A0J3.1 size=1048576 2023-12-03T11:28:25.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.190+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~W103X6X3A0J3.2 size=25003 2023-12-03T11:28:25.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.190+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=W103X6X3A0J3 tag=PQSCJUO6LD6R type=write size=3170731 2023-12-03T11:28:25.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.191+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~0ZAPROIQEDD0.0 size=1048576 2023-12-03T11:28:25.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.192+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~0ZAPROIQEDD0.1 size=1048576 2023-12-03T11:28:25.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.193+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~0ZAPROIQEDD0.2 size=839888 2023-12-03T11:28:25.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.196+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=0ZAPROIQEDD0 tag=E10SEW0H3UI4 type=write size=3985616 2023-12-03T11:28:25.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.197+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=Z1RC2CRC0E6R type=write size=563862 2023-12-03T11:28:25.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.198+0000 7fe67fa49780 1 < canceled operation key=P05UIP1IU4Z7 tag=F2UXTJ4N22R7 type=del size=3315220 2023-12-03T11:28:25.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.199+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=BR25UI5K7W9U type=del size=75879 2023-12-03T11:28:25.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.201+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~B1VKREVQ7HJS.0 size=1048576 2023-12-03T11:28:25.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.202+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~B1VKREVQ7HJS.1 size=1048576 2023-12-03T11:28:25.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.203+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~B1VKREVQ7HJS.2 size=349636 2023-12-03T11:28:25.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.204+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=B1VKREVQ7HJS tag=SD30YTJ709FZ type=write size=3495364 2023-12-03T11:28:25.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.206+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=XDUSV2LDXBCQ type=write size=490369 2023-12-03T11:28:25.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.208+0000 7fe67fa49780 1 < suggested update operation key=ASODFGLQ5VNY tag=R5IEHASR3PQF type=del size=1481196 2023-12-03T11:28:25.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.210+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~YS1USGPIM0GJ.0 size=1048576 2023-12-03T11:28:25.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.211+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~YS1USGPIM0GJ.1 size=203716 2023-12-03T11:28:25.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.211+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=YS1USGPIM0GJ tag=FO39RRPR0QGE type=write size=2300868 2023-12-03T11:28:25.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.212+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=SI2ETLG0C4EC type=del 2023-12-03T11:28:25.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.215+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~JDE82I28KL2E.0 size=1048576 2023-12-03T11:28:25.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.215+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~JDE82I28KL2E.1 size=1048576 2023-12-03T11:28:25.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.216+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~JDE82I28KL2E.2 size=423850 2023-12-03T11:28:25.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.216+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=JDE82I28KL2E tag=7XBZ6KPFJIEP type=write size=3569578 2023-12-03T11:28:25.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.217+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=9S4PNU5CV2E3 type=del 2023-12-03T11:28:25.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.219+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=KFPIMIK4ZVCZ type=del size=877839 2023-12-03T11:28:25.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.220+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~U7PD669PLDB3.0 size=1048576 2023-12-03T11:28:25.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.221+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~U7PD669PLDB3.1 size=184572 2023-12-03T11:28:25.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.223+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=U7PD669PLDB3 tag=FT39AVV2C772 type=write size=2281724 2023-12-03T11:28:25.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.224+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=IDG4VTZLX52O type=write size=802671 2023-12-03T11:28:25.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.225+0000 7fe67fa49780 1 < canceled operation key=TXVHRE03Z3DA tag=3IM63EOX29CS type=del size=1603216 2023-12-03T11:28:25.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.226+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=HXF2F2E1DB0L type=del size=2675134 2023-12-03T11:28:25.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.227+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=EY1DAH7GQE1M type=del 2023-12-03T11:28:25.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.228+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=F3UUXU3CQYLB type=del size=1038365 2023-12-03T11:28:25.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.229+0000 7fe67fa49780 1 < completed write operation key=0GQZY07Y2PVI tag=IGI3LAPP3DUJ type=write size=948291 2023-12-03T11:28:25.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.231+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~VGNSXJV7UV36.0 size=1048576 2023-12-03T11:28:25.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.232+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~VGNSXJV7UV36.1 size=360640 2023-12-03T11:28:25.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.232+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=VGNSXJV7UV36 tag=F215SOBTYYZB type=write size=2457792 2023-12-03T11:28:25.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.233+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~CH834XJ16FFF.0 size=1048576 2023-12-03T11:28:25.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.234+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~CH834XJ16FFF.1 size=387281 2023-12-03T11:28:25.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.236+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=CH834XJ16FFF tag=F5ZJTSVBWY7U type=write size=2484433 2023-12-03T11:28:25.238 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.237+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=CW6PYFVQ8GZS type=write size=878940 2023-12-03T11:28:25.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.239+0000 7fe67fa49780 1 < suggested update operation key=SXVBDBJ5B09V tag=DE13WS6YWIF0 type=write size=552695 2023-12-03T11:28:25.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.240+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=4FSNQX1GIBAG type=del size=2769670 2023-12-03T11:28:25.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.242+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=7EZNXXCUO4RM type=del 2023-12-03T11:28:25.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.243+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=VAG4HSH0XOWT type=del size=418095 2023-12-03T11:28:25.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.243+0000 7fe67fa49780 1 < canceled part key=_multipart_9AUO0SRFTAUJ.2~1FMQ1BJ6IO9E.0 size=1048576 2023-12-03T11:28:25.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.244+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~1FMQ1BJ6IO9E.1 size=645509 2023-12-03T11:28:25.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.246+0000 7fe67fa49780 1 < canceled multipart upload key=9AUO0SRFTAUJ upload=1FMQ1BJ6IO9E tag=0GEDDYSVUFMS type=write size=2742661 2023-12-03T11:28:25.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.248+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~SFBVNG7UMZVI.0 size=1048576 2023-12-03T11:28:25.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.248+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~SFBVNG7UMZVI.1 size=1048576 2023-12-03T11:28:25.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.249+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~SFBVNG7UMZVI.2 size=997025 2023-12-03T11:28:25.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.249+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=SFBVNG7UMZVI tag=ZG2U3273JCZD type=write size=4142753 2023-12-03T11:28:25.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.250+0000 7fe67fa49780 1 < canceled operation key=Z1NFEIZNYYO2 tag=U66EHLGK4TMN type=del size=607458 2023-12-03T11:28:25.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.252+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~0QN8530WU8VP.0 size=1048576 2023-12-03T11:28:25.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.253+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~0QN8530WU8VP.1 size=1048576 2023-12-03T11:28:25.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.254+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~0QN8530WU8VP.2 size=942500 2023-12-03T11:28:25.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.254+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=0QN8530WU8VP tag=F3XSIOQ3CNH6 type=write size=4088228 2023-12-03T11:28:25.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.255+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~W103X6X3A0J3.0 size=1048576 2023-12-03T11:28:25.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.256+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~W103X6X3A0J3.1 size=1048576 2023-12-03T11:28:25.258 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.257+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~W103X6X3A0J3.2 size=25003 2023-12-03T11:28:25.260 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.259+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=W103X6X3A0J3 tag=PQSCJUO6LD6R type=write size=3170731 2023-12-03T11:28:25.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.261+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~1KCH0EJJYKMN.0 size=1048576 2023-12-03T11:28:25.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.262+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~1KCH0EJJYKMN.1 size=1048576 2023-12-03T11:28:25.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.263+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~1KCH0EJJYKMN.2 size=251755 2023-12-03T11:28:25.264 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.263+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=1KCH0EJJYKMN tag=06WZ72UZTSS3 type=write size=3397483 2023-12-03T11:28:25.265 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.264+0000 7fe67fa49780 1 < completed write operation key=Z1NFEIZNYYO2 tag=Z1RC2CRC0E6R type=write size=563862 2023-12-03T11:28:25.266 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.265+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=1M4DNEWIIR1C type=del size=3683816 2023-12-03T11:28:25.267 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.266+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=BR25UI5K7W9U type=del 2023-12-03T11:28:25.268 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.267+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=R4VZUMQ3PO7C type=del size=2880950 2023-12-03T11:28:25.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.268+0000 7fe67fa49780 1 < completed write operation key=XZHCD4R4EVZR tag=XDUSV2LDXBCQ type=write size=490369 2023-12-03T11:28:25.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.269+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=LYMDJKW75JFE type=del size=2930749 2023-12-03T11:28:25.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.270+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~YS1USGPIM0GJ.0 size=1048576 2023-12-03T11:28:25.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.270+0000 7fe67fa49780 1 < canceled part key=_multipart_URVD2U16EW75.2~YS1USGPIM0GJ.1 size=203716 2023-12-03T11:28:25.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.272+0000 7fe67fa49780 1 < canceled multipart upload key=URVD2U16EW75 upload=YS1USGPIM0GJ tag=FO39RRPR0QGE type=write size=2300868 2023-12-03T11:28:25.275 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.274+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~2AQS99CYTQRW.0 size=1048576 2023-12-03T11:28:25.276 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.275+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~2AQS99CYTQRW.1 size=658504 2023-12-03T11:28:25.276 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.275+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=2AQS99CYTQRW tag=M2UBTX0ZTFJZ type=write size=2755656 2023-12-03T11:28:25.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.277+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~JDE82I28KL2E.0 size=1048576 2023-12-03T11:28:25.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.278+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~JDE82I28KL2E.1 size=1048576 2023-12-03T11:28:25.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.279+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~JDE82I28KL2E.2 size=423850 2023-12-03T11:28:25.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.280+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=JDE82I28KL2E tag=7XBZ6KPFJIEP type=write size=3569578 2023-12-03T11:28:25.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.282+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~PV0JK36MK1TE.0 size=630696 2023-12-03T11:28:25.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.282+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=PV0JK36MK1TE tag=8TI15C0SSG2Y type=write size=1679272 2023-12-03T11:28:25.285 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.284+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=KFPIMIK4ZVCZ type=del 2023-12-03T11:28:25.287 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.286+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=UKG9EE0YYKCZ type=del size=3244253 2023-12-03T11:28:25.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.287+0000 7fe67fa49780 1 < completed write operation key=N87KA638VE01 tag=IDG4VTZLX52O type=write size=802671 2023-12-03T11:28:25.291 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.290+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~UKZYAMVKEA95.0 size=1048576 2023-12-03T11:28:25.292 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.291+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~UKZYAMVKEA95.1 size=543143 2023-12-03T11:28:25.292 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.291+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=UKZYAMVKEA95 tag=S978KSZ9GWGC type=write size=2640295 2023-12-03T11:28:25.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.293+0000 7fe67fa49780 1 < suggested remove operation key=8UZJU9PNWIB6 tag=HXF2F2E1DB0L type=del 2023-12-03T11:28:25.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.294+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=1F79IMEORKWG type=del size=546283 2023-12-03T11:28:25.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.295+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=F3UUXU3CQYLB type=del 2023-12-03T11:28:25.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.298+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~QGDDUCFX1DA4.0 size=962302 2023-12-03T11:28:25.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.298+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=QGDDUCFX1DA4 tag=B5XRX8YK8ZC7 type=write size=2010878 2023-12-03T11:28:25.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.298+0000 7fe67fa49780 1 < canceled part key=_multipart_Q6GBIBMIJRKV.2~VGNSXJV7UV36.0 size=1048576 2023-12-03T11:28:25.300 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.299+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~VGNSXJV7UV36.1 size=360640 2023-12-03T11:28:25.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.301+0000 7fe67fa49780 1 < canceled multipart upload key=Q6GBIBMIJRKV upload=VGNSXJV7UV36 tag=F215SOBTYYZB type=write size=2457792 2023-12-03T11:28:25.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.302+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=Z5SHKZ7Z88TD type=del size=3158462 2023-12-03T11:28:25.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.304+0000 7fe67fa49780 1 < completed write operation key=Y0VRZR6S8FP6 tag=CW6PYFVQ8GZS type=write size=878940 2023-12-03T11:28:25.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.305+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=A7RN3RMJH8I8 type=del size=969238 2023-12-03T11:28:25.308 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.307+0000 7fe67fa49780 1 < suggested remove operation key=2GX6IWVZH25N tag=4FSNQX1GIBAG type=del 2023-12-03T11:28:25.310 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.309+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~YG4EN641T20N.0 size=1048576 2023-12-03T11:28:25.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.310+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~YG4EN641T20N.1 size=915489 2023-12-03T11:28:25.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.310+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=YG4EN641T20N tag=W3ZNBFIY0YRD type=write size=3012641 2023-12-03T11:28:25.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.311+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=VAG4HSH0XOWT type=del 2023-12-03T11:28:25.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.312+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=AXQCBHN9FXAK type=del size=685701 2023-12-03T11:28:25.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.313+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~SFBVNG7UMZVI.0 size=1048576 2023-12-03T11:28:25.315 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.314+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~SFBVNG7UMZVI.1 size=1048576 2023-12-03T11:28:25.316 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.315+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~SFBVNG7UMZVI.2 size=997025 2023-12-03T11:28:25.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.317+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=SFBVNG7UMZVI tag=ZG2U3273JCZD type=write size=4142753 2023-12-03T11:28:25.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.319+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~G6V81BTZ6A1T.0 size=624530 2023-12-03T11:28:25.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.319+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=G6V81BTZ6A1T tag=TTDBHB9HI3ZI type=write size=1673106 2023-12-03T11:28:25.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.320+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~0QN8530WU8VP.0 size=1048576 2023-12-03T11:28:25.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.321+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~0QN8530WU8VP.1 size=1048576 2023-12-03T11:28:25.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.321+0000 7fe67fa49780 1 < canceled part key=_multipart_983BDZLASC3S.2~0QN8530WU8VP.2 size=942500 2023-12-03T11:28:25.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.323+0000 7fe67fa49780 1 < canceled multipart upload key=983BDZLASC3S upload=0QN8530WU8VP tag=F3XSIOQ3CNH6 type=write size=4088228 2023-12-03T11:28:25.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.324+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=JIV5P43GTFD5 type=del size=667318 2023-12-03T11:28:25.327 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.326+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~1KCH0EJJYKMN.0 size=1048576 2023-12-03T11:28:25.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.327+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~1KCH0EJJYKMN.1 size=1048576 2023-12-03T11:28:25.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.328+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~1KCH0EJJYKMN.2 size=251755 2023-12-03T11:28:25.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.330+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=1KCH0EJJYKMN tag=06WZ72UZTSS3 type=write size=3397483 2023-12-03T11:28:25.333 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.332+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~8A1LVO1CUDMC.0 size=1048576 2023-12-03T11:28:25.334 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.333+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~8A1LVO1CUDMC.1 size=1048576 2023-12-03T11:28:25.335 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.334+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~8A1LVO1CUDMC.2 size=509509 2023-12-03T11:28:25.335 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.334+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=8A1LVO1CUDMC tag=0W31NNS4G043 type=write size=3655237 2023-12-03T11:28:25.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.336+0000 7fe67fa49780 1 < suggested remove operation key=SIES92K9QVJV tag=1M4DNEWIIR1C type=del 2023-12-03T11:28:25.339 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.339+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~IQEDY6FUHEDD.0 size=1048576 2023-12-03T11:28:25.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.339+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~IQEDY6FUHEDD.1 size=1048576 2023-12-03T11:28:25.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.340+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~IQEDY6FUHEDD.2 size=20833 2023-12-03T11:28:25.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.340+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=IQEDY6FUHEDD tag=1FZSF45GNJB9 type=write size=3166561 2023-12-03T11:28:25.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.341+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=R4VZUMQ3PO7C type=del 2023-12-03T11:28:25.344 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.344+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~MRRTMIYM3IP5.0 size=1048576 2023-12-03T11:28:25.345 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.344+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~MRRTMIYM3IP5.1 size=1023815 2023-12-03T11:28:25.345 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.344+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=MRRTMIYM3IP5 tag=RCFA3ER59I26 type=write size=3120967 2023-12-03T11:28:25.347 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.346+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=LYMDJKW75JFE type=del 2023-12-03T11:28:25.348 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.347+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=5DQUG4OZJ6A3 type=write size=679252 2023-12-03T11:28:25.349 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.348+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~2AQS99CYTQRW.0 size=1048576 2023-12-03T11:28:25.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.349+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~2AQS99CYTQRW.1 size=658504 2023-12-03T11:28:25.352 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.351+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=2AQS99CYTQRW tag=M2UBTX0ZTFJZ type=write size=2755656 2023-12-03T11:28:25.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.354+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~DAI4J0ANZ2CC.0 size=1048576 2023-12-03T11:28:25.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.358+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~DAI4J0ANZ2CC.1 size=1048576 2023-12-03T11:28:25.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.360+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~DAI4J0ANZ2CC.2 size=718222 2023-12-03T11:28:25.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.360+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=DAI4J0ANZ2CC tag=SSTMAVDPNZQ9 type=write size=3863950 2023-12-03T11:28:25.362 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.361+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~PV0JK36MK1TE.0 size=630696 2023-12-03T11:28:25.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.367+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=PV0JK36MK1TE tag=8TI15C0SSG2Y type=write size=1679272 2023-12-03T11:28:25.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.368+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=CM40K9DIXG6R type=del size=444571 2023-12-03T11:28:25.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.370+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=UKG9EE0YYKCZ type=del 2023-12-03T11:28:25.373 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.372+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~DGG1TK324CFB.0 size=1048576 2023-12-03T11:28:25.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.373+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~DGG1TK324CFB.1 size=681642 2023-12-03T11:28:25.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.373+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=DGG1TK324CFB tag=S8DUO4OC57FV type=write size=2778794 2023-12-03T11:28:25.375 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.374+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~UKZYAMVKEA95.0 size=1048576 2023-12-03T11:28:25.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.375+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~UKZYAMVKEA95.1 size=543143 2023-12-03T11:28:25.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.377+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=UKZYAMVKEA95 tag=S978KSZ9GWGC type=write size=2640295 2023-12-03T11:28:25.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.379+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~YIP8W57QV337.0 size=225342 2023-12-03T11:28:25.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.379+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=YIP8W57QV337 tag=QFQJI6I55AFG type=write size=1273918 2023-12-03T11:28:25.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.380+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=1F79IMEORKWG type=del 2023-12-03T11:28:25.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.383+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~7109VSDRX518.0 size=1048576 2023-12-03T11:28:25.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.383+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~7109VSDRX518.1 size=212908 2023-12-03T11:28:25.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.383+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=7109VSDRX518 tag=0MRL2F5C4G5C type=write size=2310060 2023-12-03T11:28:25.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.385+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~QGDDUCFX1DA4.0 size=962302 2023-12-03T11:28:25.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.387+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=QGDDUCFX1DA4 tag=B5XRX8YK8ZC7 type=write size=2010878 2023-12-03T11:28:25.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.388+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=LRZB7IVN82VA type=del size=3283869 2023-12-03T11:28:25.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.389+0000 7fe67fa49780 1 < canceled operation key=Q6GBIBMIJRKV tag=Z5SHKZ7Z88TD type=del size=3158462 2023-12-03T11:28:25.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.391+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=FDDTG6MOLQE3 type=del size=3018741 2023-12-03T11:28:25.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.392+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=A7RN3RMJH8I8 type=del 2023-12-03T11:28:25.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.393+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=T94VXKDGX848 type=del size=2472020 2023-12-03T11:28:25.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.394+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~YG4EN641T20N.0 size=1048576 2023-12-03T11:28:25.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.396+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~YG4EN641T20N.1 size=915489 2023-12-03T11:28:25.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.398+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=YG4EN641T20N tag=W3ZNBFIY0YRD type=write size=3012641 2023-12-03T11:28:25.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.399+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=DVTWQL8ZY1E7 type=del size=4018041 2023-12-03T11:28:25.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.402+0000 7fe67fa49780 1 < suggested remove operation key=URVD2U16EW75 tag=AXQCBHN9FXAK type=del 2023-12-03T11:28:25.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.403+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=3VOCVNB35WBT type=del size=1480343 2023-12-03T11:28:25.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.404+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~G6V81BTZ6A1T.0 size=624530 2023-12-03T11:28:25.407 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.406+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=G6V81BTZ6A1T tag=TTDBHB9HI3ZI type=write size=1673106 2023-12-03T11:28:25.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.407+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=PDEHGLF75UR9 type=del size=3900663 2023-12-03T11:28:25.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.408+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=JIV5P43GTFD5 type=del 2023-12-03T11:28:25.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.409+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=CQNGR8KEYL6L type=del size=71355 2023-12-03T11:28:25.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.410+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~8A1LVO1CUDMC.0 size=1048576 2023-12-03T11:28:25.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.411+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~8A1LVO1CUDMC.1 size=1048576 2023-12-03T11:28:25.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.412+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~8A1LVO1CUDMC.2 size=509509 2023-12-03T11:28:25.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.414+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=8A1LVO1CUDMC tag=0W31NNS4G043 type=write size=3655237 2023-12-03T11:28:25.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.415+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=MCRRFOTHU9YX type=del size=1683479 2023-12-03T11:28:25.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.417+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~IQEDY6FUHEDD.0 size=1048576 2023-12-03T11:28:25.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.418+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~IQEDY6FUHEDD.1 size=1048576 2023-12-03T11:28:25.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.418+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~IQEDY6FUHEDD.2 size=20833 2023-12-03T11:28:25.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.420+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=IQEDY6FUHEDD tag=1FZSF45GNJB9 type=write size=3166561 2023-12-03T11:28:25.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.423+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~7XB6P2SZJ7OD.0 size=955439 2023-12-03T11:28:25.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.423+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=7XB6P2SZJ7OD tag=BS2OVBBEOB09 type=write size=2004015 2023-12-03T11:28:25.425 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.424+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~MRRTMIYM3IP5.0 size=1048576 2023-12-03T11:28:25.425 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.424+0000 7fe67fa49780 1 < canceled part key=_multipart_A7GOX2W0WB83.2~MRRTMIYM3IP5.1 size=1023815 2023-12-03T11:28:25.427 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.426+0000 7fe67fa49780 1 < canceled multipart upload key=A7GOX2W0WB83 upload=MRRTMIYM3IP5 tag=RCFA3ER59I26 type=write size=3120967 2023-12-03T11:28:25.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.428+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~PTSVZIYGQJUN.0 size=1048576 2023-12-03T11:28:25.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.429+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~PTSVZIYGQJUN.1 size=198954 2023-12-03T11:28:25.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.429+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=PTSVZIYGQJUN tag=6PRLH0806A5I type=write size=2296106 2023-12-03T11:28:25.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.430+0000 7fe67fa49780 1 < completed write operation key=SXVBDBJ5B09V tag=5DQUG4OZJ6A3 type=write size=679252 2023-12-03T11:28:25.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.432+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=0B90NMS6AWR1 type=write size=195864 2023-12-03T11:28:25.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.433+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~DAI4J0ANZ2CC.0 size=1048576 2023-12-03T11:28:25.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.434+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~DAI4J0ANZ2CC.1 size=1048576 2023-12-03T11:28:25.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.434+0000 7fe67fa49780 1 < canceled part key=_multipart_N87KA638VE01.2~DAI4J0ANZ2CC.2 size=718222 2023-12-03T11:28:25.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.436+0000 7fe67fa49780 1 < canceled multipart upload key=N87KA638VE01 upload=DAI4J0ANZ2CC tag=SSTMAVDPNZQ9 type=write size=3863950 2023-12-03T11:28:25.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.438+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~MD4AR5U70INZ.0 size=1048576 2023-12-03T11:28:25.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.439+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~MD4AR5U70INZ.1 size=1048576 2023-12-03T11:28:25.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.440+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~MD4AR5U70INZ.2 size=120126 2023-12-03T11:28:25.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.440+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=MD4AR5U70INZ tag=EFPA63GFO4DY type=write size=3265854 2023-12-03T11:28:25.442 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.441+0000 7fe67fa49780 1 < canceled operation key=H8MBLWXG7BCZ tag=CM40K9DIXG6R type=del size=444571 2023-12-03T11:28:25.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.442+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=YHNOOGFNRA6Y type=write size=168686 2023-12-03T11:28:25.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.443+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~DGG1TK324CFB.0 size=1048576 2023-12-03T11:28:25.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.444+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~DGG1TK324CFB.1 size=681642 2023-12-03T11:28:25.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.446+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=DGG1TK324CFB tag=S8DUO4OC57FV type=write size=2778794 2023-12-03T11:28:25.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.448+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~UNP2FAV7NGVS.0 size=1048576 2023-12-03T11:28:25.450 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.449+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~UNP2FAV7NGVS.1 size=801301 2023-12-03T11:28:25.450 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.449+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=UNP2FAV7NGVS tag=VVFG5G7W87KX type=write size=2898453 2023-12-03T11:28:25.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.450+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~YIP8W57QV337.0 size=225342 2023-12-03T11:28:25.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.452+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=YIP8W57QV337 tag=QFQJI6I55AFG type=write size=1273918 2023-12-03T11:28:25.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.453+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=9P4I94YF8CCE type=del size=2099767 2023-12-03T11:28:25.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.455+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~7109VSDRX518.0 size=1048576 2023-12-03T11:28:25.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.456+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~7109VSDRX518.1 size=212908 2023-12-03T11:28:25.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.458+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=7109VSDRX518 tag=0MRL2F5C4G5C type=write size=2310060 2023-12-03T11:28:25.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.459+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=VU2ABR93X2VL type=del size=1144925 2023-12-03T11:28:25.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.460+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=LRZB7IVN82VA type=del 2023-12-03T11:28:25.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.461+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=19TNNKM0PE9U type=del size=3401085 2023-12-03T11:28:25.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.463+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=FDDTG6MOLQE3 type=del 2023-12-03T11:28:25.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.465+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~084AU2ZXEQZH.0 size=1048576 2023-12-03T11:28:25.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.466+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~084AU2ZXEQZH.1 size=876905 2023-12-03T11:28:25.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.466+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=084AU2ZXEQZH tag=BX1HKT5EE2GT type=write size=2974057 2023-12-03T11:28:25.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.467+0000 7fe67fa49780 1 < canceled operation key=N87KA638VE01 tag=T94VXKDGX848 type=del size=2472020 2023-12-03T11:28:25.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.469+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=AC9892SDCXOU type=del size=2980610 2023-12-03T11:28:25.472 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.471+0000 7fe67fa49780 1 < suggested remove operation key=ASODFGLQ5VNY tag=DVTWQL8ZY1E7 type=del 2023-12-03T11:28:25.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.472+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=WECAMJHQPAK8 type=del size=1452636 2023-12-03T11:28:25.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.473+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=3VOCVNB35WBT type=del 2023-12-03T11:28:25.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.475+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~4UAGQOQYQ0N9.0 size=1048576 2023-12-03T11:28:25.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.476+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~4UAGQOQYQ0N9.1 size=298354 2023-12-03T11:28:25.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.476+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=4UAGQOQYQ0N9 tag=O00WK8I3NZR5 type=write size=2395506 2023-12-03T11:28:25.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.477+0000 7fe67fa49780 -1 < no bi entry to suggest for operation key=ASODFGLQ5VNY tag=PDEHGLF75UR9 type=del size=3900663: (2) No such file or directory 2023-12-03T11:28:25.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.478+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=QN4WH7Q5FAO3 type=del size=2225632 2023-12-03T11:28:25.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.479+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=CQNGR8KEYL6L type=del 2023-12-03T11:28:25.481 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.480+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=HBRSSBPBIV39 type=del size=1322555 2023-12-03T11:28:25.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.483+0000 7fe67fa49780 1 < suggested remove operation key=0G8KNJBJ9K1Z tag=MCRRFOTHU9YX type=del 2023-12-03T11:28:25.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.485+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~7LZAJ2TQA1VK.0 size=1048576 2023-12-03T11:28:25.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.486+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~7LZAJ2TQA1VK.1 size=1048576 2023-12-03T11:28:25.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.487+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~7LZAJ2TQA1VK.2 size=938240 2023-12-03T11:28:25.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.487+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=7LZAJ2TQA1VK tag=SQVXENUORGIO type=write size=4083968 2023-12-03T11:28:25.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.488+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~7XB6P2SZJ7OD.0 size=955439 2023-12-03T11:28:25.491 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.490+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=7XB6P2SZJ7OD tag=BS2OVBBEOB09 type=write size=2004015 2023-12-03T11:28:25.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.492+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~7MSQ29EX58I1.0 size=1048576 2023-12-03T11:28:25.494 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.493+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~7MSQ29EX58I1.1 size=1048576 2023-12-03T11:28:25.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.494+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~7MSQ29EX58I1.2 size=73119 2023-12-03T11:28:25.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.494+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=7MSQ29EX58I1 tag=8JKAUFCDI4FR type=write size=3218847 2023-12-03T11:28:25.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.494+0000 7fe67fa49780 1 < canceled part key=_multipart_KMC5YD2M3I45.2~PTSVZIYGQJUN.0 size=1048576 2023-12-03T11:28:25.496 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.494+0000 7fe67fa49780 1 < canceled part key=_multipart_KMC5YD2M3I45.2~PTSVZIYGQJUN.1 size=198954 2023-12-03T11:28:25.497 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.496+0000 7fe67fa49780 1 < canceled multipart upload key=KMC5YD2M3I45 upload=PTSVZIYGQJUN tag=6PRLH0806A5I type=write size=2296106 2023-12-03T11:28:25.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.497+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=H51LPQSA82O4 type=del size=2325335 2023-12-03T11:28:25.499 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.499+0000 7fe67fa49780 1 < completed write operation key=PFBGR7OF7JQG tag=0B90NMS6AWR1 type=write size=195864 2023-12-03T11:28:25.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.501+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~S9LB33NVZAUO.0 size=668052 2023-12-03T11:28:25.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.501+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=S9LB33NVZAUO tag=TO3LQE7N1X8Q type=write size=1716628 2023-12-03T11:28:25.503 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.502+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~MD4AR5U70INZ.0 size=1048576 2023-12-03T11:28:25.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.503+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~MD4AR5U70INZ.1 size=1048576 2023-12-03T11:28:25.505 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.504+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~MD4AR5U70INZ.2 size=120126 2023-12-03T11:28:25.508 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.507+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=MD4AR5U70INZ tag=EFPA63GFO4DY type=write size=3265854 2023-12-03T11:28:25.510 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.509+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~FEGX495Q72YY.0 size=1048576 2023-12-03T11:28:25.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.510+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~FEGX495Q72YY.1 size=1048576 2023-12-03T11:28:25.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.510+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~FEGX495Q72YY.2 size=258104 2023-12-03T11:28:25.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.510+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=FEGX495Q72YY tag=RU31NVBY2LKQ type=write size=3403832 2023-12-03T11:28:25.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.512+0000 7fe67fa49780 1 < completed write operation key=CC1X1OP7L6BJ tag=YHNOOGFNRA6Y type=write size=168686 2023-12-03T11:28:25.513 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.513+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=ZKJK02GQ2FHN type=del size=239818 2023-12-03T11:28:25.514 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.513+0000 7fe67fa49780 1 < canceled part key=_multipart_URVD2U16EW75.2~UNP2FAV7NGVS.0 size=1048576 2023-12-03T11:28:25.515 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.514+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~UNP2FAV7NGVS.1 size=801301 2023-12-03T11:28:25.516 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.516+0000 7fe67fa49780 1 < canceled multipart upload key=URVD2U16EW75 upload=UNP2FAV7NGVS tag=VVFG5G7W87KX type=write size=2898453 2023-12-03T11:28:25.518 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.517+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=89SZP32FQSLQ type=del size=2768748 2023-12-03T11:28:25.519 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.518+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=9P4I94YF8CCE type=del 2023-12-03T11:28:25.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.519+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=Q90IDPAL45PW type=del size=3505436 2023-12-03T11:28:25.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.519+0000 7fe67fa49780 -1 < no bi entry to suggest for operation key=0G8KNJBJ9K1Z tag=VU2ABR93X2VL type=del size=1144925: (2) No such file or directory 2023-12-03T11:28:25.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.522+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~VU8V7P4SX3FX.0 size=1048576 2023-12-03T11:28:25.523 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.522+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~VU8V7P4SX3FX.1 size=727925 2023-12-03T11:28:25.523 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.522+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=VU8V7P4SX3FX tag=V109MVAKD9DP type=write size=2825077 2023-12-03T11:28:25.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.525+0000 7fe67fa49780 1 < suggested remove operation key=OH2XUEEYL9JO tag=19TNNKM0PE9U type=del 2023-12-03T11:28:25.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.526+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=O1O05SYS3VU4 type=del size=3625081 2023-12-03T11:28:25.528 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.527+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~084AU2ZXEQZH.0 size=1048576 2023-12-03T11:28:25.529 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.528+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~084AU2ZXEQZH.1 size=876905 2023-12-03T11:28:25.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.530+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=084AU2ZXEQZH tag=BX1HKT5EE2GT type=write size=2974057 2023-12-03T11:28:25.532 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.531+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=R901BR27HYRC type=del size=3871516 2023-12-03T11:28:25.535 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.534+0000 7fe67fa49780 1 < suggested remove operation key=URVD2U16EW75 tag=AC9892SDCXOU type=del 2023-12-03T11:28:25.536 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.535+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=EPP7P7RTW5CH type=del size=617720 2023-12-03T11:28:25.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.536+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=WECAMJHQPAK8 type=del 2023-12-03T11:28:25.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.538+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=1RILE94E2GD6 type=del size=2621471 2023-12-03T11:28:25.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.539+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~4UAGQOQYQ0N9.0 size=1048576 2023-12-03T11:28:25.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.540+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~4UAGQOQYQ0N9.1 size=298354 2023-12-03T11:28:25.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.542+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=4UAGQOQYQ0N9 tag=O00WK8I3NZR5 type=write size=2395506 2023-12-03T11:28:25.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.543+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=BASS0Z2ZOGN3 type=del size=1105614 2023-12-03T11:28:25.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.544+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=QN4WH7Q5FAO3 type=del 2023-12-03T11:28:25.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.545+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=DQ0NTJYA2N9F type=del size=3781408 2023-12-03T11:28:25.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.546+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=HBRSSBPBIV39 type=del 2023-12-03T11:28:25.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.547+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=XZW4KPYQ18MM type=del size=3362981 2023-12-03T11:28:25.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.549+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~7LZAJ2TQA1VK.0 size=1048576 2023-12-03T11:28:25.551 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.550+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~7LZAJ2TQA1VK.1 size=1048576 2023-12-03T11:28:25.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.551+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~7LZAJ2TQA1VK.2 size=938240 2023-12-03T11:28:25.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.553+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=7LZAJ2TQA1VK tag=SQVXENUORGIO type=write size=4083968 2023-12-03T11:28:25.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.555+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~MBH7OBI11ZAU.0 size=609539 2023-12-03T11:28:25.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.555+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=MBH7OBI11ZAU tag=MI0Z7ZY3QB0J type=write size=1658115 2023-12-03T11:28:25.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.556+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~7MSQ29EX58I1.0 size=1048576 2023-12-03T11:28:25.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.557+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~7MSQ29EX58I1.1 size=1048576 2023-12-03T11:28:25.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.558+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~7MSQ29EX58I1.2 size=73119 2023-12-03T11:28:25.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.560+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=7MSQ29EX58I1 tag=8JKAUFCDI4FR type=write size=3218847 2023-12-03T11:28:25.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.561+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=WL9WW2N513LR type=del size=2265524 2023-12-03T11:28:25.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.562+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=H51LPQSA82O4 type=del 2023-12-03T11:28:25.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.563+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=SF3BET3AP7T6 type=del size=3462272 2023-12-03T11:28:25.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.565+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~S9LB33NVZAUO.0 size=668052 2023-12-03T11:28:25.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.567+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=S9LB33NVZAUO tag=TO3LQE7N1X8Q type=write size=1716628 2023-12-03T11:28:25.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.568+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=RTPP2EYDTI4B type=del size=2358750 2023-12-03T11:28:25.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.569+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~FEGX495Q72YY.0 size=1048576 2023-12-03T11:28:25.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.570+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~FEGX495Q72YY.1 size=1048576 2023-12-03T11:28:25.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.571+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~FEGX495Q72YY.2 size=258104 2023-12-03T11:28:25.574 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.573+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=FEGX495Q72YY tag=RU31NVBY2LKQ type=write size=3403832 2023-12-03T11:28:25.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.576+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~10XEJSZP09QL.0 size=807466 2023-12-03T11:28:25.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.576+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=10XEJSZP09QL tag=WIDIZYKCE4XA type=write size=1856042 2023-12-03T11:28:25.578 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.577+0000 7fe67fa49780 -1 < failed to complete operation key=OH2XUEEYL9JO tag=ZKJK02GQ2FHN type=del size=239818: (22) Invalid argument 2023-12-03T11:28:25.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.579+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~B9Z6B040158X.0 size=1048576 2023-12-03T11:28:25.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.580+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~B9Z6B040158X.1 size=1048576 2023-12-03T11:28:25.582 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.581+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~B9Z6B040158X.2 size=265616 2023-12-03T11:28:25.582 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.581+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=B9Z6B040158X tag=0VA6MSND8UIJ type=write size=3411344 2023-12-03T11:28:25.583 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.582+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=89SZP32FQSLQ type=del 2023-12-03T11:28:25.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.583+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=GK4QDNNDLMCV type=del size=3733395 2023-12-03T11:28:25.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.584+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=Q90IDPAL45PW type=del 2023-12-03T11:28:25.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.586+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~F8L1MQ523CG3.0 size=194880 2023-12-03T11:28:25.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.586+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=F8L1MQ523CG3 tag=BNFESB5YUG9C type=write size=1243456 2023-12-03T11:28:25.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.588+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~VU8V7P4SX3FX.0 size=1048576 2023-12-03T11:28:25.589 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.588+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~VU8V7P4SX3FX.1 size=727925 2023-12-03T11:28:25.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.590+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=VU8V7P4SX3FX tag=V109MVAKD9DP type=write size=2825077 2023-12-03T11:28:25.594 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.593+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~DVWCDGKU4R0P.0 size=533225 2023-12-03T11:28:25.594 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.593+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=DVWCDGKU4R0P tag=Q34DETE7DHX8 type=write size=1581801 2023-12-03T11:28:25.595 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.594+0000 7fe67fa49780 1 < canceled operation key=KMC5YD2M3I45 tag=O1O05SYS3VU4 type=del size=3625081 2023-12-03T11:28:25.596 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.595+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=QBAWEDW7L18V type=del size=2187877 2023-12-03T11:28:25.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.596+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=R901BR27HYRC type=del 2023-12-03T11:28:25.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.598+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=5P91LPIZ9G2E type=del size=3493880 2023-12-03T11:28:25.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.599+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=EPP7P7RTW5CH type=del 2023-12-03T11:28:25.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.601+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~HX8LUZP0RUJP.0 size=1048576 2023-12-03T11:28:25.603 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.602+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~HX8LUZP0RUJP.1 size=917683 2023-12-03T11:28:25.603 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.602+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=HX8LUZP0RUJP tag=OB2GL9CPF9YE type=write size=3014835 2023-12-03T11:28:25.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.604+0000 7fe67fa49780 1 < suggested update operation key=2GX6IWVZH25N tag=1RILE94E2GD6 type=del size=2621471 2023-12-03T11:28:25.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.606+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=X2J3I5MC1A0F type=del size=2021382 2023-12-03T11:28:25.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.607+0000 7fe67fa49780 1 < canceled operation key=DDHGOWEI7WEI tag=BASS0Z2ZOGN3 type=del size=1105614 2023-12-03T11:28:25.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.609+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~LI870WIO7G0D.0 size=225133 2023-12-03T11:28:25.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.609+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=LI870WIO7G0D tag=HNI2OY0K3G01 type=write size=1273709 2023-12-03T11:28:25.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.610+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=DQ0NTJYA2N9F type=del 2023-12-03T11:28:25.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.612+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=MQMEO0CUDGZI type=write size=955938 2023-12-03T11:28:25.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.613+0000 7fe67fa49780 1 < canceled operation key=Q6GBIBMIJRKV tag=XZW4KPYQ18MM type=del size=3362981 2023-12-03T11:28:25.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.614+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=9KW9XDVJV5BI type=del size=3184588 2023-12-03T11:28:25.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.614+0000 7fe67fa49780 1 < canceled part key=_multipart_PFBGR7OF7JQG.2~MBH7OBI11ZAU.0 size=609539 2023-12-03T11:28:25.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.617+0000 7fe67fa49780 1 < canceled multipart upload key=PFBGR7OF7JQG upload=MBH7OBI11ZAU tag=MI0Z7ZY3QB0J type=write size=1658115 2023-12-03T11:28:25.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.618+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=00KJGNIY95B6 type=del size=3492911 2023-12-03T11:28:25.622 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.621+0000 7fe67fa49780 1 < suggested update operation key=2GX6IWVZH25N tag=WL9WW2N513LR type=del size=2265524 2023-12-03T11:28:25.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.622+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=PF9BIYC53PCR type=write size=533336 2023-12-03T11:28:25.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.623+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=SF3BET3AP7T6 type=del 2023-12-03T11:28:25.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.624+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=0GRGQ3H1UK2X type=del size=864410 2023-12-03T11:28:25.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.626+0000 7fe67fa49780 1 < canceled operation key=0G8KNJBJ9K1Z tag=RTPP2EYDTI4B type=del size=2358750 2023-12-03T11:28:25.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.628+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~N0XZAIY7SXG2.0 size=1048576 2023-12-03T11:28:25.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.629+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~N0XZAIY7SXG2.1 size=432990 2023-12-03T11:28:25.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.629+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=N0XZAIY7SXG2 tag=HLJTJO0M3X8F type=write size=2530142 2023-12-03T11:28:25.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.630+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~10XEJSZP09QL.0 size=807466 2023-12-03T11:28:25.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.632+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=10XEJSZP09QL tag=WIDIZYKCE4XA type=write size=1856042 2023-12-03T11:28:25.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.634+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~O8ODJCFW23YB.0 size=1048576 2023-12-03T11:28:25.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.635+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~O8ODJCFW23YB.1 size=1048576 2023-12-03T11:28:25.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.636+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~O8ODJCFW23YB.2 size=489557 2023-12-03T11:28:25.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.636+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=O8ODJCFW23YB tag=0AHNRVPYG68L type=write size=3635285 2023-12-03T11:28:25.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.637+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~B9Z6B040158X.0 size=1048576 2023-12-03T11:28:25.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.638+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~B9Z6B040158X.1 size=1048576 2023-12-03T11:28:25.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.639+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~B9Z6B040158X.2 size=265616 2023-12-03T11:28:25.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.641+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=B9Z6B040158X tag=0VA6MSND8UIJ type=write size=3411344 2023-12-03T11:28:25.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.642+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=E3GKBUHIZGGU type=write size=739635 2023-12-03T11:28:25.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.643+0000 7fe67fa49780 1 < canceled operation key=DDHGOWEI7WEI tag=GK4QDNNDLMCV type=del size=3733395 2023-12-03T11:28:25.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.645+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=4IH57UBR3LR5 type=del size=173805 2023-12-03T11:28:25.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.645+0000 7fe67fa49780 1 < canceled part key=_multipart_PFBGR7OF7JQG.2~F8L1MQ523CG3.0 size=194880 2023-12-03T11:28:25.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.647+0000 7fe67fa49780 1 < canceled multipart upload key=PFBGR7OF7JQG upload=F8L1MQ523CG3 tag=BNFESB5YUG9C type=write size=1243456 2023-12-03T11:28:25.650 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.649+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~9NUHX9CI6AI2.0 size=617647 2023-12-03T11:28:25.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.649+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=9NUHX9CI6AI2 tag=ZHOFBLI9VB0R type=write size=1666223 2023-12-03T11:28:25.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.650+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~DVWCDGKU4R0P.0 size=533225 2023-12-03T11:28:25.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.652+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=DVWCDGKU4R0P tag=Q34DETE7DHX8 type=write size=1581801 2023-12-03T11:28:25.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.653+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=Q4DD6A8HLEKZ type=write size=159072 2023-12-03T11:28:25.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.656+0000 7fe67fa49780 1 < suggested update operation key=Y0VRZR6S8FP6 tag=QBAWEDW7L18V type=del size=2187877 2023-12-03T11:28:25.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.658+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~GCSCANBP70EV.0 size=1048576 2023-12-03T11:28:25.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.659+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~GCSCANBP70EV.1 size=263690 2023-12-03T11:28:25.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.659+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=GCSCANBP70EV tag=UYM90T55I1DE type=write size=2360842 2023-12-03T11:28:25.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.661+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=5P91LPIZ9G2E type=del 2023-12-03T11:28:25.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.663+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~P86YRAESDF0M.0 size=864903 2023-12-03T11:28:25.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.663+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=P86YRAESDF0M tag=OL63W062AJJR type=write size=1913479 2023-12-03T11:28:25.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.664+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~HX8LUZP0RUJP.0 size=1048576 2023-12-03T11:28:25.666 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.665+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~HX8LUZP0RUJP.1 size=917683 2023-12-03T11:28:25.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.667+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=HX8LUZP0RUJP tag=OB2GL9CPF9YE type=write size=3014835 2023-12-03T11:28:25.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.669+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~V7ACPE46VP5Q.0 size=1048576 2023-12-03T11:28:25.671 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.670+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~V7ACPE46VP5Q.1 size=180447 2023-12-03T11:28:25.671 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.670+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=V7ACPE46VP5Q tag=9UCGZRLP13XI type=write size=2277599 2023-12-03T11:28:25.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.672+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=X2J3I5MC1A0F type=del 2023-12-03T11:28:25.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.674+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~YC25B17BN8VA.0 size=832825 2023-12-03T11:28:25.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.674+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=YC25B17BN8VA tag=EWRMPVCOO6DC type=write size=1881401 2023-12-03T11:28:25.676 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.675+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~LI870WIO7G0D.0 size=225133 2023-12-03T11:28:25.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.679+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=LI870WIO7G0D tag=HNI2OY0K3G01 type=write size=1273709 2023-12-03T11:28:25.681 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.680+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=CZUGYLHAOTWF type=del size=2988831 2023-12-03T11:28:25.684 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.683+0000 7fe67fa49780 1 < suggested update operation key=A7GOX2W0WB83 tag=MQMEO0CUDGZI type=write size=955938 2023-12-03T11:28:25.685 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.684+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=0Q1KHCXW4DWI type=del size=1334063 2023-12-03T11:28:25.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.687+0000 7fe67fa49780 1 < suggested remove operation key=OH2XUEEYL9JO tag=9KW9XDVJV5BI type=del 2023-12-03T11:28:25.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.688+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=28SNI3HPBXJG type=write size=812276 2023-12-03T11:28:25.690 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.689+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=00KJGNIY95B6 type=del 2023-12-03T11:28:25.691 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.690+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=KQNFWHCXGOSC type=del size=3528071 2023-12-03T11:28:25.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.692+0000 7fe67fa49780 1 < completed write operation key=URVD2U16EW75 tag=PF9BIYC53PCR type=write size=533336 2023-12-03T11:28:25.694 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.693+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=KYJV30Q3GBQ7 type=del size=3701753 2023-12-03T11:28:25.695 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.694+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=0GRGQ3H1UK2X type=del 2023-12-03T11:28:25.696 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.696+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=0IA12T341HXE type=del size=2988432 2023-12-03T11:28:25.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.697+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~N0XZAIY7SXG2.0 size=1048576 2023-12-03T11:28:25.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.698+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~N0XZAIY7SXG2.1 size=432990 2023-12-03T11:28:25.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.700+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=N0XZAIY7SXG2 tag=HLJTJO0M3X8F type=write size=2530142 2023-12-03T11:28:25.702 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.702+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~AQE3A8JWIAFX.0 size=595574 2023-12-03T11:28:25.703 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.702+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=AQE3A8JWIAFX tag=LKCZ0IJ7DGOX type=write size=1644150 2023-12-03T11:28:25.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.703+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~O8ODJCFW23YB.0 size=1048576 2023-12-03T11:28:25.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.704+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~O8ODJCFW23YB.1 size=1048576 2023-12-03T11:28:25.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.705+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~O8ODJCFW23YB.2 size=489557 2023-12-03T11:28:25.708 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.707+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=O8ODJCFW23YB tag=0AHNRVPYG68L type=write size=3635285 2023-12-03T11:28:25.710 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.709+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~8LU9RKGOOW1Y.0 size=838445 2023-12-03T11:28:25.710 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.709+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=8LU9RKGOOW1Y tag=NUAOTM05HKD3 type=write size=1887021 2023-12-03T11:28:25.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.711+0000 7fe67fa49780 1 < completed write operation key=9AUO0SRFTAUJ tag=E3GKBUHIZGGU type=write size=739635 2023-12-03T11:28:25.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.712+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=NPOA9E6HQUBL type=del size=137318 2023-12-03T11:28:25.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.714+0000 7fe67fa49780 1 < suggested update operation key=9OD4G28SDLB4 tag=4IH57UBR3LR5 type=del size=173805 2023-12-03T11:28:25.716 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.715+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=TF76URSZOUIU type=write size=800879 2023-12-03T11:28:25.718 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.717+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~9NUHX9CI6AI2.0 size=617647 2023-12-03T11:28:25.720 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.719+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=9NUHX9CI6AI2 tag=ZHOFBLI9VB0R type=write size=1666223 2023-12-03T11:28:25.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.721+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~VH6M13KEL655.0 size=1048576 2023-12-03T11:28:25.723 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.722+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~VH6M13KEL655.1 size=164717 2023-12-03T11:28:25.723 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.722+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=VH6M13KEL655 tag=UWWPBQYF0HZ5 type=write size=2261869 2023-12-03T11:28:25.725 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.724+0000 7fe67fa49780 1 < completed write operation key=XZHCD4R4EVZR tag=Q4DD6A8HLEKZ type=write size=159072 2023-12-03T11:28:25.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.725+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=NLHJ6N3LZBH8 type=del size=2259097 2023-12-03T11:28:25.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.726+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~GCSCANBP70EV.0 size=1048576 2023-12-03T11:28:25.728 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.727+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~GCSCANBP70EV.1 size=263690 2023-12-03T11:28:25.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.729+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=GCSCANBP70EV tag=UYM90T55I1DE type=write size=2360842 2023-12-03T11:28:25.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.731+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=2FHY373356HF type=del size=1322755 2023-12-03T11:28:25.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.731+0000 7fe67fa49780 1 < canceled part key=_multipart_PFBGR7OF7JQG.2~P86YRAESDF0M.0 size=864903 2023-12-03T11:28:25.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.734+0000 7fe67fa49780 1 < canceled multipart upload key=PFBGR7OF7JQG upload=P86YRAESDF0M tag=OL63W062AJJR type=write size=1913479 2023-12-03T11:28:25.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.735+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=F013PWO1RNE9 type=del size=2345116 2023-12-03T11:28:25.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.736+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~V7ACPE46VP5Q.0 size=1048576 2023-12-03T11:28:25.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.737+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~V7ACPE46VP5Q.1 size=180447 2023-12-03T11:28:25.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.739+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=V7ACPE46VP5Q tag=9UCGZRLP13XI type=write size=2277599 2023-12-03T11:28:25.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.740+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=8W33J77UYYDY type=del size=2116559 2023-12-03T11:28:25.742 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.741+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~YC25B17BN8VA.0 size=832825 2023-12-03T11:28:25.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.743+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=YC25B17BN8VA tag=EWRMPVCOO6DC type=write size=1881401 2023-12-03T11:28:25.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.744+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=3UCOMHSVMP3Q type=del size=3933134 2023-12-03T11:28:25.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.746+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=CZUGYLHAOTWF type=del 2023-12-03T11:28:25.749 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.748+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~LBIW9KI0DF87.0 size=1048576 2023-12-03T11:28:25.750 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.749+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~LBIW9KI0DF87.1 size=1048576 2023-12-03T11:28:25.751 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.750+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~LBIW9KI0DF87.2 size=1027300 2023-12-03T11:28:25.751 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.750+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=LBIW9KI0DF87 tag=L9VBK6JUVZ53 type=write size=4173028 2023-12-03T11:28:25.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.751+0000 7fe67fa49780 1 < canceled operation key=UL24DVOA31Y7 tag=0Q1KHCXW4DWI type=del size=1334063 2023-12-03T11:28:25.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.752+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=5PGL72DC9OFK type=del size=340797 2023-12-03T11:28:25.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.753+0000 7fe67fa49780 1 < completed write operation key=006X4CSXV0KA tag=28SNI3HPBXJG type=write size=812276 2023-12-03T11:28:25.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.755+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=YER1I0FHMEY3 type=del size=1792937 2023-12-03T11:28:25.757 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.756+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=KQNFWHCXGOSC type=del 2023-12-03T11:28:25.758 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.757+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=CZZQO8UUKIG7 type=del size=3823015 2023-12-03T11:28:25.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.760+0000 7fe67fa49780 1 < suggested remove operation key=URVD2U16EW75 tag=KYJV30Q3GBQ7 type=del 2023-12-03T11:28:25.762 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.761+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=U8HPUDI72ONT type=del size=570460 2023-12-03T11:28:25.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.762+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=0IA12T341HXE type=del 2023-12-03T11:28:25.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.764+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~6GRSR5Z4LM22.0 size=1048576 2023-12-03T11:28:25.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.765+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~6GRSR5Z4LM22.1 size=645641 2023-12-03T11:28:25.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.765+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=6GRSR5Z4LM22 tag=EIYIIPEERJLF type=write size=2742793 2023-12-03T11:28:25.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.766+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~AQE3A8JWIAFX.0 size=595574 2023-12-03T11:28:25.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.768+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=AQE3A8JWIAFX tag=LKCZ0IJ7DGOX type=write size=1644150 2023-12-03T11:28:25.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.769+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=XKA1UXNRYEBW type=del size=4002555 2023-12-03T11:28:25.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.771+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~8LU9RKGOOW1Y.0 size=838445 2023-12-03T11:28:25.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.772+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=8LU9RKGOOW1Y tag=NUAOTM05HKD3 type=write size=1887021 2023-12-03T11:28:25.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.774+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=L1BFN82K9QFD type=del size=820924 2023-12-03T11:28:25.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.775+0000 7fe67fa49780 1 < canceled operation key=IIW1Y6QYEODQ tag=NPOA9E6HQUBL type=del size=137318 2023-12-03T11:28:25.777 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.776+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=86DSQJCFSO9E type=del size=1758367 2023-12-03T11:28:25.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.778+0000 7fe67fa49780 1 < suggested update operation key=Y0VRZR6S8FP6 tag=TF76URSZOUIU type=write size=800879 2023-12-03T11:28:25.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.780+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=W63TDMV77501 type=del size=1379831 2023-12-03T11:28:25.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.782+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~VH6M13KEL655.0 size=1048576 2023-12-03T11:28:25.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.783+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~VH6M13KEL655.1 size=164717 2023-12-03T11:28:25.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.784+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=VH6M13KEL655 tag=UWWPBQYF0HZ5 type=write size=2261869 2023-12-03T11:28:25.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.786+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~70HD7ESC42DC.0 size=1048576 2023-12-03T11:28:25.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.787+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~70HD7ESC42DC.1 size=934824 2023-12-03T11:28:25.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.787+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=70HD7ESC42DC tag=SRNAKE6C25FB type=write size=3031976 2023-12-03T11:28:25.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.788+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=NLHJ6N3LZBH8 type=del 2023-12-03T11:28:25.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.791+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~TBNWY5PH3CV1.0 size=224949 2023-12-03T11:28:25.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.791+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=TBNWY5PH3CV1 tag=0346NK1NUDVS type=write size=1273525 2023-12-03T11:28:25.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.793+0000 7fe67fa49780 1 < suggested update operation key=ASODFGLQ5VNY tag=2FHY373356HF type=del size=1322755 2023-12-03T11:28:25.796 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.795+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~PV5FQV9L9ES6.0 size=1048576 2023-12-03T11:28:25.797 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.796+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~PV5FQV9L9ES6.1 size=1048576 2023-12-03T11:28:25.798 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.797+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~PV5FQV9L9ES6.2 size=719419 2023-12-03T11:28:25.798 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.797+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=PV5FQV9L9ES6 tag=804RLITH6CT5 type=write size=3865147 2023-12-03T11:28:25.799 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.798+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=F013PWO1RNE9 type=del 2023-12-03T11:28:25.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.800+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~RCYA4WZRBTR0.0 size=245166 2023-12-03T11:28:25.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.800+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=RCYA4WZRBTR0 tag=I3IY1WCAF8GF type=write size=1293742 2023-12-03T11:28:25.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.801+0000 7fe67fa49780 1 < canceled operation key=CIB1NZHJGO46 tag=8W33J77UYYDY type=del size=2116559 2023-12-03T11:28:25.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.803+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~1GKNL24O5B6S.0 size=1048576 2023-12-03T11:28:25.805 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.804+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~1GKNL24O5B6S.1 size=1048576 2023-12-03T11:28:25.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.805+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~1GKNL24O5B6S.2 size=1007384 2023-12-03T11:28:25.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.805+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=1GKNL24O5B6S tag=E7CP3Z2IBZOM type=write size=4153112 2023-12-03T11:28:25.807 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.806+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=3UCOMHSVMP3Q type=del 2023-12-03T11:28:25.809 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.808+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=06XTBMH6BR13 type=del size=111128 2023-12-03T11:28:25.810 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.809+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~LBIW9KI0DF87.0 size=1048576 2023-12-03T11:28:25.811 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.810+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~LBIW9KI0DF87.1 size=1048576 2023-12-03T11:28:25.812 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.811+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~LBIW9KI0DF87.2 size=1027300 2023-12-03T11:28:25.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.813+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=LBIW9KI0DF87 tag=L9VBK6JUVZ53 type=write size=4173028 2023-12-03T11:28:25.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.815+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~ZAK9Q48SXNFR.0 size=1048576 2023-12-03T11:28:25.817 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.816+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~ZAK9Q48SXNFR.1 size=45577 2023-12-03T11:28:25.817 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.816+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=ZAK9Q48SXNFR tag=LHACVBN611YO type=write size=2142729 2023-12-03T11:28:25.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.817+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=5PGL72DC9OFK type=del 2023-12-03T11:28:25.819 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.818+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=NGFP96BDRW5H type=del size=2748083 2023-12-03T11:28:25.820 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.820+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=YER1I0FHMEY3 type=del 2023-12-03T11:28:25.822 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.821+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=R7QTL3133WZ0 type=del size=4194279 2023-12-03T11:28:25.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.822+0000 7fe67fa49780 1 < canceled operation key=Z1NFEIZNYYO2 tag=CZZQO8UUKIG7 type=del size=3823015 2023-12-03T11:28:25.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.823+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=E4CQ0RYH6C7J type=del size=1923720 2023-12-03T11:28:25.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.824+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=U8HPUDI72ONT type=del 2023-12-03T11:28:25.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.825+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=JXE8G03U8T67 type=del size=1968910 2023-12-03T11:28:25.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.827+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~6GRSR5Z4LM22.0 size=1048576 2023-12-03T11:28:25.831 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.828+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~6GRSR5Z4LM22.1 size=645641 2023-12-03T11:28:25.831 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.830+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=6GRSR5Z4LM22 tag=EIYIIPEERJLF type=write size=2742793 2023-12-03T11:28:25.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.831+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=P79UL59MJUWU type=del size=976125 2023-12-03T11:28:25.833 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.832+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=XKA1UXNRYEBW type=del 2023-12-03T11:28:25.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.833+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=QS1Q7CYYCLDE type=del size=1698610 2023-12-03T11:28:25.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.835+0000 7fe67fa49780 1 < suggested remove operation key=0GQZY07Y2PVI tag=L1BFN82K9QFD type=del 2023-12-03T11:28:25.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.837+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=TDTX4QJSJW85 type=del size=2395669 2023-12-03T11:28:25.839 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.838+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=86DSQJCFSO9E type=del 2023-12-03T11:28:25.841 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.840+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~JF4S79Z8X0EW.0 size=417640 2023-12-03T11:28:25.841 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.840+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=JF4S79Z8X0EW tag=XEU8VZJFMN4J type=write size=1466216 2023-12-03T11:28:25.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.841+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=W63TDMV77501 type=del 2023-12-03T11:28:25.844 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.843+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~H3GYTSBZGQ53.0 size=35416 2023-12-03T11:28:25.844 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.843+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=H3GYTSBZGQ53 tag=C40LGALAQLJV type=write size=1083992 2023-12-03T11:28:25.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.845+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~70HD7ESC42DC.0 size=1048576 2023-12-03T11:28:25.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.846+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~70HD7ESC42DC.1 size=934824 2023-12-03T11:28:25.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.848+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=70HD7ESC42DC tag=SRNAKE6C25FB type=write size=3031976 2023-12-03T11:28:25.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.849+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=7H14OZ0ROJ5I type=write size=934939 2023-12-03T11:28:25.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.849+0000 7fe67fa49780 1 < canceled part key=_multipart_Y0VRZR6S8FP6.2~TBNWY5PH3CV1.0 size=224949 2023-12-03T11:28:25.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.851+0000 7fe67fa49780 1 < canceled multipart upload key=Y0VRZR6S8FP6 upload=TBNWY5PH3CV1 tag=0346NK1NUDVS type=write size=1273525 2023-12-03T11:28:25.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.853+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~PR4FNUDJIH61.0 size=1048576 2023-12-03T11:28:25.855 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.854+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~PR4FNUDJIH61.1 size=1048576 2023-12-03T11:28:25.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.855+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~PR4FNUDJIH61.2 size=985186 2023-12-03T11:28:25.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.855+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=PR4FNUDJIH61 tag=1J324O47PJ7K type=write size=4130914 2023-12-03T11:28:25.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.856+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~PV5FQV9L9ES6.0 size=1048576 2023-12-03T11:28:25.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.857+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~PV5FQV9L9ES6.1 size=1048576 2023-12-03T11:28:25.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.858+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~PV5FQV9L9ES6.2 size=719419 2023-12-03T11:28:25.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.860+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=PV5FQV9L9ES6 tag=804RLITH6CT5 type=write size=3865147 2023-12-03T11:28:25.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.861+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=N42AV20SQR9Z type=del size=3788602 2023-12-03T11:28:25.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.862+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~RCYA4WZRBTR0.0 size=245166 2023-12-03T11:28:25.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.864+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=RCYA4WZRBTR0 tag=I3IY1WCAF8GF type=write size=1293742 2023-12-03T11:28:25.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.865+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=R943K970060Y type=del size=3892136 2023-12-03T11:28:25.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.866+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~1GKNL24O5B6S.0 size=1048576 2023-12-03T11:28:25.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.866+0000 7fe67fa49780 1 < canceled part key=_multipart_6LQ18VAE3ZN6.2~1GKNL24O5B6S.1 size=1048576 2023-12-03T11:28:25.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.866+0000 7fe67fa49780 1 < canceled part key=_multipart_6LQ18VAE3ZN6.2~1GKNL24O5B6S.2 size=1007384 2023-12-03T11:28:25.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.868+0000 7fe67fa49780 1 < canceled multipart upload key=6LQ18VAE3ZN6 upload=1GKNL24O5B6S tag=E7CP3Z2IBZOM type=write size=4153112 2023-12-03T11:28:25.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.870+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=94OD5456Z7S9 type=del size=3166173 2023-12-03T11:28:25.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.871+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=06XTBMH6BR13 type=del 2023-12-03T11:28:25.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.872+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=GPFYJ5JDI4U6 type=del size=2400510 2023-12-03T11:28:25.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.873+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~ZAK9Q48SXNFR.0 size=1048576 2023-12-03T11:28:25.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.873+0000 7fe67fa49780 1 < canceled part key=_multipart_6LQ18VAE3ZN6.2~ZAK9Q48SXNFR.1 size=45577 2023-12-03T11:28:25.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.875+0000 7fe67fa49780 1 < canceled multipart upload key=6LQ18VAE3ZN6 upload=ZAK9Q48SXNFR tag=LHACVBN611YO type=write size=2142729 2023-12-03T11:28:25.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.876+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=Z9OYXOMBTJPC type=del size=1534722 2023-12-03T11:28:25.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.877+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=NGFP96BDRW5H type=del 2023-12-03T11:28:25.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.879+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~SY432WDCLBII.0 size=1048576 2023-12-03T11:28:25.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.880+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~SY432WDCLBII.1 size=1048576 2023-12-03T11:28:25.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.881+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~SY432WDCLBII.2 size=59591 2023-12-03T11:28:25.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.881+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=SY432WDCLBII tag=L7V6EWF6CERS type=write size=3205319 2023-12-03T11:28:25.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.882+0000 7fe67fa49780 -1 < failed to complete operation key=0GQZY07Y2PVI tag=R7QTL3133WZ0 type=del size=4194279: (22) Invalid argument 2023-12-03T11:28:25.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.883+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=OF8PE3N97LVR type=write size=85262 2023-12-03T11:28:25.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.884+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=E4CQ0RYH6C7J type=del 2023-12-03T11:28:25.888 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.887+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~QXUSA8B669PJ.0 size=1048576 2023-12-03T11:28:25.888 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.887+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~QXUSA8B669PJ.1 size=1048576 2023-12-03T11:28:25.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.888+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~QXUSA8B669PJ.2 size=878521 2023-12-03T11:28:25.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.888+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=QXUSA8B669PJ tag=MR1TLGF47ARR type=write size=4024249 2023-12-03T11:28:25.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.890+0000 7fe67fa49780 1 < canceled operation key=V9ZVWHO8IF8L tag=JXE8G03U8T67 type=del size=1968910 2023-12-03T11:28:25.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.892+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~9Q06KBFZZC65.0 size=1048576 2023-12-03T11:28:25.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.892+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~9Q06KBFZZC65.1 size=938360 2023-12-03T11:28:25.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.892+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=9Q06KBFZZC65 tag=ZT3UQ11MURI8 type=write size=3035512 2023-12-03T11:28:25.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.894+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=P79UL59MJUWU type=del 2023-12-03T11:28:25.896 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.895+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=4PVBQNK2ALZI type=del size=1580721 2023-12-03T11:28:25.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.896+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=QS1Q7CYYCLDE type=del 2023-12-03T11:28:25.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.898+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~I66B13G4JYW5.0 size=1048576 2023-12-03T11:28:25.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.899+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~I66B13G4JYW5.1 size=1048576 2023-12-03T11:28:25.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.900+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~I66B13G4JYW5.2 size=1000721 2023-12-03T11:28:25.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.900+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=I66B13G4JYW5 tag=AWL0SXC02784 type=write size=4146449 2023-12-03T11:28:25.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.901+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=TDTX4QJSJW85 type=del 2023-12-03T11:28:25.904 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.903+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~I5VA3H4Y1HWA.0 size=1048576 2023-12-03T11:28:25.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.904+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~I5VA3H4Y1HWA.1 size=670246 2023-12-03T11:28:25.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.904+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=I5VA3H4Y1HWA tag=GOBYYC1G2ZO8 type=write size=2767398 2023-12-03T11:28:25.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.905+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~JF4S79Z8X0EW.0 size=417640 2023-12-03T11:28:25.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.907+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=JF4S79Z8X0EW tag=XEU8VZJFMN4J type=write size=1466216 2023-12-03T11:28:25.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.909+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~GU8JRTFVAPXM.0 size=98906 2023-12-03T11:28:25.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.909+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=GU8JRTFVAPXM tag=T3TE4RDV3MQL type=write size=1147482 2023-12-03T11:28:25.911 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.910+0000 7fe67fa49780 1 < canceled part key=_multipart_P05UIP1IU4Z7.2~H3GYTSBZGQ53.0 size=35416 2023-12-03T11:28:25.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.911+0000 7fe67fa49780 1 < canceled multipart upload key=P05UIP1IU4Z7 upload=H3GYTSBZGQ53 tag=C40LGALAQLJV type=write size=1083992 2023-12-03T11:28:25.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.913+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=J4REG0MDQTWB type=del size=3780587 2023-12-03T11:28:25.915 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.914+0000 7fe67fa49780 1 < completed write operation key=A7GOX2W0WB83 tag=7H14OZ0ROJ5I type=write size=934939 2023-12-03T11:28:25.917 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.916+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~IBYHE37DQGCZ.0 size=411654 2023-12-03T11:28:25.917 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.916+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=IBYHE37DQGCZ tag=IX8GWFOJYGFV type=write size=1460230 2023-12-03T11:28:25.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.917+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~PR4FNUDJIH61.0 size=1048576 2023-12-03T11:28:25.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.918+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~PR4FNUDJIH61.1 size=1048576 2023-12-03T11:28:25.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.919+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~PR4FNUDJIH61.2 size=985186 2023-12-03T11:28:25.922 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.921+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=PR4FNUDJIH61 tag=1J324O47PJ7K type=write size=4130914 2023-12-03T11:28:25.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.922+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=RQG2OY38GTUU type=write size=919327 2023-12-03T11:28:25.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.924+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=N42AV20SQR9Z type=del 2023-12-03T11:28:25.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.926+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~2ZN816F1CZYE.0 size=1048576 2023-12-03T11:28:25.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.927+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~2ZN816F1CZYE.1 size=1048576 2023-12-03T11:28:25.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.928+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~2ZN816F1CZYE.2 size=413481 2023-12-03T11:28:25.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.928+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=2ZN816F1CZYE tag=LCXN464TGZUI type=write size=3559209 2023-12-03T11:28:25.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.930+0000 7fe67fa49780 1 < suggested remove operation key=UL24DVOA31Y7 tag=R943K970060Y type=del 2023-12-03T11:28:25.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.932+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~A32EEMCJUEOC.0 size=1048576 2023-12-03T11:28:25.934 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.933+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~A32EEMCJUEOC.1 size=545726 2023-12-03T11:28:25.934 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.933+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=A32EEMCJUEOC tag=XES5H3J1PF8Q type=write size=2642878 2023-12-03T11:28:25.935 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.934+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=94OD5456Z7S9 type=del 2023-12-03T11:28:25.936 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.935+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=RN74RNIPKXA8 type=del size=3399266 2023-12-03T11:28:25.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.937+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=GPFYJ5JDI4U6 type=del 2023-12-03T11:28:25.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.939+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~OXXFRQ3JKHP1.0 size=1048576 2023-12-03T11:28:25.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.940+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~OXXFRQ3JKHP1.1 size=546866 2023-12-03T11:28:25.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.940+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=OXXFRQ3JKHP1 tag=JO4OIBL6PD6B type=write size=2644018 2023-12-03T11:28:25.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.942+0000 7fe67fa49780 1 < suggested update operation key=YEMPVKMDANPG tag=Z9OYXOMBTJPC type=del size=1534722 2023-12-03T11:28:25.944 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.943+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=NTPTEO4QEQ5R type=del size=2427945 2023-12-03T11:28:25.945 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.944+0000 7fe67fa49780 1 < canceled part key=_multipart_DDHGOWEI7WEI.2~SY432WDCLBII.0 size=1048576 2023-12-03T11:28:25.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.945+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~SY432WDCLBII.1 size=1048576 2023-12-03T11:28:25.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.946+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~SY432WDCLBII.2 size=59591 2023-12-03T11:28:25.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.947+0000 7fe67fa49780 1 < canceled multipart upload key=DDHGOWEI7WEI upload=SY432WDCLBII tag=L7V6EWF6CERS type=write size=3205319 2023-12-03T11:28:25.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.949+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=Q3FZM60LJBPP type=del size=4178341 2023-12-03T11:28:25.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.950+0000 7fe67fa49780 1 < completed write operation key=2GX6IWVZH25N tag=OF8PE3N97LVR type=write size=85262 2023-12-03T11:28:25.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.953+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~L9PW05SSBTC4.0 size=124350 2023-12-03T11:28:25.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.953+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=L9PW05SSBTC4 tag=1F3GJ61WTL0M type=write size=1172926 2023-12-03T11:28:25.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.954+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~QXUSA8B669PJ.0 size=1048576 2023-12-03T11:28:25.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.955+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~QXUSA8B669PJ.1 size=1048576 2023-12-03T11:28:25.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.956+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~QXUSA8B669PJ.2 size=878521 2023-12-03T11:28:25.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.958+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=QXUSA8B669PJ tag=MR1TLGF47ARR type=write size=4024249 2023-12-03T11:28:25.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.959+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=YJVBMT3XHHH5 type=del size=3918822 2023-12-03T11:28:25.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.960+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~9Q06KBFZZC65.0 size=1048576 2023-12-03T11:28:25.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.961+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~9Q06KBFZZC65.1 size=938360 2023-12-03T11:28:25.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.963+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=9Q06KBFZZC65 tag=ZT3UQ11MURI8 type=write size=3035512 2023-12-03T11:28:25.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.965+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=E9KX46PMY3OX type=del size=244636 2023-12-03T11:28:25.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.966+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=4PVBQNK2ALZI type=del 2023-12-03T11:28:25.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.969+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~CUF39K9IDJY9.0 size=1048576 2023-12-03T11:28:25.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.969+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~CUF39K9IDJY9.1 size=1048576 2023-12-03T11:28:25.973 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.970+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~CUF39K9IDJY9.2 size=812717 2023-12-03T11:28:25.973 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.970+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=CUF39K9IDJY9 tag=XNMGF2XQRJBH type=write size=3958445 2023-12-03T11:28:25.973 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.972+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~I66B13G4JYW5.0 size=1048576 2023-12-03T11:28:25.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.973+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~I66B13G4JYW5.1 size=1048576 2023-12-03T11:28:25.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.974+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~I66B13G4JYW5.2 size=1000721 2023-12-03T11:28:25.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.976+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=I66B13G4JYW5 tag=AWL0SXC02784 type=write size=4146449 2023-12-03T11:28:25.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.977+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=19BDPIY1UC86 type=del size=2094488 2023-12-03T11:28:25.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.978+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~I5VA3H4Y1HWA.0 size=1048576 2023-12-03T11:28:25.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.979+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~I5VA3H4Y1HWA.1 size=670246 2023-12-03T11:28:25.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.981+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=I5VA3H4Y1HWA tag=GOBYYC1G2ZO8 type=write size=2767398 2023-12-03T11:28:25.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.983+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~FEIK0ZHZQ3ZA.0 size=232617 2023-12-03T11:28:25.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.983+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=FEIK0ZHZQ3ZA tag=8Q0KHJTIPZ6M type=write size=1281193 2023-12-03T11:28:25.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.984+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~GU8JRTFVAPXM.0 size=98906 2023-12-03T11:28:25.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.988+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=GU8JRTFVAPXM tag=T3TE4RDV3MQL type=write size=1147482 2023-12-03T11:28:25.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.989+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=LRQZSP9ZIR6L type=del size=1430879 2023-12-03T11:28:25.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.990+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=J4REG0MDQTWB type=del 2023-12-03T11:28:25.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.991+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=LV11I2XD6B2Y type=del size=1285356 2023-12-03T11:28:25.993 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.992+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~IBYHE37DQGCZ.0 size=411654 2023-12-03T11:28:25.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.994+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=IBYHE37DQGCZ tag=IX8GWFOJYGFV type=write size=1460230 2023-12-03T11:28:25.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.995+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=APN2QEPZGZPG type=del size=2810153 2023-12-03T11:28:25.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.997+0000 7fe67fa49780 1 < completed write operation key=2GX6IWVZH25N tag=RQG2OY38GTUU type=write size=919327 2023-12-03T11:28:25.999 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.998+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=79A1VS4P05PY type=del size=1173672 2023-12-03T11:28:26.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:25.999+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~2ZN816F1CZYE.0 size=1048576 2023-12-03T11:28:26.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.000+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~2ZN816F1CZYE.1 size=1048576 2023-12-03T11:28:26.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.001+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~2ZN816F1CZYE.2 size=413481 2023-12-03T11:28:26.004 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.003+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=2ZN816F1CZYE tag=LCXN464TGZUI type=write size=3559209 2023-12-03T11:28:26.005 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.004+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=OD7MVTVABZ83 type=write size=13879 2023-12-03T11:28:26.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.005+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~A32EEMCJUEOC.0 size=1048576 2023-12-03T11:28:26.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.006+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~A32EEMCJUEOC.1 size=545726 2023-12-03T11:28:26.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.008+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=A32EEMCJUEOC tag=XES5H3J1PF8Q type=write size=2642878 2023-12-03T11:28:26.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.009+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=OYCMCA7SD8P1 type=del size=2856422 2023-12-03T11:28:26.012 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.011+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=RN74RNIPKXA8 type=del 2023-12-03T11:28:26.014 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.013+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~ZB1EH6ZH1K6G.0 size=1048576 2023-12-03T11:28:26.015 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.014+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~ZB1EH6ZH1K6G.1 size=1048576 2023-12-03T11:28:26.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.015+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~ZB1EH6ZH1K6G.2 size=29870 2023-12-03T11:28:26.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.015+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=ZB1EH6ZH1K6G tag=CT3PP2O9HJX6 type=write size=3175598 2023-12-03T11:28:26.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.015+0000 7fe67fa49780 1 < canceled part key=_multipart_YEMPVKMDANPG.2~OXXFRQ3JKHP1.0 size=1048576 2023-12-03T11:28:26.017 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.016+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~OXXFRQ3JKHP1.1 size=546866 2023-12-03T11:28:26.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.018+0000 7fe67fa49780 1 < canceled multipart upload key=YEMPVKMDANPG upload=OXXFRQ3JKHP1 tag=JO4OIBL6PD6B type=write size=2644018 2023-12-03T11:28:26.020 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.019+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=NGHLR2QUSO5X type=del size=1314565 2023-12-03T11:28:26.021 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.020+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=NTPTEO4QEQ5R type=del 2023-12-03T11:28:26.023 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.022+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~YPZ1M160BKRV.0 size=164854 2023-12-03T11:28:26.023 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.022+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=YPZ1M160BKRV tag=5NBQENB6WC5E type=write size=1213430 2023-12-03T11:28:26.024 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.023+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=Q3FZM60LJBPP type=del 2023-12-03T11:28:26.025 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.025+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=DROH8HJI1N1K type=del size=2262753 2023-12-03T11:28:26.027 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.026+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~L9PW05SSBTC4.0 size=124350 2023-12-03T11:28:26.029 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.028+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=L9PW05SSBTC4 tag=1F3GJ61WTL0M type=write size=1172926 2023-12-03T11:28:26.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.029+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=OXHXXYV6KLWD type=del size=115309 2023-12-03T11:28:26.032 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.031+0000 7fe67fa49780 1 < suggested update operation key=6LQ18VAE3ZN6 tag=YJVBMT3XHHH5 type=del size=3918822 2023-12-03T11:28:26.033 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.032+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=RTQVL2C05KNJ type=del size=3984602 2023-12-03T11:28:26.034 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.033+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=E9KX46PMY3OX type=del 2023-12-03T11:28:26.035 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.034+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=PTG8IB9JR48T type=del size=1981807 2023-12-03T11:28:26.036 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.035+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~CUF39K9IDJY9.0 size=1048576 2023-12-03T11:28:26.037 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.036+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~CUF39K9IDJY9.1 size=1048576 2023-12-03T11:28:26.038 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.037+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~CUF39K9IDJY9.2 size=812717 2023-12-03T11:28:26.040 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.039+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=CUF39K9IDJY9 tag=XNMGF2XQRJBH type=write size=3958445 2023-12-03T11:28:26.041 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.041+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=1GQDGZGSITDW type=del size=730793 2023-12-03T11:28:26.043 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.042+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=19BDPIY1UC86 type=del 2023-12-03T11:28:26.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.043+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=QZ8ILQG0UDWZ type=del size=2529081 2023-12-03T11:28:26.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.044+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~FEIK0ZHZQ3ZA.0 size=232617 2023-12-03T11:28:26.047 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.046+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=FEIK0ZHZQ3ZA tag=8Q0KHJTIPZ6M type=write size=1281193 2023-12-03T11:28:26.048 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.047+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=UHO7S3ABLRCM type=del size=2611337 2023-12-03T11:28:26.049 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.048+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=LRQZSP9ZIR6L type=del 2023-12-03T11:28:26.053 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.050+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=H2DVWC225JZF type=write size=755351 2023-12-03T11:28:26.053 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.051+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=LV11I2XD6B2Y type=del 2023-12-03T11:28:26.054 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.053+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~WVF60WWJ3D94.0 size=822568 2023-12-03T11:28:26.054 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.053+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=WVF60WWJ3D94 tag=SZJDU8A1FHK8 type=write size=1871144 2023-12-03T11:28:26.056 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.055+0000 7fe67fa49780 1 < suggested remove operation key=H8MBLWXG7BCZ tag=APN2QEPZGZPG type=del 2023-12-03T11:28:26.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.057+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~6AGGTN2QPV2Z.0 size=1048576 2023-12-03T11:28:26.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.058+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~6AGGTN2QPV2Z.1 size=114143 2023-12-03T11:28:26.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.058+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=6AGGTN2QPV2Z tag=BJNTI4DJX9S0 type=write size=2211295 2023-12-03T11:28:26.060 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.059+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=79A1VS4P05PY type=del 2023-12-03T11:28:26.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.061+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=OIO92DTKPHN9 type=del size=1937792 2023-12-03T11:28:26.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.062+0000 7fe67fa49780 1 < completed write operation key=0GQZY07Y2PVI tag=OD7MVTVABZ83 type=write size=13879 2023-12-03T11:28:26.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.064+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=NBIEPNQIQIX1 type=write size=825729 2023-12-03T11:28:26.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.065+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=OYCMCA7SD8P1 type=del 2023-12-03T11:28:26.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.066+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=9H11IWLZHDR3 type=del size=3968275 2023-12-03T11:28:26.068 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.067+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~ZB1EH6ZH1K6G.0 size=1048576 2023-12-03T11:28:26.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.068+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~ZB1EH6ZH1K6G.1 size=1048576 2023-12-03T11:28:26.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.069+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~ZB1EH6ZH1K6G.2 size=29870 2023-12-03T11:28:26.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.071+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=ZB1EH6ZH1K6G tag=CT3PP2O9HJX6 type=write size=3175598 2023-12-03T11:28:26.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.073+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~50AY1EMTIY3M.0 size=1048576 2023-12-03T11:28:26.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.074+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~50AY1EMTIY3M.1 size=1048576 2023-12-03T11:28:26.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.075+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~50AY1EMTIY3M.2 size=1006222 2023-12-03T11:28:26.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.075+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=50AY1EMTIY3M tag=JRQ25WBS9X1Q type=write size=4151950 2023-12-03T11:28:26.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.076+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=NGHLR2QUSO5X type=del 2023-12-03T11:28:26.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.077+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=LCQSTPBNKD36 type=del size=2677262 2023-12-03T11:28:26.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.079+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~YPZ1M160BKRV.0 size=164854 2023-12-03T11:28:26.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.080+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=YPZ1M160BKRV tag=5NBQENB6WC5E type=write size=1213430 2023-12-03T11:28:26.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.082+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=6MI2623RN0Q5 type=write size=390891 2023-12-03T11:28:26.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.084+0000 7fe67fa49780 1 < suggested remove operation key=UL24DVOA31Y7 tag=DROH8HJI1N1K type=del 2023-12-03T11:28:26.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.086+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~GSXXOD5DPUC5.0 size=1048576 2023-12-03T11:28:26.088 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.087+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~GSXXOD5DPUC5.1 size=744360 2023-12-03T11:28:26.088 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.087+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=GSXXOD5DPUC5 tag=M8C38SWK3IJL type=write size=2841512 2023-12-03T11:28:26.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.088+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=OXHXXYV6KLWD type=del 2023-12-03T11:28:26.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.089+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=PDBAQ23YTFX2 type=del size=926149 2023-12-03T11:28:26.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.090+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=RTQVL2C05KNJ type=del 2023-12-03T11:28:26.093 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.092+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~BPKW9Y16AW2F.0 size=1048576 2023-12-03T11:28:26.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.093+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~BPKW9Y16AW2F.1 size=987021 2023-12-03T11:28:26.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.093+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=BPKW9Y16AW2F tag=XE5RAIU75R3I type=write size=3084173 2023-12-03T11:28:26.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.094+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=PTG8IB9JR48T type=del 2023-12-03T11:28:26.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.096+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=S3CRJM4F2RVY type=del size=1452082 2023-12-03T11:28:26.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.098+0000 7fe67fa49780 1 < suggested remove operation key=0GQZY07Y2PVI tag=1GQDGZGSITDW type=del 2023-12-03T11:28:26.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.100+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~7D50WPW3D300.0 size=1048576 2023-12-03T11:28:26.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.101+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~7D50WPW3D300.1 size=1048576 2023-12-03T11:28:26.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.103+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~7D50WPW3D300.2 size=1036809 2023-12-03T11:28:26.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.103+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=7D50WPW3D300 tag=RUEY48NI99EO type=write size=4182537 2023-12-03T11:28:26.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.106+0000 7fe67fa49780 1 < suggested update operation key=9AUO0SRFTAUJ tag=QZ8ILQG0UDWZ type=del size=2529081 2023-12-03T11:28:26.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.108+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~BNVJ68YXGF18.0 size=834402 2023-12-03T11:28:26.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.108+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=BNVJ68YXGF18 tag=3MWIFBBKKFZY type=write size=1882978 2023-12-03T11:28:26.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.109+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=UHO7S3ABLRCM type=del 2023-12-03T11:28:26.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.110+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=2MNKQVOWR7D9 type=del size=514773 2023-12-03T11:28:26.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.111+0000 7fe67fa49780 -1 < failed to complete operation key=H8MBLWXG7BCZ tag=H2DVWC225JZF type=write size=755351: (22) Invalid argument 2023-12-03T11:28:26.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.113+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=L54UHH6TS2MR type=del size=2604822 2023-12-03T11:28:26.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.114+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~WVF60WWJ3D94.0 size=822568 2023-12-03T11:28:26.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.116+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=WVF60WWJ3D94 tag=SZJDU8A1FHK8 type=write size=1871144 2023-12-03T11:28:26.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.117+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=21FKF2V1GXXH type=del size=4052309 2023-12-03T11:28:26.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.118+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~6AGGTN2QPV2Z.0 size=1048576 2023-12-03T11:28:26.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.119+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~6AGGTN2QPV2Z.1 size=114143 2023-12-03T11:28:26.122 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.121+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=6AGGTN2QPV2Z tag=BJNTI4DJX9S0 type=write size=2211295 2023-12-03T11:28:26.124 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.123+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~ABBYIHMRFLP0.0 size=1048576 2023-12-03T11:28:26.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.124+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~ABBYIHMRFLP0.1 size=1048576 2023-12-03T11:28:26.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.125+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~ABBYIHMRFLP0.2 size=137461 2023-12-03T11:28:26.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.125+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=ABBYIHMRFLP0 tag=CIM2OML0RRZX type=write size=3283189 2023-12-03T11:28:26.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.126+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=OIO92DTKPHN9 type=del 2023-12-03T11:28:26.128 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.127+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=TOQ6GB5EA55D type=del size=3255541 2023-12-03T11:28:26.130 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.129+0000 7fe67fa49780 1 < completed write operation key=N87KA638VE01 tag=NBIEPNQIQIX1 type=write size=825729 2023-12-03T11:28:26.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.130+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=3TAWVGQXEBD6 type=write size=928138 2023-12-03T11:28:26.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.131+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=9H11IWLZHDR3 type=del 2023-12-03T11:28:26.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.132+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=NM3IAD2SO70T type=del size=306973 2023-12-03T11:28:26.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.133+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~50AY1EMTIY3M.0 size=1048576 2023-12-03T11:28:26.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.134+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~50AY1EMTIY3M.1 size=1048576 2023-12-03T11:28:26.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.135+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~50AY1EMTIY3M.2 size=1006222 2023-12-03T11:28:26.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.137+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=50AY1EMTIY3M tag=JRQ25WBS9X1Q type=write size=4151950 2023-12-03T11:28:26.139 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.138+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=KNDF058KXX3Q type=del size=2619983 2023-12-03T11:28:26.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.140+0000 7fe67fa49780 -1 < failed to complete operation key=9AUO0SRFTAUJ tag=LCQSTPBNKD36 type=del size=2677262: (22) Invalid argument 2023-12-03T11:28:26.143 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.142+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~SST5ZO7PXZ9X.0 size=1048576 2023-12-03T11:28:26.144 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.143+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~SST5ZO7PXZ9X.1 size=1048576 2023-12-03T11:28:26.145 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.144+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~SST5ZO7PXZ9X.2 size=444058 2023-12-03T11:28:26.145 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.144+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=SST5ZO7PXZ9X tag=3BV4YTYSS2NI type=write size=3589786 2023-12-03T11:28:26.146 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.145+0000 7fe67fa49780 1 < completed write operation key=URVD2U16EW75 tag=6MI2623RN0Q5 type=write size=390891 2023-12-03T11:28:26.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.147+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~JR5EBQ18H1I4.0 size=1048576 2023-12-03T11:28:26.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.148+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~JR5EBQ18H1I4.1 size=741545 2023-12-03T11:28:26.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.148+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=JR5EBQ18H1I4 tag=1YE2KSFVMUM4 type=write size=2838697 2023-12-03T11:28:26.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.150+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~GSXXOD5DPUC5.0 size=1048576 2023-12-03T11:28:26.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.151+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~GSXXOD5DPUC5.1 size=744360 2023-12-03T11:28:26.154 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.153+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=GSXXOD5DPUC5 tag=M8C38SWK3IJL type=write size=2841512 2023-12-03T11:28:26.155 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.154+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=S0TWPXPY6WSA type=del size=1550280 2023-12-03T11:28:26.156 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.155+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=PDBAQ23YTFX2 type=del 2023-12-03T11:28:26.157 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.156+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=LPE3KYXJ2SP3 type=write size=963528 2023-12-03T11:28:26.158 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.157+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~BPKW9Y16AW2F.0 size=1048576 2023-12-03T11:28:26.158 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.157+0000 7fe67fa49780 1 < canceled part key=_multipart_Q6GBIBMIJRKV.2~BPKW9Y16AW2F.1 size=987021 2023-12-03T11:28:26.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.159+0000 7fe67fa49780 1 < canceled multipart upload key=Q6GBIBMIJRKV upload=BPKW9Y16AW2F tag=XE5RAIU75R3I type=write size=3084173 2023-12-03T11:28:26.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.160+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=0822JXYC2DOC type=write size=487761 2023-12-03T11:28:26.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.161+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=S3CRJM4F2RVY type=del 2023-12-03T11:28:26.164 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.163+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~7TQ20W5HF0DK.0 size=1048576 2023-12-03T11:28:26.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.164+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~7TQ20W5HF0DK.1 size=1048576 2023-12-03T11:28:26.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.165+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~7TQ20W5HF0DK.2 size=40260 2023-12-03T11:28:26.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.165+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=7TQ20W5HF0DK tag=MPGX436590OB type=write size=3185988 2023-12-03T11:28:26.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.166+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~7D50WPW3D300.0 size=1048576 2023-12-03T11:28:26.168 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.167+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~7D50WPW3D300.1 size=1048576 2023-12-03T11:28:26.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.168+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~7D50WPW3D300.2 size=1036809 2023-12-03T11:28:26.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.170+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=7D50WPW3D300 tag=RUEY48NI99EO type=write size=4182537 2023-12-03T11:28:26.173 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.172+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=62N2TMMB3U93 type=del size=3906756 2023-12-03T11:28:26.174 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.173+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~BNVJ68YXGF18.0 size=834402 2023-12-03T11:28:26.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.175+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=BNVJ68YXGF18 tag=3MWIFBBKKFZY type=write size=1882978 2023-12-03T11:28:26.177 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.177+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=JZ548YIRM9L4 type=write size=728065 2023-12-03T11:28:26.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.178+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=2MNKQVOWR7D9 type=del 2023-12-03T11:28:26.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.179+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=SQF6S4DSUMPV type=del size=2278836 2023-12-03T11:28:26.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.180+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=L54UHH6TS2MR type=del 2023-12-03T11:28:26.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.181+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=UHRQOF2VXLH9 type=del size=2843412 2023-12-03T11:28:26.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.182+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=21FKF2V1GXXH type=del 2023-12-03T11:28:26.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.183+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=BNZATROGREEJ type=write size=327137 2023-12-03T11:28:26.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.185+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~ABBYIHMRFLP0.0 size=1048576 2023-12-03T11:28:26.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.186+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~ABBYIHMRFLP0.1 size=1048576 2023-12-03T11:28:26.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.187+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~ABBYIHMRFLP0.2 size=137461 2023-12-03T11:28:26.189 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.189+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=ABBYIHMRFLP0 tag=CIM2OML0RRZX type=write size=3283189 2023-12-03T11:28:26.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.191+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~YDDJAMAA0SXE.0 size=417454 2023-12-03T11:28:26.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.191+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=YDDJAMAA0SXE tag=2LEMDRJS7PXD type=write size=1466030 2023-12-03T11:28:26.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.192+0000 7fe67fa49780 1 < canceled operation key=URVD2U16EW75 tag=TOQ6GB5EA55D type=del size=3255541 2023-12-03T11:28:26.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.193+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=NGLIYI5PHYGC type=del size=2681187 2023-12-03T11:28:26.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.194+0000 7fe67fa49780 1 < completed write operation key=XZHCD4R4EVZR tag=3TAWVGQXEBD6 type=write size=928138 2023-12-03T11:28:26.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.196+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~ZT2LDNNH5DWS.0 size=755361 2023-12-03T11:28:26.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.196+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=ZT2LDNNH5DWS tag=FWDX8P7G26ZA type=write size=1803937 2023-12-03T11:28:26.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.197+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=NM3IAD2SO70T type=del 2023-12-03T11:28:26.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.198+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=LY6IR2RXKNRZ type=write size=35537 2023-12-03T11:28:26.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.200+0000 7fe67fa49780 1 < suggested update operation key=DDHGOWEI7WEI tag=KNDF058KXX3Q type=del size=2619983 2023-12-03T11:28:26.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.202+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~Z8L4NTLRIOBJ.0 size=1048576 2023-12-03T11:28:26.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.203+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~Z8L4NTLRIOBJ.1 size=440926 2023-12-03T11:28:26.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.203+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=Z8L4NTLRIOBJ tag=3OQOB03MW2BF type=write size=2538078 2023-12-03T11:28:26.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.204+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~SST5ZO7PXZ9X.0 size=1048576 2023-12-03T11:28:26.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.205+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~SST5ZO7PXZ9X.1 size=1048576 2023-12-03T11:28:26.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.206+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~SST5ZO7PXZ9X.2 size=444058 2023-12-03T11:28:26.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.208+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=SST5ZO7PXZ9X tag=3BV4YTYSS2NI type=write size=3589786 2023-12-03T11:28:26.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.209+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=N4YXOIGPFNNR type=del size=4044330 2023-12-03T11:28:26.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.210+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~JR5EBQ18H1I4.0 size=1048576 2023-12-03T11:28:26.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.211+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~JR5EBQ18H1I4.1 size=741545 2023-12-03T11:28:26.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.213+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=JR5EBQ18H1I4 tag=1YE2KSFVMUM4 type=write size=2838697 2023-12-03T11:28:26.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.214+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=4NQ1PNAFEZ56 type=del size=481830 2023-12-03T11:28:26.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.215+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=S0TWPXPY6WSA type=del 2023-12-03T11:28:26.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.216+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=KB3A0VXFR5KR type=del size=3909222 2023-12-03T11:28:26.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.218+0000 7fe67fa49780 1 < canceled operation key=Q6GBIBMIJRKV tag=LPE3KYXJ2SP3 type=write size=963528 2023-12-03T11:28:26.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.219+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=7GOAJ7WLVN71 type=del size=1208849 2023-12-03T11:28:26.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.220+0000 7fe67fa49780 1 < completed write operation key=IIW1Y6QYEODQ tag=0822JXYC2DOC type=write size=487761 2023-12-03T11:28:26.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.221+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=J8QHDMMDR8Y7 type=del size=3795958 2023-12-03T11:28:26.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.221+0000 7fe67fa49780 1 < canceled part key=_multipart_ASODFGLQ5VNY.2~7TQ20W5HF0DK.0 size=1048576 2023-12-03T11:28:26.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.222+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~7TQ20W5HF0DK.1 size=1048576 2023-12-03T11:28:26.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.223+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~7TQ20W5HF0DK.2 size=40260 2023-12-03T11:28:26.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.225+0000 7fe67fa49780 1 < canceled multipart upload key=ASODFGLQ5VNY upload=7TQ20W5HF0DK tag=MPGX436590OB type=write size=3185988 2023-12-03T11:28:26.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.226+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=RA8YBMJEEB74 type=del size=2819346 2023-12-03T11:28:26.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.227+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=62N2TMMB3U93 type=del 2023-12-03T11:28:26.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.228+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=7RI2TZSTW10P type=del size=490266 2023-12-03T11:28:26.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.230+0000 7fe67fa49780 1 < completed write operation key=ASODFGLQ5VNY tag=JZ548YIRM9L4 type=write size=728065 2023-12-03T11:28:26.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.231+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=AEFSQ6LVIK9V type=del size=2567386 2023-12-03T11:28:26.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.232+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=SQF6S4DSUMPV type=del 2023-12-03T11:28:26.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.234+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~KD4YL3HN157U.0 size=1048576 2023-12-03T11:28:26.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.235+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~KD4YL3HN157U.1 size=501271 2023-12-03T11:28:26.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.235+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=KD4YL3HN157U tag=0S4W8PMRISZ0 type=write size=2598423 2023-12-03T11:28:26.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.236+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=UHRQOF2VXLH9 type=del 2023-12-03T11:28:26.239 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.238+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~JAFPLM3YW9BM.0 size=1048576 2023-12-03T11:28:26.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.239+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~JAFPLM3YW9BM.1 size=228012 2023-12-03T11:28:26.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.239+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=JAFPLM3YW9BM tag=V3ZG5Y44AHB8 type=write size=2325164 2023-12-03T11:28:26.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.240+0000 7fe67fa49780 1 < completed write operation key=0G8KNJBJ9K1Z tag=BNZATROGREEJ type=write size=327137 2023-12-03T11:28:26.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.241+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=4VHR92BKYXNL type=del size=1092781 2023-12-03T11:28:26.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.242+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~YDDJAMAA0SXE.0 size=417454 2023-12-03T11:28:26.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.244+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=YDDJAMAA0SXE tag=2LEMDRJS7PXD type=write size=1466030 2023-12-03T11:28:26.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.246+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~822C0FGHTAWU.0 size=1048576 2023-12-03T11:28:26.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.247+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~822C0FGHTAWU.1 size=201892 2023-12-03T11:28:26.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.247+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=822C0FGHTAWU tag=KBKZCJEJU02J type=write size=2299044 2023-12-03T11:28:26.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.249+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=NGLIYI5PHYGC type=del 2023-12-03T11:28:26.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.251+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~LNHGX2GLXQ6N.0 size=1048576 2023-12-03T11:28:26.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.252+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~LNHGX2GLXQ6N.1 size=1048576 2023-12-03T11:28:26.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.253+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~LNHGX2GLXQ6N.2 size=615903 2023-12-03T11:28:26.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.253+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=LNHGX2GLXQ6N tag=KGBJYMM4GXI5 type=write size=3761631 2023-12-03T11:28:26.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.254+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~ZT2LDNNH5DWS.0 size=755361 2023-12-03T11:28:26.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.256+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=ZT2LDNNH5DWS tag=FWDX8P7G26ZA type=write size=1803937 2023-12-03T11:28:26.259 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.258+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~Z6RJZ4T6I7GL.0 size=1048576 2023-12-03T11:28:26.261 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.259+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~Z6RJZ4T6I7GL.1 size=187903 2023-12-03T11:28:26.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.259+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=Z6RJZ4T6I7GL tag=UJRH2HJY7CTN type=write size=2285055 2023-12-03T11:28:26.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.260+0000 7fe67fa49780 1 < completed write operation key=Q6GBIBMIJRKV tag=LY6IR2RXKNRZ type=write size=35537 2023-12-03T11:28:26.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.261+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=W0LC8FJQSU6L type=del size=632035 2023-12-03T11:28:26.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.263+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~Z8L4NTLRIOBJ.0 size=1048576 2023-12-03T11:28:26.264 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.264+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~Z8L4NTLRIOBJ.1 size=440926 2023-12-03T11:28:26.267 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.266+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=Z8L4NTLRIOBJ tag=3OQOB03MW2BF type=write size=2538078 2023-12-03T11:28:26.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.268+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~C4H2IME9Z80F.0 size=861545 2023-12-03T11:28:26.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.268+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=C4H2IME9Z80F tag=Y31F1VWIS359 type=write size=1910121 2023-12-03T11:28:26.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.269+0000 7fe67fa49780 1 < canceled operation key=ASODFGLQ5VNY tag=N4YXOIGPFNNR type=del size=4044330 2023-12-03T11:28:26.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.270+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=W2GJNHNINIQT type=del size=794126 2023-12-03T11:28:26.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.271+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=4NQ1PNAFEZ56 type=del 2023-12-03T11:28:26.275 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.274+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~1F1R1JVW6PZP.0 size=1048576 2023-12-03T11:28:26.275 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.275+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~1F1R1JVW6PZP.1 size=972659 2023-12-03T11:28:26.275 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.275+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=1F1R1JVW6PZP tag=MMAA4CPRCA9F type=write size=3069811 2023-12-03T11:28:26.277 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.276+0000 7fe67fa49780 1 < canceled operation key=Q6GBIBMIJRKV tag=KB3A0VXFR5KR type=del size=3909222 2023-12-03T11:28:26.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.277+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=AFCZ3ZUZ9PN2 type=del size=963861 2023-12-03T11:28:26.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.278+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=7GOAJ7WLVN71 type=del 2023-12-03T11:28:26.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.281+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~T2HXAML7RO40.0 size=1048576 2023-12-03T11:28:26.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.282+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~T2HXAML7RO40.1 size=926284 2023-12-03T11:28:26.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.282+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=T2HXAML7RO40 tag=24X03D81T919 type=write size=3023436 2023-12-03T11:28:26.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.283+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=J8QHDMMDR8Y7 type=del 2023-12-03T11:28:26.285 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.284+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=071DL3MO22T4 type=del size=2935959 2023-12-03T11:28:26.286 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.285+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=RA8YBMJEEB74 type=del 2023-12-03T11:28:26.287 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.286+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=QFSUIFUVDLQA type=del size=2094744 2023-12-03T11:28:26.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.287+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=7RI2TZSTW10P type=del 2023-12-03T11:28:26.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.288+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=FBWSB4EXNVOJ type=del size=2195069 2023-12-03T11:28:26.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.289+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=AEFSQ6LVIK9V type=del 2023-12-03T11:28:26.291 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.290+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=4KRUB9PMODO6 type=del size=907420 2023-12-03T11:28:26.291 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.290+0000 7fe67fa49780 1 < canceled part key=_multipart_XZHCD4R4EVZR.2~KD4YL3HN157U.0 size=1048576 2023-12-03T11:28:26.292 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.291+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~KD4YL3HN157U.1 size=501271 2023-12-03T11:28:26.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.293+0000 7fe67fa49780 1 < canceled multipart upload key=XZHCD4R4EVZR upload=KD4YL3HN157U tag=0S4W8PMRISZ0 type=write size=2598423 2023-12-03T11:28:26.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.294+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=Q62PLJQZN5GJ type=del size=3250631 2023-12-03T11:28:26.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.296+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~JAFPLM3YW9BM.0 size=1048576 2023-12-03T11:28:26.297 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.296+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~JAFPLM3YW9BM.1 size=228012 2023-12-03T11:28:26.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.298+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=JAFPLM3YW9BM tag=V3ZG5Y44AHB8 type=write size=2325164 2023-12-03T11:28:26.300 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.299+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=V5UY8GXO2OSD type=del size=1265751 2023-12-03T11:28:26.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.300+0000 7fe67fa49780 1 < canceled operation key=0G8KNJBJ9K1Z tag=4VHR92BKYXNL type=del size=1092781 2023-12-03T11:28:26.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.301+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=TMLZ73S02I1T type=del size=1069605 2023-12-03T11:28:26.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.302+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~822C0FGHTAWU.0 size=1048576 2023-12-03T11:28:26.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.302+0000 7fe67fa49780 1 < canceled part key=_multipart_UL24DVOA31Y7.2~822C0FGHTAWU.1 size=201892 2023-12-03T11:28:26.305 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.304+0000 7fe67fa49780 1 < canceled multipart upload key=UL24DVOA31Y7 upload=822C0FGHTAWU tag=KBKZCJEJU02J type=write size=2299044 2023-12-03T11:28:26.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.306+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~6XSS56W214CU.0 size=1048576 2023-12-03T11:28:26.308 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.307+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~6XSS56W214CU.1 size=1048576 2023-12-03T11:28:26.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.308+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~6XSS56W214CU.2 size=33285 2023-12-03T11:28:26.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.308+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=6XSS56W214CU tag=IJ55PTM1I5TB type=write size=3179013 2023-12-03T11:28:26.310 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.309+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~LNHGX2GLXQ6N.0 size=1048576 2023-12-03T11:28:26.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.310+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~LNHGX2GLXQ6N.1 size=1048576 2023-12-03T11:28:26.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.311+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~LNHGX2GLXQ6N.2 size=615903 2023-12-03T11:28:26.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.313+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=LNHGX2GLXQ6N tag=KGBJYMM4GXI5 type=write size=3761631 2023-12-03T11:28:26.316 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.315+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~N22BG1SWCBLY.0 size=1048576 2023-12-03T11:28:26.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.316+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~N22BG1SWCBLY.1 size=1048576 2023-12-03T11:28:26.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.317+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~N22BG1SWCBLY.2 size=152041 2023-12-03T11:28:26.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.317+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=N22BG1SWCBLY tag=359VOA1DJPZX type=write size=3297769 2023-12-03T11:28:26.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.318+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~Z6RJZ4T6I7GL.0 size=1048576 2023-12-03T11:28:26.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.319+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~Z6RJZ4T6I7GL.1 size=187903 2023-12-03T11:28:26.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.320+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=Z6RJZ4T6I7GL tag=UJRH2HJY7CTN type=write size=2285055 2023-12-03T11:28:26.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.322+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~120JQH2LD1E0.0 size=297734 2023-12-03T11:28:26.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.322+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=120JQH2LD1E0 tag=P9GRGEYQLKMH type=write size=1346310 2023-12-03T11:28:26.326 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.325+0000 7fe67fa49780 1 < suggested remove operation key=PFBGR7OF7JQG tag=W0LC8FJQSU6L type=del 2023-12-03T11:28:26.327 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.326+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=13QKPUE7AG5Z type=del size=280459 2023-12-03T11:28:26.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.327+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~C4H2IME9Z80F.0 size=861545 2023-12-03T11:28:26.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.329+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=C4H2IME9Z80F tag=Y31F1VWIS359 type=write size=1910121 2023-12-03T11:28:26.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.330+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=FCHY5BH0CKEN type=del size=2304215 2023-12-03T11:28:26.333 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.332+0000 7fe67fa49780 1 < suggested update operation key=ASODFGLQ5VNY tag=W2GJNHNINIQT type=del size=794126 2023-12-03T11:28:26.335 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.334+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~0CGB1S85GD8Q.0 size=1048576 2023-12-03T11:28:26.336 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.335+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~0CGB1S85GD8Q.1 size=606782 2023-12-03T11:28:26.336 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.335+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=0CGB1S85GD8Q tag=BDO7C931KM6T type=write size=2703934 2023-12-03T11:28:26.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.336+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~1F1R1JVW6PZP.0 size=1048576 2023-12-03T11:28:26.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.336+0000 7fe67fa49780 1 < canceled part key=_multipart_6LQ18VAE3ZN6.2~1F1R1JVW6PZP.1 size=972659 2023-12-03T11:28:26.339 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.338+0000 7fe67fa49780 1 < canceled multipart upload key=6LQ18VAE3ZN6 upload=1F1R1JVW6PZP tag=MMAA4CPRCA9F type=write size=3069811 2023-12-03T11:28:26.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.339+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=15Q5LFXHZ1SO type=del size=1261482 2023-12-03T11:28:26.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.340+0000 7fe67fa49780 1 < canceled operation key=H8MBLWXG7BCZ tag=AFCZ3ZUZ9PN2 type=del size=963861 2023-12-03T11:28:26.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.342+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~6BTRQTJ9854V.0 size=722214 2023-12-03T11:28:26.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.342+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=6BTRQTJ9854V tag=BUFASYJE4T56 type=write size=1770790 2023-12-03T11:28:26.344 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.344+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~T2HXAML7RO40.0 size=1048576 2023-12-03T11:28:26.346 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.345+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~T2HXAML7RO40.1 size=926284 2023-12-03T11:28:26.348 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.347+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=T2HXAML7RO40 tag=24X03D81T919 type=write size=3023436 2023-12-03T11:28:26.349 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.348+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=YSEPB4WHKDOR type=write size=643952 2023-12-03T11:28:26.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.349+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=071DL3MO22T4 type=del 2023-12-03T11:28:26.352 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.351+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~JI8AI90J619I.0 size=571842 2023-12-03T11:28:26.352 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.351+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=JI8AI90J619I tag=OBVRB5H643VQ type=write size=1620418 2023-12-03T11:28:26.353 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.352+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=QFSUIFUVDLQA type=del 2023-12-03T11:28:26.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.353+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=QS9MDG7EU9P0 type=del size=1720478 2023-12-03T11:28:26.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.354+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=FBWSB4EXNVOJ type=del 2023-12-03T11:28:26.356 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.355+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=CCT2VEU4B2RM type=del size=2449287 2023-12-03T11:28:26.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.357+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=4KRUB9PMODO6 type=del 2023-12-03T11:28:26.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.358+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=9B1XCQMZG8T2 type=write size=965847 2023-12-03T11:28:26.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.359+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=Q62PLJQZN5GJ type=del 2023-12-03T11:28:26.363 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.362+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~9X3FFATVK5A9.0 size=696008 2023-12-03T11:28:26.363 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.362+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=9X3FFATVK5A9 tag=IF9LCZIPK441 type=write size=1744584 2023-12-03T11:28:26.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.363+0000 7fe67fa49780 1 < canceled operation key=P05UIP1IU4Z7 tag=V5UY8GXO2OSD type=del size=1265751 2023-12-03T11:28:26.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.364+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=J3OCOYZHPWHG type=write size=939012 2023-12-03T11:28:26.366 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.365+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=TMLZ73S02I1T type=del 2023-12-03T11:28:26.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.368+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~B6815P3UVBZ8.0 size=1048576 2023-12-03T11:28:26.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.369+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~B6815P3UVBZ8.1 size=1048576 2023-12-03T11:28:26.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.370+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~B6815P3UVBZ8.2 size=198572 2023-12-03T11:28:26.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.370+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=B6815P3UVBZ8 tag=6T60QIMLMC55 type=write size=3344300 2023-12-03T11:28:26.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.371+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~6XSS56W214CU.0 size=1048576 2023-12-03T11:28:26.373 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.372+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~6XSS56W214CU.1 size=1048576 2023-12-03T11:28:26.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.373+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~6XSS56W214CU.2 size=33285 2023-12-03T11:28:26.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.375+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=6XSS56W214CU tag=IJ55PTM1I5TB type=write size=3179013 2023-12-03T11:28:26.377 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.376+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=MWOCUFSWF0M1 type=del size=3779298 2023-12-03T11:28:26.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.377+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~N22BG1SWCBLY.0 size=1048576 2023-12-03T11:28:26.379 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.378+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~N22BG1SWCBLY.1 size=1048576 2023-12-03T11:28:26.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.379+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~N22BG1SWCBLY.2 size=152041 2023-12-03T11:28:26.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.381+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=N22BG1SWCBLY tag=359VOA1DJPZX type=write size=3297769 2023-12-03T11:28:26.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.382+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=U2JCSJTXLMB9 type=del size=3086217 2023-12-03T11:28:26.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.383+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~120JQH2LD1E0.0 size=297734 2023-12-03T11:28:26.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.387+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=120JQH2LD1E0 tag=P9GRGEYQLKMH type=write size=1346310 2023-12-03T11:28:26.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.388+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=05OZHFUCFRE4 type=del size=3515648 2023-12-03T11:28:26.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.390+0000 7fe67fa49780 1 < canceled operation key=YEMPVKMDANPG tag=13QKPUE7AG5Z type=del size=280459 2023-12-03T11:28:26.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.391+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=1IV5XZSPTPGR type=del size=2941203 2023-12-03T11:28:26.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.392+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=FCHY5BH0CKEN type=del 2023-12-03T11:28:26.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.393+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=Z4BMLNU8ADOG type=del size=2118611 2023-12-03T11:28:26.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.395+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~0CGB1S85GD8Q.0 size=1048576 2023-12-03T11:28:26.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.396+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~0CGB1S85GD8Q.1 size=606782 2023-12-03T11:28:26.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.398+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=0CGB1S85GD8Q tag=BDO7C931KM6T type=write size=2703934 2023-12-03T11:28:26.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.399+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=Q1AVPQEHK2JB type=del size=2062145 2023-12-03T11:28:26.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.400+0000 7fe67fa49780 1 < canceled operation key=XZHCD4R4EVZR tag=15Q5LFXHZ1SO type=del size=1261482 2023-12-03T11:28:26.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.401+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=BTUK6MAVD3ZY type=del size=3508364 2023-12-03T11:28:26.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.402+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~6BTRQTJ9854V.0 size=722214 2023-12-03T11:28:26.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.404+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=6BTRQTJ9854V tag=BUFASYJE4T56 type=write size=1770790 2023-12-03T11:28:26.406 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.405+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=9MCA7NEZGX3G type=write size=947147 2023-12-03T11:28:26.407 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.406+0000 7fe67fa49780 1 < completed write operation key=H8MBLWXG7BCZ tag=YSEPB4WHKDOR type=write size=643952 2023-12-03T11:28:26.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.408+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=SWPWUABYY7XR type=del size=2477534 2023-12-03T11:28:26.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.409+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~JI8AI90J619I.0 size=571842 2023-12-03T11:28:26.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.411+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=JI8AI90J619I tag=OBVRB5H643VQ type=write size=1620418 2023-12-03T11:28:26.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.413+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~2B75DNAWYAPA.0 size=1048576 2023-12-03T11:28:26.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.414+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~2B75DNAWYAPA.1 size=1048576 2023-12-03T11:28:26.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.414+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~2B75DNAWYAPA.2 size=1029523 2023-12-03T11:28:26.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.414+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=2B75DNAWYAPA tag=DVTEE7TDBMWB type=write size=4175251 2023-12-03T11:28:26.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.416+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=QS9MDG7EU9P0 type=del 2023-12-03T11:28:26.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.417+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=Z8ZNZLH8P1W4 type=del size=438522 2023-12-03T11:28:26.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.418+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=CCT2VEU4B2RM type=del 2023-12-03T11:28:26.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.419+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=RAVJWU9B1M5K type=del size=3027325 2023-12-03T11:28:26.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.421+0000 7fe67fa49780 1 < suggested update operation key=Q6GBIBMIJRKV tag=9B1XCQMZG8T2 type=write size=965847 2023-12-03T11:28:26.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.423+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~M02ACNIGS9GL.0 size=117165 2023-12-03T11:28:26.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.423+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=M02ACNIGS9GL tag=17RVH8GOCVC4 type=write size=1165741 2023-12-03T11:28:26.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.424+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~9X3FFATVK5A9.0 size=696008 2023-12-03T11:28:26.427 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.426+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=9X3FFATVK5A9 tag=IF9LCZIPK441 type=write size=1744584 2023-12-03T11:28:26.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.428+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=X2O4XUCGRFQU type=del size=254483 2023-12-03T11:28:26.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.429+0000 7fe67fa49780 1 < completed write operation key=ASODFGLQ5VNY tag=J3OCOYZHPWHG type=write size=939012 2023-12-03T11:28:26.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.430+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=Q11HNDPH6VU1 type=del size=3444919 2023-12-03T11:28:26.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.431+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~B6815P3UVBZ8.0 size=1048576 2023-12-03T11:28:26.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.432+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~B6815P3UVBZ8.1 size=1048576 2023-12-03T11:28:26.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.433+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~B6815P3UVBZ8.2 size=198572 2023-12-03T11:28:26.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.435+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=B6815P3UVBZ8 tag=6T60QIMLMC55 type=write size=3344300 2023-12-03T11:28:26.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.436+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=2SHYFO4IXB03 type=del size=495854 2023-12-03T11:28:26.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.438+0000 7fe67fa49780 -1 < failed to complete operation key=Q6GBIBMIJRKV tag=MWOCUFSWF0M1 type=del size=3779298: (22) Invalid argument 2023-12-03T11:28:26.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.440+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~WTDA3O55GZTR.0 size=163351 2023-12-03T11:28:26.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.440+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=WTDA3O55GZTR tag=T4RK3JTGXX74 type=write size=1211927 2023-12-03T11:28:26.442 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.441+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=U2JCSJTXLMB9 type=del 2023-12-03T11:28:26.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.442+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=C55GXUGNIK32 type=del size=650882 2023-12-03T11:28:26.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.443+0000 7fe67fa49780 1 < canceled operation key=CIB1NZHJGO46 tag=05OZHFUCFRE4 type=del size=3515648 2023-12-03T11:28:26.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.445+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=QLG0L0X43SLY type=del size=2402240 2023-12-03T11:28:26.448 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.447+0000 7fe67fa49780 1 < suggested remove operation key=CC1X1OP7L6BJ tag=1IV5XZSPTPGR type=del 2023-12-03T11:28:26.450 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.449+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~SERZD1NDBGQO.0 size=193727 2023-12-03T11:28:26.450 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.449+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=SERZD1NDBGQO tag=XENQNO3H0JI4 type=write size=1242303 2023-12-03T11:28:26.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.450+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=Z4BMLNU8ADOG type=del 2023-12-03T11:28:26.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.452+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=SIG3FTZXUPBS type=del size=977595 2023-12-03T11:28:26.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.453+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=Q1AVPQEHK2JB type=del 2023-12-03T11:28:26.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.454+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=KB13YYFFHP7A type=del size=2016338 2023-12-03T11:28:26.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.455+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=BTUK6MAVD3ZY type=del 2023-12-03T11:28:26.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.456+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=LQVI9NY0PZ73 type=write size=445983 2023-12-03T11:28:26.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.458+0000 7fe67fa49780 1 < completed write operation key=CIB1NZHJGO46 tag=9MCA7NEZGX3G type=write size=947147 2023-12-03T11:28:26.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.459+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=U5ILWD7QPVOY type=del size=2410597 2023-12-03T11:28:26.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.460+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=SWPWUABYY7XR type=del 2023-12-03T11:28:26.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.461+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=DYNI37NY9PYR type=del size=247966 2023-12-03T11:28:26.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.462+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~2B75DNAWYAPA.0 size=1048576 2023-12-03T11:28:26.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.463+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~2B75DNAWYAPA.1 size=1048576 2023-12-03T11:28:26.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.465+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~2B75DNAWYAPA.2 size=1029523 2023-12-03T11:28:26.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.467+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=2B75DNAWYAPA tag=DVTEE7TDBMWB type=write size=4175251 2023-12-03T11:28:26.471 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.469+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~13DR6PY9MJQI.0 size=243483 2023-12-03T11:28:26.471 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.469+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=13DR6PY9MJQI tag=3BI8YAA6UQ7E type=write size=1292059 2023-12-03T11:28:26.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.472+0000 7fe67fa49780 1 < suggested remove operation key=URVD2U16EW75 tag=Z8ZNZLH8P1W4 type=del 2023-12-03T11:28:26.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.473+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=6TM7QA0381PE type=del size=2314156 2023-12-03T11:28:26.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.475+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=RAVJWU9B1M5K type=del 2023-12-03T11:28:26.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.476+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=WLWR4MRS74WO type=del size=2166785 2023-12-03T11:28:26.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.477+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~M02ACNIGS9GL.0 size=117165 2023-12-03T11:28:26.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.479+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=M02ACNIGS9GL tag=17RVH8GOCVC4 type=write size=1165741 2023-12-03T11:28:26.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.480+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=S9J3Z0LJKV3V type=del size=640817 2023-12-03T11:28:26.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.481+0000 7fe67fa49780 -1 < failed to complete operation key=CC1X1OP7L6BJ tag=X2O4XUCGRFQU type=del size=254483: (22) Invalid argument 2023-12-03T11:28:26.484 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.483+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=A0PXV4CQA27C type=del size=2535514 2023-12-03T11:28:26.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.485+0000 7fe67fa49780 1 < suggested remove operation key=0G8KNJBJ9K1Z tag=Q11HNDPH6VU1 type=del 2023-12-03T11:28:26.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.487+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~F1RWRSPSW9C1.0 size=329421 2023-12-03T11:28:26.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.487+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=F1RWRSPSW9C1 tag=FM71D4ZZDWU1 type=write size=1377997 2023-12-03T11:28:26.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.488+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=2SHYFO4IXB03 type=del 2023-12-03T11:28:26.491 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.490+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~3TZ8C28PMPBU.0 size=99893 2023-12-03T11:28:26.492 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.490+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=3TZ8C28PMPBU tag=7U47NJW7V38I type=write size=1148469 2023-12-03T11:28:26.492 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.491+0000 7fe67fa49780 1 < canceled part key=_multipart_Q6GBIBMIJRKV.2~WTDA3O55GZTR.0 size=163351 2023-12-03T11:28:26.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.492+0000 7fe67fa49780 1 < canceled multipart upload key=Q6GBIBMIJRKV upload=WTDA3O55GZTR tag=T4RK3JTGXX74 type=write size=1211927 2023-12-03T11:28:26.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.495+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~NTIRDIT4ENQE.0 size=1048576 2023-12-03T11:28:26.496 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.495+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~NTIRDIT4ENQE.1 size=255795 2023-12-03T11:28:26.496 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.495+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=NTIRDIT4ENQE tag=NZAE387LBK8H type=write size=2352947 2023-12-03T11:28:26.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.497+0000 7fe67fa49780 1 < canceled operation key=XZHCD4R4EVZR tag=C55GXUGNIK32 type=del size=650882 2023-12-03T11:28:26.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.500+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~Y4FLQH0MT9OB.0 size=1048576 2023-12-03T11:28:26.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.501+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~Y4FLQH0MT9OB.1 size=1008657 2023-12-03T11:28:26.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.501+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=Y4FLQH0MT9OB tag=7X0D2PFC13NV type=write size=3105809 2023-12-03T11:28:26.503 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.502+0000 7fe67fa49780 -1 < failed to complete operation key=0G8KNJBJ9K1Z tag=QLG0L0X43SLY type=del size=2402240: (22) Invalid argument 2023-12-03T11:28:26.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.503+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=XBOMIFR728D8 type=del size=2311710 2023-12-03T11:28:26.505 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.504+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~SERZD1NDBGQO.0 size=193727 2023-12-03T11:28:26.507 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.506+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=SERZD1NDBGQO tag=XENQNO3H0JI4 type=write size=1242303 2023-12-03T11:28:26.509 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.508+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~2CP2F811KG5I.0 size=882612 2023-12-03T11:28:26.509 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.508+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=2CP2F811KG5I tag=A746YWUHZXU2 type=write size=1931188 2023-12-03T11:28:26.510 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.509+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=SIG3FTZXUPBS type=del 2023-12-03T11:28:26.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.510+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=PDSOLYY1JFYE type=del size=2665646 2023-12-03T11:28:26.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.511+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=KB13YYFFHP7A type=del 2023-12-03T11:28:26.513 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.512+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=CJGEKXQP80RL type=del size=2723283 2023-12-03T11:28:26.516 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.515+0000 7fe67fa49780 1 < suggested update operation key=9OD4G28SDLB4 tag=LQVI9NY0PZ73 type=write size=445983 2023-12-03T11:28:26.517 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.516+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=NIABSN8U0BI8 type=write size=300562 2023-12-03T11:28:26.518 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.517+0000 7fe67fa49780 1 < canceled operation key=N87KA638VE01 tag=U5ILWD7QPVOY type=del size=2410597 2023-12-03T11:28:26.519 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.518+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=WLUFI3WQQQ1U type=write size=283372 2023-12-03T11:28:26.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.521+0000 7fe67fa49780 1 < suggested remove operation key=V9ZVWHO8IF8L tag=DYNI37NY9PYR type=del 2023-12-03T11:28:26.524 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.523+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~5F1HK21979XB.0 size=1007375 2023-12-03T11:28:26.524 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.523+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=5F1HK21979XB tag=RR9U4P5URT4U type=write size=2055951 2023-12-03T11:28:26.525 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.524+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~13DR6PY9MJQI.0 size=243483 2023-12-03T11:28:26.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.526+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=13DR6PY9MJQI tag=3BI8YAA6UQ7E type=write size=1292059 2023-12-03T11:28:26.529 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.528+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~7A71OFDZSKDL.0 size=1048576 2023-12-03T11:28:26.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.529+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~7A71OFDZSKDL.1 size=787014 2023-12-03T11:28:26.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.529+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=7A71OFDZSKDL tag=8JR7YBMM1TCF type=write size=2884166 2023-12-03T11:28:26.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.530+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=6TM7QA0381PE type=del 2023-12-03T11:28:26.532 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.531+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=2OA8L101KHTU type=write size=539482 2023-12-03T11:28:26.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.532+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=WLWR4MRS74WO type=del 2023-12-03T11:28:26.535 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.535+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~ZRTYHHNHLQ3K.0 size=1048576 2023-12-03T11:28:26.536 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.535+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~ZRTYHHNHLQ3K.1 size=1048576 2023-12-03T11:28:26.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.536+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~ZRTYHHNHLQ3K.2 size=791705 2023-12-03T11:28:26.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.536+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=ZRTYHHNHLQ3K tag=CKIU625WZG5C type=write size=3937433 2023-12-03T11:28:26.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.538+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=S9J3Z0LJKV3V type=del 2023-12-03T11:28:26.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.540+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~EISUAA0T7KA8.0 size=1048576 2023-12-03T11:28:26.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.540+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~EISUAA0T7KA8.1 size=691715 2023-12-03T11:28:26.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.541+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=EISUAA0T7KA8 tag=H1Y9R586IJGV type=write size=2788867 2023-12-03T11:28:26.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.542+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=A0PXV4CQA27C type=del 2023-12-03T11:28:26.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.544+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~HLODXR8TVJ5U.0 size=771682 2023-12-03T11:28:26.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.544+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=HLODXR8TVJ5U tag=4NW8PYF22OY8 type=write size=1820258 2023-12-03T11:28:26.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.545+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~F1RWRSPSW9C1.0 size=329421 2023-12-03T11:28:26.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.547+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=F1RWRSPSW9C1 tag=FM71D4ZZDWU1 type=write size=1377997 2023-12-03T11:28:26.549 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.548+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=X8YS367EPU4Q type=del size=171197 2023-12-03T11:28:26.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.549+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~3TZ8C28PMPBU.0 size=99893 2023-12-03T11:28:26.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.551+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=3TZ8C28PMPBU tag=7U47NJW7V38I type=write size=1148469 2023-12-03T11:28:26.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.552+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=TT8IPIBT6YRI type=del size=4189289 2023-12-03T11:28:26.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.553+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~NTIRDIT4ENQE.0 size=1048576 2023-12-03T11:28:26.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.554+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~NTIRDIT4ENQE.1 size=255795 2023-12-03T11:28:26.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.556+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=NTIRDIT4ENQE tag=NZAE387LBK8H type=write size=2352947 2023-12-03T11:28:26.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.557+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=6JFNXNX5ER77 type=del size=3233460 2023-12-03T11:28:26.560 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.559+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~Y4FLQH0MT9OB.0 size=1048576 2023-12-03T11:28:26.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.560+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~Y4FLQH0MT9OB.1 size=1008657 2023-12-03T11:28:26.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.562+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=Y4FLQH0MT9OB tag=7X0D2PFC13NV type=write size=3105809 2023-12-03T11:28:26.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.563+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=SVFUQLOLSIOA type=write size=53715 2023-12-03T11:28:26.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.564+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=XBOMIFR728D8 type=del 2023-12-03T11:28:26.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.565+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=2JY1ODP5DWQ5 type=del size=1744628 2023-12-03T11:28:26.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.566+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~2CP2F811KG5I.0 size=882612 2023-12-03T11:28:26.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.568+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=2CP2F811KG5I tag=A746YWUHZXU2 type=write size=1931188 2023-12-03T11:28:26.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.570+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~ZJQ7Y69SCQ2I.0 size=1048576 2023-12-03T11:28:26.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.571+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~ZJQ7Y69SCQ2I.1 size=1048576 2023-12-03T11:28:26.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.572+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~ZJQ7Y69SCQ2I.2 size=342366 2023-12-03T11:28:26.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.572+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=ZJQ7Y69SCQ2I tag=BHVXKMK20RBO type=write size=3488094 2023-12-03T11:28:26.574 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.573+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=PDSOLYY1JFYE type=del 2023-12-03T11:28:26.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.574+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=VQ3AQQP6J1S7 type=write size=1011452 2023-12-03T11:28:26.576 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.576+0000 7fe67fa49780 1 < canceled operation key=KMC5YD2M3I45 tag=CJGEKXQP80RL type=del size=2723283 2023-12-03T11:28:26.578 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.577+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=Z2HREAN33EON type=del size=3851477 2023-12-03T11:28:26.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.579+0000 7fe67fa49780 1 < suggested update operation key=IIW1Y6QYEODQ tag=NIABSN8U0BI8 type=write size=300562 2023-12-03T11:28:26.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.580+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=Q2S4U1T8E0AR type=del size=33812 2023-12-03T11:28:26.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.583+0000 7fe67fa49780 1 < suggested remove operation key=UL24DVOA31Y7 tag=WLUFI3WQQQ1U type=write 2023-12-03T11:28:26.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.584+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=1MX4CO8T9W39 type=del size=2278309 2023-12-03T11:28:26.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.585+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~5F1HK21979XB.0 size=1007375 2023-12-03T11:28:26.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.587+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=5F1HK21979XB tag=RR9U4P5URT4U type=write size=2055951 2023-12-03T11:28:26.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.590+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~YFZTKLAW8K6Z.0 size=1048576 2023-12-03T11:28:26.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.591+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~YFZTKLAW8K6Z.1 size=1048576 2023-12-03T11:28:26.592 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.591+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~YFZTKLAW8K6Z.2 size=680339 2023-12-03T11:28:26.593 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.591+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=YFZTKLAW8K6Z tag=BY6EI7WJ6LWT type=write size=3826067 2023-12-03T11:28:26.594 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.593+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~7A71OFDZSKDL.0 size=1048576 2023-12-03T11:28:26.594 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.594+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~7A71OFDZSKDL.1 size=787014 2023-12-03T11:28:26.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.596+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=7A71OFDZSKDL tag=8JR7YBMM1TCF type=write size=2884166 2023-12-03T11:28:26.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.597+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=CJO4I4S8F6CD type=del size=2914425 2023-12-03T11:28:26.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.598+0000 7fe67fa49780 1 < completed write operation key=XZHCD4R4EVZR tag=2OA8L101KHTU type=write size=539482 2023-12-03T11:28:26.601 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.600+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~W1H82B6G6BJ5.0 size=1048576 2023-12-03T11:28:26.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.601+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~W1H82B6G6BJ5.1 size=1048576 2023-12-03T11:28:26.603 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.602+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~W1H82B6G6BJ5.2 size=725158 2023-12-03T11:28:26.603 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.602+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=W1H82B6G6BJ5 tag=G4MMNBT0BOFY type=write size=3870886 2023-12-03T11:28:26.604 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.603+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~ZRTYHHNHLQ3K.0 size=1048576 2023-12-03T11:28:26.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.604+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~ZRTYHHNHLQ3K.1 size=1048576 2023-12-03T11:28:26.606 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.605+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~ZRTYHHNHLQ3K.2 size=791705 2023-12-03T11:28:26.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.608+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=ZRTYHHNHLQ3K tag=CKIU625WZG5C type=write size=3937433 2023-12-03T11:28:26.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.611+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=0YYE06PH1GMM type=del size=1054585 2023-12-03T11:28:26.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.612+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~EISUAA0T7KA8.0 size=1048576 2023-12-03T11:28:26.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.613+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~EISUAA0T7KA8.1 size=691715 2023-12-03T11:28:26.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.615+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=EISUAA0T7KA8 tag=H1Y9R586IJGV type=write size=2788867 2023-12-03T11:28:26.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.617+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~GCWVY3YG3QQD.0 size=402048 2023-12-03T11:28:26.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.617+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=GCWVY3YG3QQD tag=EVCNT1ZZ8X7G type=write size=1450624 2023-12-03T11:28:26.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.619+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~HLODXR8TVJ5U.0 size=771682 2023-12-03T11:28:26.622 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.621+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=HLODXR8TVJ5U tag=4NW8PYF22OY8 type=write size=1820258 2023-12-03T11:28:26.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.622+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=Q616658FI97J type=del size=3062491 2023-12-03T11:28:26.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.623+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=X8YS367EPU4Q type=del 2023-12-03T11:28:26.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.625+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~8RINBQGUPP3I.0 size=204819 2023-12-03T11:28:26.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.625+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=8RINBQGUPP3I tag=XXPO6O4NYL4Z type=write size=1253395 2023-12-03T11:28:26.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.626+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=TT8IPIBT6YRI type=del 2023-12-03T11:28:26.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.627+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=JCPQ2926FIVV type=del size=3033010 2023-12-03T11:28:26.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.629+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=6JFNXNX5ER77 type=del 2023-12-03T11:28:26.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.630+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=YI27EWII49W2 type=write size=67822 2023-12-03T11:28:26.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.632+0000 7fe67fa49780 1 < suggested remove operation key=Q6GBIBMIJRKV tag=SVFUQLOLSIOA type=write 2023-12-03T11:28:26.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.634+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~XQKSIPMNTX9P.0 size=1048576 2023-12-03T11:28:26.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.634+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~XQKSIPMNTX9P.1 size=355382 2023-12-03T11:28:26.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.635+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=XQKSIPMNTX9P tag=QGUD97RPQJ31 type=write size=2452534 2023-12-03T11:28:26.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.636+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=2JY1ODP5DWQ5 type=del 2023-12-03T11:28:26.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.638+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~4V0W0KU01FOR.0 size=1048576 2023-12-03T11:28:26.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.639+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~4V0W0KU01FOR.1 size=1011581 2023-12-03T11:28:26.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.639+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=4V0W0KU01FOR tag=K5D1FP8FX73I type=write size=3108733 2023-12-03T11:28:26.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.640+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~ZJQ7Y69SCQ2I.0 size=1048576 2023-12-03T11:28:26.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.641+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~ZJQ7Y69SCQ2I.1 size=1048576 2023-12-03T11:28:26.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.642+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~ZJQ7Y69SCQ2I.2 size=342366 2023-12-03T11:28:26.644 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.644+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=ZJQ7Y69SCQ2I tag=BHVXKMK20RBO type=write size=3488094 2023-12-03T11:28:26.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.645+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=I4TYOL87O5JV type=del size=3731017 2023-12-03T11:28:26.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.646+0000 7fe67fa49780 1 < completed write operation key=OH2XUEEYL9JO tag=VQ3AQQP6J1S7 type=write size=1011452 2023-12-03T11:28:26.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.647+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=ZIH3EMAQW1LV type=write size=386122 2023-12-03T11:28:26.650 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.649+0000 7fe67fa49780 1 < suggested remove operation key=9OD4G28SDLB4 tag=Z2HREAN33EON type=del 2023-12-03T11:28:26.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.650+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=5DJIOCA5G4ZW type=del size=583231 2023-12-03T11:28:26.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.651+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=Q2S4U1T8E0AR type=del 2023-12-03T11:28:26.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.652+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=NSLWG5KBQFL5 type=del size=1394491 2023-12-03T11:28:26.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.654+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=1MX4CO8T9W39 type=del 2023-12-03T11:28:26.656 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.655+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=N61NKK3JKW6T type=write size=127951 2023-12-03T11:28:26.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.656+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~YFZTKLAW8K6Z.0 size=1048576 2023-12-03T11:28:26.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.657+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~YFZTKLAW8K6Z.1 size=1048576 2023-12-03T11:28:26.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.657+0000 7fe67fa49780 1 < canceled part key=_multipart_DDHGOWEI7WEI.2~YFZTKLAW8K6Z.2 size=680339 2023-12-03T11:28:26.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.659+0000 7fe67fa49780 1 < canceled multipart upload key=DDHGOWEI7WEI upload=YFZTKLAW8K6Z tag=BY6EI7WJ6LWT type=write size=3826067 2023-12-03T11:28:26.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.660+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=0QIFPU550RMA type=del size=2234603 2023-12-03T11:28:26.663 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.662+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=CJO4I4S8F6CD type=del 2023-12-03T11:28:26.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.663+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=8R0M8YYAZ4KR type=del size=3700961 2023-12-03T11:28:26.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.664+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~W1H82B6G6BJ5.0 size=1048576 2023-12-03T11:28:26.666 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.665+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~W1H82B6G6BJ5.1 size=1048576 2023-12-03T11:28:26.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.666+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~W1H82B6G6BJ5.2 size=725158 2023-12-03T11:28:26.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.668+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=W1H82B6G6BJ5 tag=G4MMNBT0BOFY type=write size=3870886 2023-12-03T11:28:26.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.670+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~CH798NUNW62O.0 size=26525 2023-12-03T11:28:26.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.670+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=CH798NUNW62O tag=7804S8K8XXLC type=write size=1075101 2023-12-03T11:28:26.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.671+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=0YYE06PH1GMM type=del 2023-12-03T11:28:26.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.673+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~V2ZYORGI2CH6.0 size=1048576 2023-12-03T11:28:26.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.674+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~V2ZYORGI2CH6.1 size=733510 2023-12-03T11:28:26.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.674+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=V2ZYORGI2CH6 tag=8KZAZ9148OIL type=write size=2830662 2023-12-03T11:28:26.676 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.675+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~GCWVY3YG3QQD.0 size=402048 2023-12-03T11:28:26.678 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.677+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=GCWVY3YG3QQD tag=EVCNT1ZZ8X7G type=write size=1450624 2023-12-03T11:28:26.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.679+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~ZYEYYV9DHX2M.0 size=1048576 2023-12-03T11:28:26.681 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.680+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~ZYEYYV9DHX2M.1 size=1048576 2023-12-03T11:28:26.682 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.681+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~ZYEYYV9DHX2M.2 size=270765 2023-12-03T11:28:26.682 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.681+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=ZYEYYV9DHX2M tag=T3IP2JHBAUWD type=write size=3416493 2023-12-03T11:28:26.683 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.682+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=Q616658FI97J type=del 2023-12-03T11:28:26.684 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.683+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=HVCG187AAABZ type=del size=3429410 2023-12-03T11:28:26.685 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.684+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~8RINBQGUPP3I.0 size=204819 2023-12-03T11:28:26.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.686+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=8RINBQGUPP3I tag=XXPO6O4NYL4Z type=write size=1253395 2023-12-03T11:28:26.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.688+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~WCL2480LWK2S.0 size=291408 2023-12-03T11:28:26.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.688+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=WCL2480LWK2S tag=T4CREDJE5D23 type=write size=1339984 2023-12-03T11:28:26.690 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.689+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=JCPQ2926FIVV type=del 2023-12-03T11:28:26.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.691+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~CMG0F48PAHKF.0 size=1048576 2023-12-03T11:28:26.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.692+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~CMG0F48PAHKF.1 size=1048576 2023-12-03T11:28:26.694 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.693+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~CMG0F48PAHKF.2 size=1037244 2023-12-03T11:28:26.694 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.693+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=CMG0F48PAHKF tag=JG0Y2MJLHURT type=write size=4182972 2023-12-03T11:28:26.695 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.694+0000 7fe67fa49780 1 < completed write operation key=ASODFGLQ5VNY tag=YI27EWII49W2 type=write size=67822 2023-12-03T11:28:26.696 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.695+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=4RCUQEVZ736E type=del size=172808 2023-12-03T11:28:26.697 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.696+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~XQKSIPMNTX9P.0 size=1048576 2023-12-03T11:28:26.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.697+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~XQKSIPMNTX9P.1 size=355382 2023-12-03T11:28:26.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.699+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=XQKSIPMNTX9P tag=QGUD97RPQJ31 type=write size=2452534 2023-12-03T11:28:26.702 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.701+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=1Y2ETSP0V6IL type=del size=1669166 2023-12-03T11:28:26.703 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.702+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~4V0W0KU01FOR.0 size=1048576 2023-12-03T11:28:26.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.703+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~4V0W0KU01FOR.1 size=1011581 2023-12-03T11:28:26.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.705+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=4V0W0KU01FOR tag=K5D1FP8FX73I type=write size=3108733 2023-12-03T11:28:26.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.706+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=1VM9N4MW310I type=write size=483773 2023-12-03T11:28:26.708 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.707+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=I4TYOL87O5JV type=del 2023-12-03T11:28:26.709 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.708+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=XBZPUYNC5C7K type=del size=816193 2023-12-03T11:28:26.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.711+0000 7fe67fa49780 1 < suggested update operation key=ASODFGLQ5VNY tag=ZIH3EMAQW1LV type=write size=386122 2023-12-03T11:28:26.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.712+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=5FPFP7WS8S4R type=del size=424040 2023-12-03T11:28:26.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.713+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=5DJIOCA5G4ZW type=del 2023-12-03T11:28:26.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.715+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=1FLLIFH9YXJJ type=del size=844315 2023-12-03T11:28:26.717 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.716+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=NSLWG5KBQFL5 type=del 2023-12-03T11:28:26.719 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.718+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=SOY1JRJ3L160 type=del size=3762935 2023-12-03T11:28:26.720 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.719+0000 7fe67fa49780 1 < canceled operation key=CIB1NZHJGO46 tag=N61NKK3JKW6T type=write size=127951 2023-12-03T11:28:26.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.720+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=K2ZD7GFMCSZR type=del size=408310 2023-12-03T11:28:26.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.721+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=0QIFPU550RMA type=del 2023-12-03T11:28:26.723 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.722+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=S6N99ND5F77B type=write size=496929 2023-12-03T11:28:26.724 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.724+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=8R0M8YYAZ4KR type=del 2023-12-03T11:28:26.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.726+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~Q1EV4PWU1NQC.0 size=1048576 2023-12-03T11:28:26.728 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.727+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~Q1EV4PWU1NQC.1 size=436540 2023-12-03T11:28:26.728 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.727+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=Q1EV4PWU1NQC tag=YBGBBJ8FWWTG type=write size=2533692 2023-12-03T11:28:26.729 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.728+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~CH798NUNW62O.0 size=26525 2023-12-03T11:28:26.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.730+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=CH798NUNW62O tag=7804S8K8XXLC type=write size=1075101 2023-12-03T11:28:26.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.731+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=G7JTJ33CU948 type=write size=355345 2023-12-03T11:28:26.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.732+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~V2ZYORGI2CH6.0 size=1048576 2023-12-03T11:28:26.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.733+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~V2ZYORGI2CH6.1 size=733510 2023-12-03T11:28:26.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.735+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=V2ZYORGI2CH6 tag=8KZAZ9148OIL type=write size=2830662 2023-12-03T11:28:26.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.736+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=V38ORRABLVVG type=del size=2554570 2023-12-03T11:28:26.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.737+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~ZYEYYV9DHX2M.0 size=1048576 2023-12-03T11:28:26.739 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.738+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~ZYEYYV9DHX2M.1 size=1048576 2023-12-03T11:28:26.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.739+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~ZYEYYV9DHX2M.2 size=270765 2023-12-03T11:28:26.743 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.742+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=ZYEYYV9DHX2M tag=T3IP2JHBAUWD type=write size=3416493 2023-12-03T11:28:26.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.743+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=2D88N06GHV88 type=del size=1729017 2023-12-03T11:28:26.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.744+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=HVCG187AAABZ type=del 2023-12-03T11:28:26.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.746+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~SVB2ZAXD7RZB.0 size=703258 2023-12-03T11:28:26.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.746+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=SVB2ZAXD7RZB tag=KX17U42MVB3S type=write size=1751834 2023-12-03T11:28:26.748 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.747+0000 7fe67fa49780 1 < canceled part key=_multipart_ASODFGLQ5VNY.2~WCL2480LWK2S.0 size=291408 2023-12-03T11:28:26.750 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.749+0000 7fe67fa49780 1 < canceled multipart upload key=ASODFGLQ5VNY upload=WCL2480LWK2S tag=T4CREDJE5D23 type=write size=1339984 2023-12-03T11:28:26.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.751+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~ZXL4XCT0P3I2.0 size=1048576 2023-12-03T11:28:26.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.752+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~ZXL4XCT0P3I2.1 size=1048576 2023-12-03T11:28:26.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.753+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~ZXL4XCT0P3I2.2 size=927988 2023-12-03T11:28:26.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.753+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=ZXL4XCT0P3I2 tag=R96IRSUYFDDA type=write size=4073716 2023-12-03T11:28:26.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.754+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~CMG0F48PAHKF.0 size=1048576 2023-12-03T11:28:26.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.755+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~CMG0F48PAHKF.1 size=1048576 2023-12-03T11:28:26.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.756+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~CMG0F48PAHKF.2 size=1037244 2023-12-03T11:28:26.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.758+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=CMG0F48PAHKF tag=JG0Y2MJLHURT type=write size=4182972 2023-12-03T11:28:26.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.759+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=AF1WFRC8CWLM type=del size=2220646 2023-12-03T11:28:26.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.760+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=4RCUQEVZ736E type=del 2023-12-03T11:28:26.762 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.762+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=NXZHVXM0CHY0 type=del size=3363855 2023-12-03T11:28:26.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.763+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=1Y2ETSP0V6IL type=del 2023-12-03T11:28:26.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.765+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~XK85UR7JGM48.0 size=1048576 2023-12-03T11:28:26.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.766+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~XK85UR7JGM48.1 size=1048576 2023-12-03T11:28:26.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.767+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~XK85UR7JGM48.2 size=945235 2023-12-03T11:28:26.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.767+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=XK85UR7JGM48 tag=TIQWNMFLQAOP type=write size=4090963 2023-12-03T11:28:26.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.768+0000 7fe67fa49780 1 < completed write operation key=URVD2U16EW75 tag=1VM9N4MW310I type=write size=483773 2023-12-03T11:28:26.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.769+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=W6861PGQHPYG type=del size=349349 2023-12-03T11:28:26.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.771+0000 7fe67fa49780 1 < suggested update operation key=SXVBDBJ5B09V tag=XBZPUYNC5C7K type=del size=816193 2023-12-03T11:28:26.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.773+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~GCSMZF6O780I.0 size=1048576 2023-12-03T11:28:26.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.774+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~GCSMZF6O780I.1 size=1048576 2023-12-03T11:28:26.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.775+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~GCSMZF6O780I.2 size=45281 2023-12-03T11:28:26.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.775+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=GCSMZF6O780I tag=BWG3GFEUKDKO type=write size=3191009 2023-12-03T11:28:26.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.777+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=5FPFP7WS8S4R type=del 2023-12-03T11:28:26.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.778+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=ACQ8O6LOVOGK type=del size=970715 2023-12-03T11:28:26.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.780+0000 7fe67fa49780 1 < suggested update operation key=OH2XUEEYL9JO tag=1FLLIFH9YXJJ type=del size=844315 2023-12-03T11:28:26.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.781+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=UNRR0IVLJ7ER type=del size=477202 2023-12-03T11:28:26.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.782+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=SOY1JRJ3L160 type=del 2023-12-03T11:28:26.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.784+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~8SEGDDCTORKQ.0 size=978125 2023-12-03T11:28:26.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.784+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=8SEGDDCTORKQ tag=BZFGB7XTYBZB type=write size=2026701 2023-12-03T11:28:26.786 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.786+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=K2ZD7GFMCSZR type=del 2023-12-03T11:28:26.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.787+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=3OBRJ8MUBZ24 type=del size=2620492 2023-12-03T11:28:26.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.788+0000 7fe67fa49780 1 < canceled operation key=A7GOX2W0WB83 tag=S6N99ND5F77B type=write size=496929 2023-12-03T11:28:26.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.789+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=48O0TI6VYQU3 type=del size=727928 2023-12-03T11:28:26.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.790+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~Q1EV4PWU1NQC.0 size=1048576 2023-12-03T11:28:26.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.791+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~Q1EV4PWU1NQC.1 size=436540 2023-12-03T11:28:26.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.794+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=Q1EV4PWU1NQC tag=YBGBBJ8FWWTG type=write size=2533692 2023-12-03T11:28:26.796 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.795+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=95MYS1A339TE type=write size=818707 2023-12-03T11:28:26.799 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.798+0000 7fe67fa49780 1 < suggested remove operation key=XZHCD4R4EVZR tag=G7JTJ33CU948 type=write 2023-12-03T11:28:26.800 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.799+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=9Y1I9I0T89W0 type=del size=2243130 2023-12-03T11:28:26.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.800+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=V38ORRABLVVG type=del 2023-12-03T11:28:26.805 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.804+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~NFHPZVVLSBTB.0 size=1048576 2023-12-03T11:28:26.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.805+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~NFHPZVVLSBTB.1 size=1048576 2023-12-03T11:28:26.807 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.806+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~NFHPZVVLSBTB.2 size=180812 2023-12-03T11:28:26.807 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.806+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=NFHPZVVLSBTB tag=N9KEQ06VJ0GM type=write size=3326540 2023-12-03T11:28:26.808 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.807+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=2D88N06GHV88 type=del 2023-12-03T11:28:26.810 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.809+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~D4BQBHRFR7AB.0 size=1048576 2023-12-03T11:28:26.811 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.810+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~D4BQBHRFR7AB.1 size=155330 2023-12-03T11:28:26.811 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.810+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=D4BQBHRFR7AB tag=9I2TYA5XC685 type=write size=2252482 2023-12-03T11:28:26.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.812+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~SVB2ZAXD7RZB.0 size=703258 2023-12-03T11:28:26.815 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.814+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=SVB2ZAXD7RZB tag=KX17U42MVB3S type=write size=1751834 2023-12-03T11:28:26.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.815+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=RQ2EKO6821UM type=del size=1978126 2023-12-03T11:28:26.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.815+0000 7fe67fa49780 1 < canceled part key=_multipart_9AUO0SRFTAUJ.2~ZXL4XCT0P3I2.0 size=1048576 2023-12-03T11:28:26.817 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.816+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~ZXL4XCT0P3I2.1 size=1048576 2023-12-03T11:28:26.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.816+0000 7fe67fa49780 1 < canceled part key=_multipart_9AUO0SRFTAUJ.2~ZXL4XCT0P3I2.2 size=927988 2023-12-03T11:28:26.819 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.818+0000 7fe67fa49780 1 < canceled multipart upload key=9AUO0SRFTAUJ upload=ZXL4XCT0P3I2 tag=R96IRSUYFDDA type=write size=4073716 2023-12-03T11:28:26.820 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.819+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=32I0AKJVG1EU type=del size=2890823 2023-12-03T11:28:26.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.822+0000 7fe67fa49780 1 < suggested update operation key=ASODFGLQ5VNY tag=AF1WFRC8CWLM type=del size=2220646 2023-12-03T11:28:26.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.823+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=Z2IQPYE42L2O type=del size=3428754 2023-12-03T11:28:26.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.824+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=NXZHVXM0CHY0 type=del 2023-12-03T11:28:26.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.825+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=2R90A6W0NX79 type=del size=305425 2023-12-03T11:28:26.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.826+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~XK85UR7JGM48.0 size=1048576 2023-12-03T11:28:26.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.827+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~XK85UR7JGM48.1 size=1048576 2023-12-03T11:28:26.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.828+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~XK85UR7JGM48.2 size=945235 2023-12-03T11:28:26.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.831+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=XK85UR7JGM48 tag=TIQWNMFLQAOP type=write size=4090963 2023-12-03T11:28:26.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.833+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~HNE9BXA7I52Z.0 size=1048576 2023-12-03T11:28:26.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.833+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~HNE9BXA7I52Z.1 size=978766 2023-12-03T11:28:26.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.833+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=HNE9BXA7I52Z tag=2UUKQW89JXJH type=write size=3075918 2023-12-03T11:28:26.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.835+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=W6861PGQHPYG type=del 2023-12-03T11:28:26.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.836+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=5Y72O8JY91XK type=del size=747939 2023-12-03T11:28:26.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.837+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~GCSMZF6O780I.0 size=1048576 2023-12-03T11:28:26.839 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.838+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~GCSMZF6O780I.1 size=1048576 2023-12-03T11:28:26.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.839+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~GCSMZF6O780I.2 size=45281 2023-12-03T11:28:26.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.841+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=GCSMZF6O780I tag=BWG3GFEUKDKO type=write size=3191009 2023-12-03T11:28:26.843 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.842+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=7YWCLBAXITSX type=del size=2353645 2023-12-03T11:28:26.844 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.843+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=ACQ8O6LOVOGK type=del 2023-12-03T11:28:26.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.845+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~IA8Q3BNC8X6C.0 size=1048576 2023-12-03T11:28:26.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.846+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~IA8Q3BNC8X6C.1 size=1048576 2023-12-03T11:28:26.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.847+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~IA8Q3BNC8X6C.2 size=144465 2023-12-03T11:28:26.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.847+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=IA8Q3BNC8X6C tag=OBYT3U45H6LW type=write size=3290193 2023-12-03T11:28:26.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.848+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=UNRR0IVLJ7ER type=del 2023-12-03T11:28:26.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.849+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=Z21H4FUMFAXA type=del size=860370 2023-12-03T11:28:26.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.851+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~8SEGDDCTORKQ.0 size=978125 2023-12-03T11:28:26.853 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.852+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=8SEGDDCTORKQ tag=BZFGB7XTYBZB type=write size=2026701 2023-12-03T11:28:26.855 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.854+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~HR1OFZGHHCBI.0 size=1048576 2023-12-03T11:28:26.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.855+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~HR1OFZGHHCBI.1 size=1048576 2023-12-03T11:28:26.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.856+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~HR1OFZGHHCBI.2 size=394508 2023-12-03T11:28:26.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.856+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=HR1OFZGHHCBI tag=9G69GDFFVQ0K type=write size=3540236 2023-12-03T11:28:26.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.857+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=3OBRJ8MUBZ24 type=del 2023-12-03T11:28:26.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.859+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~X5JRV0D66RVS.0 size=1048576 2023-12-03T11:28:26.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.860+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~X5JRV0D66RVS.1 size=481873 2023-12-03T11:28:26.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.860+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=X5JRV0D66RVS tag=UIG9LRK0ESJ9 type=write size=2579025 2023-12-03T11:28:26.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.862+0000 7fe67fa49780 1 < suggested remove operation key=9AUO0SRFTAUJ tag=48O0TI6VYQU3 type=del 2023-12-03T11:28:26.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.863+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=B3LE67U9VVW6 type=del size=408952 2023-12-03T11:28:26.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.865+0000 7fe67fa49780 1 < completed write operation key=0GQZY07Y2PVI tag=95MYS1A339TE type=write size=818707 2023-12-03T11:28:26.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.867+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~9E4YSCZVF2FQ.0 size=1048576 2023-12-03T11:28:26.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.868+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~9E4YSCZVF2FQ.1 size=368909 2023-12-03T11:28:26.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.868+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=9E4YSCZVF2FQ tag=TUGLTUCNJSUK type=write size=2466061 2023-12-03T11:28:26.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.869+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=9Y1I9I0T89W0 type=del 2023-12-03T11:28:26.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.871+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~CEVEPBP53S5N.0 size=122178 2023-12-03T11:28:26.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.871+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=CEVEPBP53S5N tag=VE0F3GBI3DMV type=write size=1170754 2023-12-03T11:28:26.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.872+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~NFHPZVVLSBTB.0 size=1048576 2023-12-03T11:28:26.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.873+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~NFHPZVVLSBTB.1 size=1048576 2023-12-03T11:28:26.875 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.874+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~NFHPZVVLSBTB.2 size=180812 2023-12-03T11:28:26.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.876+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=NFHPZVVLSBTB tag=N9KEQ06VJ0GM type=write size=3326540 2023-12-03T11:28:26.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.877+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=Q709O871N4MQ type=del size=2062137 2023-12-03T11:28:26.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.877+0000 7fe67fa49780 1 < canceled part key=_multipart_0G8KNJBJ9K1Z.2~D4BQBHRFR7AB.0 size=1048576 2023-12-03T11:28:26.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.879+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~D4BQBHRFR7AB.1 size=155330 2023-12-03T11:28:26.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.880+0000 7fe67fa49780 1 < canceled multipart upload key=0G8KNJBJ9K1Z upload=D4BQBHRFR7AB tag=9I2TYA5XC685 type=write size=2252482 2023-12-03T11:28:26.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.882+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=4MRGL0RU85T6 type=del size=4018643 2023-12-03T11:28:26.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.883+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=RQ2EKO6821UM type=del 2023-12-03T11:28:26.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.884+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=GYDM9X0VO9CX type=del size=3404469 2023-12-03T11:28:26.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.885+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=32I0AKJVG1EU type=del 2023-12-03T11:28:26.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.886+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=1MA0KG5US1IG type=del size=3058425 2023-12-03T11:28:26.888 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.887+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=Z2IQPYE42L2O type=del 2023-12-03T11:28:26.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.889+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=MSCX5N3G67VU type=write size=826754 2023-12-03T11:28:26.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.890+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=2R90A6W0NX79 type=del 2023-12-03T11:28:26.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.891+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=WUV7TI90AL34 type=write size=81050 2023-12-03T11:28:26.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.892+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~HNE9BXA7I52Z.0 size=1048576 2023-12-03T11:28:26.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.893+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~HNE9BXA7I52Z.1 size=978766 2023-12-03T11:28:26.896 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.895+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=HNE9BXA7I52Z tag=2UUKQW89JXJH type=write size=3075918 2023-12-03T11:28:26.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.898+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~DIXZJSNC24GP.0 size=157465 2023-12-03T11:28:26.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.898+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=DIXZJSNC24GP tag=GT0QHLF3YJBY type=write size=1206041 2023-12-03T11:28:26.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.900+0000 7fe67fa49780 1 < suggested remove operation key=TXVHRE03Z3DA tag=5Y72O8JY91XK type=del 2023-12-03T11:28:26.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.901+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=GFZ3V7CZUWXG type=write size=669434 2023-12-03T11:28:26.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.904+0000 7fe67fa49780 1 < suggested remove operation key=983BDZLASC3S tag=7YWCLBAXITSX type=del 2023-12-03T11:28:26.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.905+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=YC1CDMCK5HT6 type=del size=2472869 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.906+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~IA8Q3BNC8X6C.0 size=1048576 2023-12-03T11:28:26.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.906+0000 7fe67fa49780 1 < canceled part key=_multipart_XZHCD4R4EVZR.2~IA8Q3BNC8X6C.1 size=1048576 2023-12-03T11:28:26.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.907+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~IA8Q3BNC8X6C.2 size=144465 2023-12-03T11:28:26.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.909+0000 7fe67fa49780 1 < canceled multipart upload key=XZHCD4R4EVZR upload=IA8Q3BNC8X6C tag=OBYT3U45H6LW type=write size=3290193 2023-12-03T11:28:26.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.918+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~91Z78CIGSWIV.0 size=1048576 2023-12-03T11:28:26.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.919+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~91Z78CIGSWIV.1 size=931165 2023-12-03T11:28:26.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.919+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=91Z78CIGSWIV tag=RHQTW29CMYR3 type=write size=3028317 2023-12-03T11:28:26.921 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.920+0000 7fe67fa49780 1 < canceled operation key=DDHGOWEI7WEI tag=Z21H4FUMFAXA type=del size=860370 2023-12-03T11:28:26.922 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.921+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=BP313H9SN311 type=del size=1672929 2023-12-03T11:28:26.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.923+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~HR1OFZGHHCBI.0 size=1048576 2023-12-03T11:28:26.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.923+0000 7fe67fa49780 1 < canceled part key=_multipart_A7GOX2W0WB83.2~HR1OFZGHHCBI.1 size=1048576 2023-12-03T11:28:26.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.923+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~HR1OFZGHHCBI.2 size=394508 2023-12-03T11:28:26.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.926+0000 7fe67fa49780 1 < canceled multipart upload key=A7GOX2W0WB83 upload=HR1OFZGHHCBI tag=9G69GDFFVQ0K type=write size=3540236 2023-12-03T11:28:26.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.928+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~KY0ZRSN60702.0 size=410723 2023-12-03T11:28:26.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.928+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=KY0ZRSN60702 tag=3GRPLTTVTUFB type=write size=1459299 2023-12-03T11:28:26.930 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.929+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~X5JRV0D66RVS.0 size=1048576 2023-12-03T11:28:26.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.930+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~X5JRV0D66RVS.1 size=481873 2023-12-03T11:28:26.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.932+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=X5JRV0D66RVS tag=UIG9LRK0ESJ9 type=write size=2579025 2023-12-03T11:28:26.935 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.934+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~OB3G0TKXGS3T.0 size=514460 2023-12-03T11:28:26.935 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.934+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=OB3G0TKXGS3T tag=8PIWCARSGB10 type=write size=1563036 2023-12-03T11:28:26.936 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.936+0000 7fe67fa49780 1 < canceled operation key=ASODFGLQ5VNY tag=B3LE67U9VVW6 type=del size=408952 2023-12-03T11:28:26.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.938+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~KOLMUNWW4EOO.0 size=595979 2023-12-03T11:28:26.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.938+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=KOLMUNWW4EOO tag=GMHPKKHUZRZ7 type=write size=1644555 2023-12-03T11:28:26.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.938+0000 7fe67fa49780 1 < canceled part key=_multipart_006X4CSXV0KA.2~9E4YSCZVF2FQ.0 size=1048576 2023-12-03T11:28:26.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.939+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~9E4YSCZVF2FQ.1 size=368909 2023-12-03T11:28:26.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.941+0000 7fe67fa49780 1 < canceled multipart upload key=006X4CSXV0KA upload=9E4YSCZVF2FQ tag=TUGLTUCNJSUK type=write size=2466061 2023-12-03T11:28:26.944 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.943+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~ZZKGLGWFISDD.0 size=1048576 2023-12-03T11:28:26.945 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.944+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~ZZKGLGWFISDD.1 size=1048576 2023-12-03T11:28:26.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.945+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~ZZKGLGWFISDD.2 size=363037 2023-12-03T11:28:26.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.945+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=ZZKGLGWFISDD tag=UBFEP7D6BTCH type=write size=3508765 2023-12-03T11:28:26.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.946+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~CEVEPBP53S5N.0 size=122178 2023-12-03T11:28:26.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.948+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=CEVEPBP53S5N tag=VE0F3GBI3DMV type=write size=1170754 2023-12-03T11:28:26.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.950+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~P3V4XR4FRPFO.0 size=1048576 2023-12-03T11:28:26.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.951+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~P3V4XR4FRPFO.1 size=417869 2023-12-03T11:28:26.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.951+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=P3V4XR4FRPFO tag=1CJKDHUP862S type=write size=2515021 2023-12-03T11:28:26.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.953+0000 7fe67fa49780 1 < suggested remove operation key=PFBGR7OF7JQG tag=Q709O871N4MQ type=del 2023-12-03T11:28:26.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.955+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=2DUTFKDNGGZA type=del size=3900948 2023-12-03T11:28:26.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.956+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=4MRGL0RU85T6 type=del 2023-12-03T11:28:26.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.957+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=4PEBIVOHW5X2 type=del size=3838702 2023-12-03T11:28:26.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.958+0000 7fe67fa49780 1 < canceled operation key=2GX6IWVZH25N tag=GYDM9X0VO9CX type=del size=3404469 2023-12-03T11:28:26.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.959+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=KZCCVXNSYFO3 type=del size=881214 2023-12-03T11:28:26.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.961+0000 7fe67fa49780 1 < suggested remove operation key=P05UIP1IU4Z7 tag=1MA0KG5US1IG type=del 2023-12-03T11:28:26.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.963+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~V6C6N6LDTDIR.0 size=1048576 2023-12-03T11:28:26.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.964+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~V6C6N6LDTDIR.1 size=1048576 2023-12-03T11:28:26.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.965+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~V6C6N6LDTDIR.2 size=610160 2023-12-03T11:28:26.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.965+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=V6C6N6LDTDIR tag=NW7AH2KXQC9Q type=write size=3755888 2023-12-03T11:28:26.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.966+0000 7fe67fa49780 1 < completed write operation key=CC1X1OP7L6BJ tag=MSCX5N3G67VU type=write size=826754 2023-12-03T11:28:26.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.967+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=P2PTT34THU0W type=del size=2381456 2023-12-03T11:28:26.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.969+0000 7fe67fa49780 1 < canceled operation key=8UZJU9PNWIB6 tag=WUV7TI90AL34 type=write size=81050 2023-12-03T11:28:26.971 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.970+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=99W20PYWOQZH type=del size=2703101 2023-12-03T11:28:26.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.971+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~DIXZJSNC24GP.0 size=157465 2023-12-03T11:28:26.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.973+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=DIXZJSNC24GP tag=GT0QHLF3YJBY type=write size=1206041 2023-12-03T11:28:26.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.975+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~H02B1T1XJIP9.0 size=1048576 2023-12-03T11:28:26.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.976+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~H02B1T1XJIP9.1 size=1048576 2023-12-03T11:28:26.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.977+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~H02B1T1XJIP9.2 size=1013149 2023-12-03T11:28:26.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.977+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=H02B1T1XJIP9 tag=ZWUBWQUO97TW type=write size=4158877 2023-12-03T11:28:26.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.978+0000 7fe67fa49780 1 < completed write operation key=0G8KNJBJ9K1Z tag=GFZ3V7CZUWXG type=write size=669434 2023-12-03T11:28:26.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.979+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=S3RND6GK4Z88 type=del size=623181 2023-12-03T11:28:26.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.981+0000 7fe67fa49780 1 < suggested remove operation key=SIES92K9QVJV tag=YC1CDMCK5HT6 type=del 2023-12-03T11:28:26.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.982+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=5WA1I5203IRZ type=write size=337145 2023-12-03T11:28:26.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.983+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~91Z78CIGSWIV.0 size=1048576 2023-12-03T11:28:26.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.984+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~91Z78CIGSWIV.1 size=931165 2023-12-03T11:28:26.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.986+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=91Z78CIGSWIV tag=RHQTW29CMYR3 type=write size=3028317 2023-12-03T11:28:26.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.988+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~6329I0GA7RD3.0 size=691349 2023-12-03T11:28:26.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.988+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=6329I0GA7RD3 tag=FUWFGUZLEYM8 type=write size=1739925 2023-12-03T11:28:26.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.990+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=BP313H9SN311 type=del 2023-12-03T11:28:26.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.991+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=T0IU0FW0S3OS type=del size=2515910 2023-12-03T11:28:26.993 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.992+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~KY0ZRSN60702.0 size=410723 2023-12-03T11:28:26.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.994+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=KY0ZRSN60702 tag=3GRPLTTVTUFB type=write size=1459299 2023-12-03T11:28:26.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.996+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~9W5YI6WL411K.0 size=400336 2023-12-03T11:28:26.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.996+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=9W5YI6WL411K tag=EAZIM1L1P7R2 type=write size=1448912 2023-12-03T11:28:26.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.997+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~OB3G0TKXGS3T.0 size=514460 2023-12-03T11:28:27.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:26.999+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=OB3G0TKXGS3T tag=8PIWCARSGB10 type=write size=1563036 2023-12-03T11:28:27.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.001+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~38WB5IIV7WJM.0 size=180525 2023-12-03T11:28:27.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.001+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=38WB5IIV7WJM tag=TJ7UT4UXWZKT type=write size=1229101 2023-12-03T11:28:27.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.002+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~KOLMUNWW4EOO.0 size=595979 2023-12-03T11:28:27.005 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.004+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=KOLMUNWW4EOO tag=GMHPKKHUZRZ7 type=write size=1644555 2023-12-03T11:28:27.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.006+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~R2TK78JPDRDG.0 size=1048576 2023-12-03T11:28:27.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.007+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~R2TK78JPDRDG.1 size=1048576 2023-12-03T11:28:27.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.008+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~R2TK78JPDRDG.2 size=34968 2023-12-03T11:28:27.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.008+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=R2TK78JPDRDG tag=MGXCFHBLW0IV type=write size=3180696 2023-12-03T11:28:27.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.009+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~ZZKGLGWFISDD.0 size=1048576 2023-12-03T11:28:27.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.010+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~ZZKGLGWFISDD.1 size=1048576 2023-12-03T11:28:27.012 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.011+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~ZZKGLGWFISDD.2 size=363037 2023-12-03T11:28:27.014 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.013+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=ZZKGLGWFISDD tag=UBFEP7D6BTCH type=write size=3508765 2023-12-03T11:28:27.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.015+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~3E988TUS8DYN.0 size=1048576 2023-12-03T11:28:27.017 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.016+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~3E988TUS8DYN.1 size=1048576 2023-12-03T11:28:27.018 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.017+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~3E988TUS8DYN.2 size=568592 2023-12-03T11:28:27.018 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.017+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=3E988TUS8DYN tag=GTC6P9PLS697 type=write size=3714320 2023-12-03T11:28:27.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.018+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~P3V4XR4FRPFO.0 size=1048576 2023-12-03T11:28:27.020 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.019+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~P3V4XR4FRPFO.1 size=417869 2023-12-03T11:28:27.022 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.021+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=P3V4XR4FRPFO tag=1CJKDHUP862S type=write size=2515021 2023-12-03T11:28:27.024 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.023+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~0KIVCCGYW8W4.0 size=434207 2023-12-03T11:28:27.024 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.023+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=0KIVCCGYW8W4 tag=6N81ETI7IYHC type=write size=1482783 2023-12-03T11:28:27.025 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.024+0000 7fe67fa49780 1 < canceled operation key=KMC5YD2M3I45 tag=2DUTFKDNGGZA type=del size=3900948 2023-12-03T11:28:27.027 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.026+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~ABQ7FFRNWV2T.0 size=1048576 2023-12-03T11:28:27.028 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.027+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~ABQ7FFRNWV2T.1 size=64468 2023-12-03T11:28:27.028 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.027+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=ABQ7FFRNWV2T tag=TIB0ZZG7GWMM type=write size=2161620 2023-12-03T11:28:27.029 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.028+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=4PEBIVOHW5X2 type=del 2023-12-03T11:28:27.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.029+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=J1VP5RY4D4UY type=del size=3866832 2023-12-03T11:28:27.031 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.030+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=KZCCVXNSYFO3 type=del 2023-12-03T11:28:27.033 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.032+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~KWM2YSYZF9W9.0 size=204311 2023-12-03T11:28:27.033 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.032+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=KWM2YSYZF9W9 tag=N1IF8KLBQPMV type=write size=1252887 2023-12-03T11:28:27.034 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.033+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~V6C6N6LDTDIR.0 size=1048576 2023-12-03T11:28:27.035 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.034+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~V6C6N6LDTDIR.1 size=1048576 2023-12-03T11:28:27.036 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.035+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~V6C6N6LDTDIR.2 size=610160 2023-12-03T11:28:27.038 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.037+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=V6C6N6LDTDIR tag=NW7AH2KXQC9Q type=write size=3755888 2023-12-03T11:28:27.039 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.038+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=L6JGGTR6YPDA type=del size=954501 2023-12-03T11:28:27.040 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.039+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=P2PTT34THU0W type=del 2023-12-03T11:28:27.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.041+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=9H9XRT1JFJ65 type=write size=264260 2023-12-03T11:28:27.043 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.042+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=99W20PYWOQZH type=del 2023-12-03T11:28:27.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.043+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=6FLDUNKU01SW type=del size=501419 2023-12-03T11:28:27.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.044+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~H02B1T1XJIP9.0 size=1048576 2023-12-03T11:28:27.046 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.045+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~H02B1T1XJIP9.1 size=1048576 2023-12-03T11:28:27.047 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.046+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~H02B1T1XJIP9.2 size=1013149 2023-12-03T11:28:27.049 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.048+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=H02B1T1XJIP9 tag=ZWUBWQUO97TW type=write size=4158877 2023-12-03T11:28:27.052 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.051+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~IML1PC9AISZ9.0 size=1048576 2023-12-03T11:28:27.053 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.052+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~IML1PC9AISZ9.1 size=1048576 2023-12-03T11:28:27.054 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.053+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~IML1PC9AISZ9.2 size=154603 2023-12-03T11:28:27.054 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.053+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=IML1PC9AISZ9 tag=SZM25K805VP9 type=write size=3300331 2023-12-03T11:28:27.055 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.054+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=S3RND6GK4Z88 type=del 2023-12-03T11:28:27.057 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.056+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~JSDRWOHS65IQ.0 size=1048576 2023-12-03T11:28:27.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.057+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~JSDRWOHS65IQ.1 size=68880 2023-12-03T11:28:27.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.057+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=JSDRWOHS65IQ tag=4OJLNOY264WE type=write size=2166032 2023-12-03T11:28:27.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.058+0000 7fe67fa49780 1 < completed write operation key=UL24DVOA31Y7 tag=5WA1I5203IRZ type=write size=337145 2023-12-03T11:28:27.060 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.059+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=833AG47FB4JS type=del size=261584 2023-12-03T11:28:27.061 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.060+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~6329I0GA7RD3.0 size=691349 2023-12-03T11:28:27.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.062+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=6329I0GA7RD3 tag=FUWFGUZLEYM8 type=write size=1739925 2023-12-03T11:28:27.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.063+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=PQ386HAJCR3Z type=del size=1846549 2023-12-03T11:28:27.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.064+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=T0IU0FW0S3OS type=del 2023-12-03T11:28:27.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.065+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=SCRYAGULGI92 type=del size=2776040 2023-12-03T11:28:27.068 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.067+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~9W5YI6WL411K.0 size=400336 2023-12-03T11:28:27.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.068+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=9W5YI6WL411K tag=EAZIM1L1P7R2 type=write size=1448912 2023-12-03T11:28:27.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.070+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=8OFTX2L009NL type=del size=1709367 2023-12-03T11:28:27.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.071+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~38WB5IIV7WJM.0 size=180525 2023-12-03T11:28:27.073 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.073+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=38WB5IIV7WJM tag=TJ7UT4UXWZKT type=write size=1229101 2023-12-03T11:28:27.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.074+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=AKTNUPC0718Q type=del size=3220560 2023-12-03T11:28:27.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.075+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~R2TK78JPDRDG.0 size=1048576 2023-12-03T11:28:27.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.076+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~R2TK78JPDRDG.1 size=1048576 2023-12-03T11:28:27.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.077+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~R2TK78JPDRDG.2 size=34968 2023-12-03T11:28:27.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.079+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=R2TK78JPDRDG tag=MGXCFHBLW0IV type=write size=3180696 2023-12-03T11:28:27.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.080+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=FYNGD9XSCQMO type=del size=1995295 2023-12-03T11:28:27.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.081+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~3E988TUS8DYN.0 size=1048576 2023-12-03T11:28:27.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.082+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~3E988TUS8DYN.1 size=1048576 2023-12-03T11:28:27.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.083+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~3E988TUS8DYN.2 size=568592 2023-12-03T11:28:27.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.085+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=3E988TUS8DYN tag=GTC6P9PLS697 type=write size=3714320 2023-12-03T11:28:27.088 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.087+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~J4IFGS8WPZPZ.0 size=1048576 2023-12-03T11:28:27.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.090+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~J4IFGS8WPZPZ.1 size=212713 2023-12-03T11:28:27.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.090+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=J4IFGS8WPZPZ tag=V147FB6H19PK type=write size=2309865 2023-12-03T11:28:27.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.091+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~0KIVCCGYW8W4.0 size=434207 2023-12-03T11:28:27.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.093+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=0KIVCCGYW8W4 tag=6N81ETI7IYHC type=write size=1482783 2023-12-03T11:28:27.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.095+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~EP01G58H8PS2.0 size=1048576 2023-12-03T11:28:27.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.096+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~EP01G58H8PS2.1 size=1048576 2023-12-03T11:28:27.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.097+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~EP01G58H8PS2.2 size=26655 2023-12-03T11:28:27.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.097+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=EP01G58H8PS2 tag=5HVBD7OXYYEG type=write size=3172383 2023-12-03T11:28:27.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.099+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~ABQ7FFRNWV2T.0 size=1048576 2023-12-03T11:28:27.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.100+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~ABQ7FFRNWV2T.1 size=64468 2023-12-03T11:28:27.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.101+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=ABQ7FFRNWV2T tag=TIB0ZZG7GWMM type=write size=2161620 2023-12-03T11:28:27.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.103+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=M2AAAVNYQYCP type=del size=3836328 2023-12-03T11:28:27.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.104+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=J1VP5RY4D4UY type=del 2023-12-03T11:28:27.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.106+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~JMYBZ79WATV9.0 size=1048576 2023-12-03T11:28:27.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.107+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~JMYBZ79WATV9.1 size=1048576 2023-12-03T11:28:27.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.109+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~JMYBZ79WATV9.2 size=796507 2023-12-03T11:28:27.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.109+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=JMYBZ79WATV9 tag=69LIAWYM9PN9 type=write size=3942235 2023-12-03T11:28:27.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.110+0000 7fe67fa49780 1 < canceled part key=_multipart_9OD4G28SDLB4.2~KWM2YSYZF9W9.0 size=204311 2023-12-03T11:28:27.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.112+0000 7fe67fa49780 1 < canceled multipart upload key=9OD4G28SDLB4 upload=KWM2YSYZF9W9 tag=N1IF8KLBQPMV type=write size=1252887 2023-12-03T11:28:27.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.114+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~17M1ABMSRTGB.0 size=1048576 2023-12-03T11:28:27.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.115+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~17M1ABMSRTGB.1 size=1048576 2023-12-03T11:28:27.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.116+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~17M1ABMSRTGB.2 size=443212 2023-12-03T11:28:27.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.116+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=17M1ABMSRTGB tag=Z0NSJ2FAL9YB type=write size=3588940 2023-12-03T11:28:27.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.118+0000 7fe67fa49780 1 < suggested update operation key=N87KA638VE01 tag=L6JGGTR6YPDA type=del size=954501 2023-12-03T11:28:27.121 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.120+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~BL1UJZ0IZAQ4.0 size=1048576 2023-12-03T11:28:27.122 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.121+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~BL1UJZ0IZAQ4.1 size=1048576 2023-12-03T11:28:27.123 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.122+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~BL1UJZ0IZAQ4.2 size=292002 2023-12-03T11:28:27.123 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.122+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=BL1UJZ0IZAQ4 tag=5BS0G0B0H1KY type=write size=3437730 2023-12-03T11:28:27.124 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.123+0000 7fe67fa49780 1 < completed write operation key=H8MBLWXG7BCZ tag=9H9XRT1JFJ65 type=write size=264260 2023-12-03T11:28:27.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.124+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=RVCX6O0NNUYN type=del size=3294342 2023-12-03T11:28:27.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.126+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=6FLDUNKU01SW type=del 2023-12-03T11:28:27.129 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.128+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~VWO30ETQ2DX3.0 size=737419 2023-12-03T11:28:27.129 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.128+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=VWO30ETQ2DX3 tag=HFH9ZAQNNBBE type=write size=1785995 2023-12-03T11:28:27.130 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.129+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~IML1PC9AISZ9.0 size=1048576 2023-12-03T11:28:27.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.130+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~IML1PC9AISZ9.1 size=1048576 2023-12-03T11:28:27.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.131+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~IML1PC9AISZ9.2 size=154603 2023-12-03T11:28:27.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.133+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=IML1PC9AISZ9 tag=SZM25K805VP9 type=write size=3300331 2023-12-03T11:28:27.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.135+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~QKTOX7R6Q1EV.0 size=950821 2023-12-03T11:28:27.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.135+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=QKTOX7R6Q1EV tag=I2HY14XCVJ85 type=write size=1999397 2023-12-03T11:28:27.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.136+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~JSDRWOHS65IQ.0 size=1048576 2023-12-03T11:28:27.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.137+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~JSDRWOHS65IQ.1 size=68880 2023-12-03T11:28:27.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.140+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=JSDRWOHS65IQ tag=4OJLNOY264WE type=write size=2166032 2023-12-03T11:28:27.142 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.141+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=MWE1UZFW5RVT type=del size=1660590 2023-12-03T11:28:27.145 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.144+0000 7fe67fa49780 1 < suggested update operation key=UL24DVOA31Y7 tag=833AG47FB4JS type=del size=261584 2023-12-03T11:28:27.146 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.145+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=YWJXH4W06URJ type=del size=2728487 2023-12-03T11:28:27.147 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.146+0000 7fe67fa49780 -1 < failed to complete operation key=UL24DVOA31Y7 tag=PQ386HAJCR3Z type=del size=1846549: (22) Invalid argument 2023-12-03T11:28:27.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.148+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=X7E7FQWVXXKH type=del size=2680298 2023-12-03T11:28:27.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.150+0000 7fe67fa49780 1 < suggested remove operation key=Q6GBIBMIJRKV tag=SCRYAGULGI92 type=del 2023-12-03T11:28:27.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.151+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=AZLG7I1VZD9V type=del size=2206576 2023-12-03T11:28:27.154 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.153+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=8OFTX2L009NL type=del 2023-12-03T11:28:27.155 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.154+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=N2QM01GVEVH7 type=del size=2717188 2023-12-03T11:28:27.156 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.155+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=AKTNUPC0718Q type=del 2023-12-03T11:28:27.158 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.157+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~D8N3UPXHS8IR.0 size=1048576 2023-12-03T11:28:27.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.158+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~D8N3UPXHS8IR.1 size=1048576 2023-12-03T11:28:27.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.159+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~D8N3UPXHS8IR.2 size=722764 2023-12-03T11:28:27.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.159+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=D8N3UPXHS8IR tag=WZTBDT0KQPRP type=write size=3868492 2023-12-03T11:28:27.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.160+0000 7fe67fa49780 -1 < no bi entry to suggest for operation key=Q6GBIBMIJRKV tag=FYNGD9XSCQMO type=del size=1995295: (2) No such file or directory 2023-12-03T11:28:27.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.161+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=NVYYRBWMIPOX type=del size=891666 2023-12-03T11:28:27.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.161+0000 7fe67fa49780 1 < canceled part key=_multipart_CIB1NZHJGO46.2~J4IFGS8WPZPZ.0 size=1048576 2023-12-03T11:28:27.164 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.163+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~J4IFGS8WPZPZ.1 size=212713 2023-12-03T11:28:27.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.166+0000 7fe67fa49780 1 < canceled multipart upload key=CIB1NZHJGO46 upload=J4IFGS8WPZPZ tag=V147FB6H19PK type=write size=2309865 2023-12-03T11:28:27.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.168+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~CQSN4WSOCJ7I.0 size=1048576 2023-12-03T11:28:27.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.169+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~CQSN4WSOCJ7I.1 size=1048576 2023-12-03T11:28:27.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.170+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~CQSN4WSOCJ7I.2 size=184959 2023-12-03T11:28:27.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.170+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=CQSN4WSOCJ7I tag=W24FZBJKQ8DT type=write size=3330687 2023-12-03T11:28:27.172 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.171+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~EP01G58H8PS2.0 size=1048576 2023-12-03T11:28:27.173 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.172+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~EP01G58H8PS2.1 size=1048576 2023-12-03T11:28:27.174 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.173+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~EP01G58H8PS2.2 size=26655 2023-12-03T11:28:27.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.175+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=EP01G58H8PS2 tag=5HVBD7OXYYEG type=write size=3172383 2023-12-03T11:28:27.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.177+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=GKMWNWFZCU5M type=del size=2207054 2023-12-03T11:28:27.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.178+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=M2AAAVNYQYCP type=del 2023-12-03T11:28:27.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.180+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=OELEPLEUJ3W6 type=del size=68845 2023-12-03T11:28:27.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.181+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~JMYBZ79WATV9.0 size=1048576 2023-12-03T11:28:27.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.181+0000 7fe67fa49780 1 < canceled part key=_multipart_Q6GBIBMIJRKV.2~JMYBZ79WATV9.1 size=1048576 2023-12-03T11:28:27.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.182+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~JMYBZ79WATV9.2 size=796507 2023-12-03T11:28:27.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.184+0000 7fe67fa49780 1 < canceled multipart upload key=Q6GBIBMIJRKV upload=JMYBZ79WATV9 tag=69LIAWYM9PN9 type=write size=3942235 2023-12-03T11:28:27.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.185+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=XR2V04EC47TW type=del size=296321 2023-12-03T11:28:27.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.185+0000 7fe67fa49780 1 < canceled part key=_multipart_H8MBLWXG7BCZ.2~17M1ABMSRTGB.0 size=1048576 2023-12-03T11:28:27.187 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.186+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~17M1ABMSRTGB.1 size=1048576 2023-12-03T11:28:27.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.187+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~17M1ABMSRTGB.2 size=443212 2023-12-03T11:28:27.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.189+0000 7fe67fa49780 1 < canceled multipart upload key=H8MBLWXG7BCZ upload=17M1ABMSRTGB tag=Z0NSJ2FAL9YB type=write size=3588940 2023-12-03T11:28:27.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.192+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~VSP87PD31Z16.0 size=1048576 2023-12-03T11:28:27.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.192+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~VSP87PD31Z16.1 size=1048576 2023-12-03T11:28:27.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.193+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~VSP87PD31Z16.2 size=502579 2023-12-03T11:28:27.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.193+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=VSP87PD31Z16 tag=GDXD0KFOGH72 type=write size=3648307 2023-12-03T11:28:27.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.195+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~BL1UJZ0IZAQ4.0 size=1048576 2023-12-03T11:28:27.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.196+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~BL1UJZ0IZAQ4.1 size=1048576 2023-12-03T11:28:27.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.197+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~BL1UJZ0IZAQ4.2 size=292002 2023-12-03T11:28:27.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.199+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=BL1UJZ0IZAQ4 tag=5BS0G0B0H1KY type=write size=3437730 2023-12-03T11:28:27.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.200+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=L9N66D6JS67S type=del size=818588 2023-12-03T11:28:27.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.202+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=RVCX6O0NNUYN type=del 2023-12-03T11:28:27.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.203+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=7ACCT7RIOPZB type=del size=1283246 2023-12-03T11:28:27.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.203+0000 7fe67fa49780 1 < canceled part key=_multipart_XZHCD4R4EVZR.2~VWO30ETQ2DX3.0 size=737419 2023-12-03T11:28:27.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.205+0000 7fe67fa49780 1 < canceled multipart upload key=XZHCD4R4EVZR upload=VWO30ETQ2DX3 tag=HFH9ZAQNNBBE type=write size=1785995 2023-12-03T11:28:27.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.207+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~J13Q11HI2JQE.0 size=711036 2023-12-03T11:28:27.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.207+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=J13Q11HI2JQE tag=0JMJJEOH70RD type=write size=1759612 2023-12-03T11:28:27.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.208+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~QKTOX7R6Q1EV.0 size=950821 2023-12-03T11:28:27.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.210+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=QKTOX7R6Q1EV tag=I2HY14XCVJ85 type=write size=1999397 2023-12-03T11:28:27.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.211+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=DI688UPSWUM4 type=write size=167535 2023-12-03T11:28:27.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.212+0000 7fe67fa49780 1 < canceled operation key=6LQ18VAE3ZN6 tag=MWE1UZFW5RVT type=del size=1660590 2023-12-03T11:28:27.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.214+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=AMMYLLC7NX2A type=del size=3310596 2023-12-03T11:28:27.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.215+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=YWJXH4W06URJ type=del 2023-12-03T11:28:27.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.217+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~TFZY4P0JIMV4.0 size=1048576 2023-12-03T11:28:27.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.218+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~TFZY4P0JIMV4.1 size=1048576 2023-12-03T11:28:27.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.218+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~TFZY4P0JIMV4.2 size=995283 2023-12-03T11:28:27.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.218+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=TFZY4P0JIMV4 tag=HZTUIWUC4L7G type=write size=4141011 2023-12-03T11:28:27.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.220+0000 7fe67fa49780 1 < canceled operation key=PFBGR7OF7JQG tag=X7E7FQWVXXKH type=del size=2680298 2023-12-03T11:28:27.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.221+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=YZOAZ12TL97M type=del size=1655274 2023-12-03T11:28:27.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.222+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=AZLG7I1VZD9V type=del 2023-12-03T11:28:27.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.223+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=PSBGPS4TPHZV type=del size=794257 2023-12-03T11:28:27.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.224+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=N2QM01GVEVH7 type=del 2023-12-03T11:28:27.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.225+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=3GDZXK3571IM type=del size=83223 2023-12-03T11:28:27.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.226+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~D8N3UPXHS8IR.0 size=1048576 2023-12-03T11:28:27.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.227+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~D8N3UPXHS8IR.1 size=1048576 2023-12-03T11:28:27.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.228+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~D8N3UPXHS8IR.2 size=722764 2023-12-03T11:28:27.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.230+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=D8N3UPXHS8IR tag=WZTBDT0KQPRP type=write size=3868492 2023-12-03T11:28:27.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.231+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=HJHFOBB1019P type=del size=1039885 2023-12-03T11:28:27.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.232+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=NVYYRBWMIPOX type=del 2023-12-03T11:28:27.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.233+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=MBPEXXXNYXUV type=del size=3096729 2023-12-03T11:28:27.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.235+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~CQSN4WSOCJ7I.0 size=1048576 2023-12-03T11:28:27.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.235+0000 7fe67fa49780 1 < canceled part key=_multipart_ASODFGLQ5VNY.2~CQSN4WSOCJ7I.1 size=1048576 2023-12-03T11:28:27.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.236+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~CQSN4WSOCJ7I.2 size=184959 2023-12-03T11:28:27.238 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.238+0000 7fe67fa49780 1 < canceled multipart upload key=ASODFGLQ5VNY upload=CQSN4WSOCJ7I tag=W24FZBJKQ8DT type=write size=3330687 2023-12-03T11:28:27.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.239+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=4GYZ3WO0QLZW type=write size=785152 2023-12-03T11:28:27.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.240+0000 7fe67fa49780 1 < canceled operation key=983BDZLASC3S tag=GKMWNWFZCU5M type=del size=2207054 2023-12-03T11:28:27.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.242+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~B11P1Q9W2RVF.0 size=1048576 2023-12-03T11:28:27.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.243+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~B11P1Q9W2RVF.1 size=436217 2023-12-03T11:28:27.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.243+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=B11P1Q9W2RVF tag=6FITUJL3FN1S type=write size=2533369 2023-12-03T11:28:27.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.244+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=OELEPLEUJ3W6 type=del 2023-12-03T11:28:27.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.245+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=2T6WEQMBTDL6 type=del size=2275289 2023-12-03T11:28:27.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.246+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=XR2V04EC47TW type=del 2023-12-03T11:28:27.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.247+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=3WQ7VW9YLJZF type=write size=178663 2023-12-03T11:28:27.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.248+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~VSP87PD31Z16.0 size=1048576 2023-12-03T11:28:27.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.248+0000 7fe67fa49780 1 < canceled part key=_multipart_9OD4G28SDLB4.2~VSP87PD31Z16.1 size=1048576 2023-12-03T11:28:27.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.249+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~VSP87PD31Z16.2 size=502579 2023-12-03T11:28:27.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.251+0000 7fe67fa49780 1 < canceled multipart upload key=9OD4G28SDLB4 upload=VSP87PD31Z16 tag=GDXD0KFOGH72 type=write size=3648307 2023-12-03T11:28:27.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.253+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~KU9CS2ALQ9UE.0 size=1048576 2023-12-03T11:28:27.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.254+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~KU9CS2ALQ9UE.1 size=796024 2023-12-03T11:28:27.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.254+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=KU9CS2ALQ9UE tag=8SPCZ62HPMFU type=write size=2893176 2023-12-03T11:28:27.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.255+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=L9N66D6JS67S type=del 2023-12-03T11:28:27.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.256+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=VPYN6DANCL4K type=del size=1315123 2023-12-03T11:28:27.258 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.257+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=7ACCT7RIOPZB type=del 2023-12-03T11:28:27.259 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.258+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=OMTHJF0ZTZXS type=write size=904069 2023-12-03T11:28:27.260 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.259+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~J13Q11HI2JQE.0 size=711036 2023-12-03T11:28:27.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.261+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=J13Q11HI2JQE tag=0JMJJEOH70RD type=write size=1759612 2023-12-03T11:28:27.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.262+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=ZO3UE35FXOLH type=write size=1019702 2023-12-03T11:28:27.264 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.263+0000 7fe67fa49780 1 < canceled operation key=YEMPVKMDANPG tag=DI688UPSWUM4 type=write size=167535 2023-12-03T11:28:27.265 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.264+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=WNNU5N0ZNXYO type=del size=4138789 2023-12-03T11:28:27.267 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.267+0000 7fe67fa49780 1 < suggested update operation key=XZHCD4R4EVZR tag=AMMYLLC7NX2A type=del size=3310596 2023-12-03T11:28:27.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.268+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=V3HA36C199MM type=del size=3738686 2023-12-03T11:28:27.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.268+0000 7fe67fa49780 1 < canceled part key=_multipart_CIB1NZHJGO46.2~TFZY4P0JIMV4.0 size=1048576 2023-12-03T11:28:27.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.269+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~TFZY4P0JIMV4.1 size=1048576 2023-12-03T11:28:27.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.270+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~TFZY4P0JIMV4.2 size=995283 2023-12-03T11:28:27.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.272+0000 7fe67fa49780 1 < canceled multipart upload key=CIB1NZHJGO46 upload=TFZY4P0JIMV4 tag=HZTUIWUC4L7G type=write size=4141011 2023-12-03T11:28:27.274 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.273+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=AYYRPPXB5HGO type=del size=312434 2023-12-03T11:28:27.275 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.275+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=YZOAZ12TL97M type=del 2023-12-03T11:28:27.277 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.276+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=IVLNBGK913IW type=del size=2125521 2023-12-03T11:28:27.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.277+0000 7fe67fa49780 -1 < failed to complete operation key=XZHCD4R4EVZR tag=PSBGPS4TPHZV type=del size=794257: (22) Invalid argument 2023-12-03T11:28:27.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.278+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=EDSCDEJZZ1X1 type=del size=909620 2023-12-03T11:28:27.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.279+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=3GDZXK3571IM type=del 2023-12-03T11:28:27.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.280+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=3I8AOJCXQDM7 type=del size=3491887 2023-12-03T11:28:27.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.281+0000 7fe67fa49780 1 < canceled operation key=8UZJU9PNWIB6 tag=HJHFOBB1019P type=del size=1039885 2023-12-03T11:28:27.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.283+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~WMMHBVJLUXHO.0 size=1048576 2023-12-03T11:28:27.285 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.284+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~WMMHBVJLUXHO.1 size=441633 2023-12-03T11:28:27.285 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.284+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=WMMHBVJLUXHO tag=73PWX0C32J45 type=write size=2538785 2023-12-03T11:28:27.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.287+0000 7fe67fa49780 1 < suggested remove operation key=ASODFGLQ5VNY tag=MBPEXXXNYXUV type=del 2023-12-03T11:28:27.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.288+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=KBB11OUJ1TO2 type=del size=3414079 2023-12-03T11:28:27.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.289+0000 7fe67fa49780 1 < completed write operation key=0G8KNJBJ9K1Z tag=4GYZ3WO0QLZW type=write size=785152 2023-12-03T11:28:27.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.290+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=K3MIC880ROT9 type=del size=2548683 2023-12-03T11:28:27.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.291+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~B11P1Q9W2RVF.0 size=1048576 2023-12-03T11:28:27.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.292+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~B11P1Q9W2RVF.1 size=436217 2023-12-03T11:28:27.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.294+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=B11P1Q9W2RVF tag=6FITUJL3FN1S type=write size=2533369 2023-12-03T11:28:27.297 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.296+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~0WXTY2QGD2NZ.0 size=292398 2023-12-03T11:28:27.297 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.296+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=0WXTY2QGD2NZ tag=K1U90EDJBBAL type=write size=1340974 2023-12-03T11:28:27.298 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.297+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=2T6WEQMBTDL6 type=del 2023-12-03T11:28:27.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.299+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=FMHJ20O0XO7V type=write size=913368 2023-12-03T11:28:27.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.300+0000 7fe67fa49780 1 < completed write operation key=YEMPVKMDANPG tag=3WQ7VW9YLJZF type=write size=178663 2023-12-03T11:28:27.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.301+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=RMDDGXLITKOJ type=del size=2178637 2023-12-03T11:28:27.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.302+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~KU9CS2ALQ9UE.0 size=1048576 2023-12-03T11:28:27.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.303+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~KU9CS2ALQ9UE.1 size=796024 2023-12-03T11:28:27.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.305+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=KU9CS2ALQ9UE tag=8SPCZ62HPMFU type=write size=2893176 2023-12-03T11:28:27.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.306+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=ECUIFK2WAZWX type=del size=1266221 2023-12-03T11:28:27.308 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.307+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=VPYN6DANCL4K type=del 2023-12-03T11:28:27.310 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.309+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~6CRM0E32MDXF.0 size=1048576 2023-12-03T11:28:27.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.310+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~6CRM0E32MDXF.1 size=120129 2023-12-03T11:28:27.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.310+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=6CRM0E32MDXF tag=0R5AHHXWXMF0 type=write size=2217281 2023-12-03T11:28:27.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.311+0000 7fe67fa49780 1 < completed write operation key=Y0VRZR6S8FP6 tag=OMTHJF0ZTZXS type=write size=904069 2023-12-03T11:28:27.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.312+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=XGFPZ66M96TJ type=del size=3364913 2023-12-03T11:28:27.315 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.314+0000 7fe67fa49780 1 < suggested remove operation key=9AUO0SRFTAUJ tag=ZO3UE35FXOLH type=write 2023-12-03T11:28:27.316 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.315+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=W7CDCTK24OYO type=del size=3635276 2023-12-03T11:28:27.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.317+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=WNNU5N0ZNXYO type=del 2023-12-03T11:28:27.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.319+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~E2VRSYJMA19C.0 size=1048576 2023-12-03T11:28:27.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.319+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~E2VRSYJMA19C.1 size=1005162 2023-12-03T11:28:27.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.319+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=E2VRSYJMA19C tag=KPXJ5DMT7RMK type=write size=3102314 2023-12-03T11:28:27.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.321+0000 7fe67fa49780 1 < canceled operation key=XZHCD4R4EVZR tag=V3HA36C199MM type=del size=3738686 2023-12-03T11:28:27.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.323+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~WOGX94M39TMU.0 size=1048576 2023-12-03T11:28:27.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.324+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~WOGX94M39TMU.1 size=1048576 2023-12-03T11:28:27.326 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.325+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~WOGX94M39TMU.2 size=681337 2023-12-03T11:28:27.326 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.325+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=WOGX94M39TMU tag=0HWO21VARSXS type=write size=3827065 2023-12-03T11:28:27.327 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.326+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=AYYRPPXB5HGO type=del 2023-12-03T11:28:27.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.329+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~87OOZHBKW6I2.0 size=1048576 2023-12-03T11:28:27.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.330+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~87OOZHBKW6I2.1 size=1048576 2023-12-03T11:28:27.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.331+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~87OOZHBKW6I2.2 size=757684 2023-12-03T11:28:27.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.331+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=87OOZHBKW6I2 tag=TON594GU0WZ8 type=write size=3903412 2023-12-03T11:28:27.333 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.332+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=IVLNBGK913IW type=del 2023-12-03T11:28:27.335 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.334+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~ZGC6QWD5TVIH.0 size=1048576 2023-12-03T11:28:27.336 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.335+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~ZGC6QWD5TVIH.1 size=1048576 2023-12-03T11:28:27.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.336+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~ZGC6QWD5TVIH.2 size=51495 2023-12-03T11:28:27.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.336+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=ZGC6QWD5TVIH tag=T3J55XP73FK6 type=write size=3197223 2023-12-03T11:28:27.338 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.337+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=EDSCDEJZZ1X1 type=del 2023-12-03T11:28:27.339 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.338+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=RE2WHD5SOZJE type=del size=3136394 2023-12-03T11:28:27.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.339+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=3I8AOJCXQDM7 type=del 2023-12-03T11:28:27.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.340+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=J3U1235MU39K type=write size=139543 2023-12-03T11:28:27.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.341+0000 7fe67fa49780 1 < canceled part key=_multipart_PFBGR7OF7JQG.2~WMMHBVJLUXHO.0 size=1048576 2023-12-03T11:28:27.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.342+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~WMMHBVJLUXHO.1 size=441633 2023-12-03T11:28:27.344 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.344+0000 7fe67fa49780 1 < canceled multipart upload key=PFBGR7OF7JQG upload=WMMHBVJLUXHO tag=73PWX0C32J45 type=write size=2538785 2023-12-03T11:28:27.346 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.345+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=W17NA31BY3EM type=write size=259641 2023-12-03T11:28:27.347 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.346+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=KBB11OUJ1TO2 type=del 2023-12-03T11:28:27.349 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.348+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~HK4WT7WTKEJ4.0 size=914985 2023-12-03T11:28:27.349 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.348+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=HK4WT7WTKEJ4 tag=2AP8943SZGSM type=write size=1963561 2023-12-03T11:28:27.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.349+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=K3MIC880ROT9 type=del 2023-12-03T11:28:27.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.350+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=7L6GYUSOI8MP type=del size=1574329 2023-12-03T11:28:27.352 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.351+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~0WXTY2QGD2NZ.0 size=292398 2023-12-03T11:28:27.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.353+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=0WXTY2QGD2NZ tag=K1U90EDJBBAL type=write size=1340974 2023-12-03T11:28:27.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.354+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=XMKPDJ05RZFH type=del size=1929165 2023-12-03T11:28:27.357 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.356+0000 7fe67fa49780 1 < suggested remove operation key=2GX6IWVZH25N tag=FMHJ20O0XO7V type=write 2023-12-03T11:28:27.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.358+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=8K9TH0V2X5AF type=del size=1931684 2023-12-03T11:28:27.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.359+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=RMDDGXLITKOJ type=del 2023-12-03T11:28:27.362 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.361+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~B8C0EC2LSDE2.0 size=845965 2023-12-03T11:28:27.362 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.361+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=B8C0EC2LSDE2 tag=OOE2QCD7HZNC type=write size=1894541 2023-12-03T11:28:27.363 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.362+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=ECUIFK2WAZWX type=del 2023-12-03T11:28:27.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.363+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=HQ6IQKFCWQH1 type=del size=1830193 2023-12-03T11:28:27.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.364+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~6CRM0E32MDXF.0 size=1048576 2023-12-03T11:28:27.366 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.365+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~6CRM0E32MDXF.1 size=120129 2023-12-03T11:28:27.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.367+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=6CRM0E32MDXF tag=0R5AHHXWXMF0 type=write size=2217281 2023-12-03T11:28:27.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.368+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=P1NZ9ME5I823 type=del size=863680 2023-12-03T11:28:27.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.369+0000 7fe67fa49780 1 < canceled operation key=URVD2U16EW75 tag=XGFPZ66M96TJ type=del size=3364913 2023-12-03T11:28:27.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.371+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=YE5JPVCP0M5L type=write size=90565 2023-12-03T11:28:27.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.373+0000 7fe67fa49780 1 < suggested update operation key=UL24DVOA31Y7 tag=W7CDCTK24OYO type=del size=3635276 2023-12-03T11:28:27.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.376+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~0WWHXRHQ52GQ.0 size=1048576 2023-12-03T11:28:27.377 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.377+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~0WWHXRHQ52GQ.1 size=215853 2023-12-03T11:28:27.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.377+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=0WWHXRHQ52GQ tag=N6NEY4BTGGSU type=write size=2313005 2023-12-03T11:28:27.379 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.378+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~E2VRSYJMA19C.0 size=1048576 2023-12-03T11:28:27.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.379+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~E2VRSYJMA19C.1 size=1005162 2023-12-03T11:28:27.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.382+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=E2VRSYJMA19C tag=KPXJ5DMT7RMK type=write size=3102314 2023-12-03T11:28:27.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.383+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=OYLYIYFJX216 type=del size=2247569 2023-12-03T11:28:27.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.384+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~WOGX94M39TMU.0 size=1048576 2023-12-03T11:28:27.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.385+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~WOGX94M39TMU.1 size=1048576 2023-12-03T11:28:27.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.386+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~WOGX94M39TMU.2 size=681337 2023-12-03T11:28:27.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.388+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=WOGX94M39TMU tag=0HWO21VARSXS type=write size=3827065 2023-12-03T11:28:27.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.389+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=6MS0UAX60SY6 type=del size=3383342 2023-12-03T11:28:27.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.391+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~87OOZHBKW6I2.0 size=1048576 2023-12-03T11:28:27.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.392+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~87OOZHBKW6I2.1 size=1048576 2023-12-03T11:28:27.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.393+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~87OOZHBKW6I2.2 size=757684 2023-12-03T11:28:27.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.394+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=87OOZHBKW6I2 tag=TON594GU0WZ8 type=write size=3903412 2023-12-03T11:28:27.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.396+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=Q63R7BFG1RE3 type=del size=1943578 2023-12-03T11:28:27.398 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.397+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~ZGC6QWD5TVIH.0 size=1048576 2023-12-03T11:28:27.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.398+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~ZGC6QWD5TVIH.1 size=1048576 2023-12-03T11:28:27.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.399+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~ZGC6QWD5TVIH.2 size=51495 2023-12-03T11:28:27.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.401+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=ZGC6QWD5TVIH tag=T3J55XP73FK6 type=write size=3197223 2023-12-03T11:28:27.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.402+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=H6ZTWZMB295K type=del size=91494 2023-12-03T11:28:27.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.403+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=RE2WHD5SOZJE type=del 2023-12-03T11:28:27.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.404+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=RUJYX8I00Y2Z type=write size=642843 2023-12-03T11:28:27.406 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.405+0000 7fe67fa49780 1 < completed write operation key=9OD4G28SDLB4 tag=J3U1235MU39K type=write size=139543 2023-12-03T11:28:27.407 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.406+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=085N03O3IHHZ type=del size=13233 2023-12-03T11:28:27.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.407+0000 7fe67fa49780 1 < completed write operation key=A7GOX2W0WB83 tag=W17NA31BY3EM type=write size=259641 2023-12-03T11:28:27.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.409+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~D5ZTYLRY1XAW.0 size=1048576 2023-12-03T11:28:27.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.410+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~D5ZTYLRY1XAW.1 size=1048576 2023-12-03T11:28:27.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.411+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~D5ZTYLRY1XAW.2 size=657614 2023-12-03T11:28:27.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.411+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=D5ZTYLRY1XAW tag=ZNM8750NC0WA type=write size=3803342 2023-12-03T11:28:27.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.412+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~HK4WT7WTKEJ4.0 size=914985 2023-12-03T11:28:27.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.414+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=HK4WT7WTKEJ4 tag=2AP8943SZGSM type=write size=1963561 2023-12-03T11:28:27.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.415+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=ITY2R5QKQ80F type=del size=1037480 2023-12-03T11:28:27.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.418+0000 7fe67fa49780 1 < suggested update operation key=P05UIP1IU4Z7 tag=7L6GYUSOI8MP type=del size=1574329 2023-12-03T11:28:27.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.419+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=6QYXTZGAXXMQ type=write size=545075 2023-12-03T11:28:27.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.420+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=XMKPDJ05RZFH type=del 2023-12-03T11:28:27.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.423+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~2210Y5N7W1TB.0 size=721770 2023-12-03T11:28:27.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.423+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=2210Y5N7W1TB tag=3V66DCBQ21HA type=write size=1770346 2023-12-03T11:28:27.425 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.424+0000 7fe67fa49780 1 < canceled operation key=Y0VRZR6S8FP6 tag=8K9TH0V2X5AF type=del size=1931684 2023-12-03T11:28:27.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.425+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=WKKGF1SH4TL4 type=del size=3404246 2023-12-03T11:28:27.427 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.426+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~B8C0EC2LSDE2.0 size=845965 2023-12-03T11:28:27.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.428+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=B8C0EC2LSDE2 tag=OOE2QCD7HZNC type=write size=1894541 2023-12-03T11:28:27.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.429+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=C2VMJK0QD8XU type=write size=48252 2023-12-03T11:28:27.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.431+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=HQ6IQKFCWQH1 type=del 2023-12-03T11:28:27.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.432+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=M9X8Q36UAH2M type=del size=2243550 2023-12-03T11:28:27.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.433+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=P1NZ9ME5I823 type=del 2023-12-03T11:28:27.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.434+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=ZNLXH510Y6LJ type=del size=2139491 2023-12-03T11:28:27.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.435+0000 7fe67fa49780 1 < completed write operation key=PFBGR7OF7JQG tag=YE5JPVCP0M5L type=write size=90565 2023-12-03T11:28:27.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.436+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=YN8ERXI442CP type=del size=454231 2023-12-03T11:28:27.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.438+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~0WWHXRHQ52GQ.0 size=1048576 2023-12-03T11:28:27.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.439+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~0WWHXRHQ52GQ.1 size=215853 2023-12-03T11:28:27.442 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.441+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=0WWHXRHQ52GQ tag=N6NEY4BTGGSU type=write size=2313005 2023-12-03T11:28:27.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.442+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=Q0Y17CKWR5N3 type=write size=292720 2023-12-03T11:28:27.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.443+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=OYLYIYFJX216 type=del 2023-12-03T11:28:27.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.445+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=S1N0UON0J3O5 type=del size=106850 2023-12-03T11:28:27.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.446+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=6MS0UAX60SY6 type=del 2023-12-03T11:28:27.448 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.447+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=5LVD83FHY14K type=write size=695399 2023-12-03T11:28:27.450 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.449+0000 7fe67fa49780 1 < canceled operation key=ASODFGLQ5VNY tag=Q63R7BFG1RE3 type=del size=1943578 2023-12-03T11:28:27.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.450+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=8UC52AUHH2A3 type=del size=1539177 2023-12-03T11:28:27.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.451+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=H6ZTWZMB295K type=del 2023-12-03T11:28:27.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.454+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~3U2TVYBWXA8V.0 size=1048576 2023-12-03T11:28:27.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.455+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~3U2TVYBWXA8V.1 size=707282 2023-12-03T11:28:27.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.455+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=3U2TVYBWXA8V tag=X4X17XAPKDBU type=write size=2804434 2023-12-03T11:28:27.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.456+0000 7fe67fa49780 1 < completed write operation key=OH2XUEEYL9JO tag=RUJYX8I00Y2Z type=write size=642843 2023-12-03T11:28:27.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.457+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=5KSAJVFTBG9U type=del size=1858361 2023-12-03T11:28:27.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.459+0000 7fe67fa49780 1 < canceled operation key=9AUO0SRFTAUJ tag=085N03O3IHHZ type=del size=13233 2023-12-03T11:28:27.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.460+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=LDHLBEQUIWN5 type=del size=157437 2023-12-03T11:28:27.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.461+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~D5ZTYLRY1XAW.0 size=1048576 2023-12-03T11:28:27.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.461+0000 7fe67fa49780 1 < canceled part key=_multipart_P05UIP1IU4Z7.2~D5ZTYLRY1XAW.1 size=1048576 2023-12-03T11:28:27.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.462+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~D5ZTYLRY1XAW.2 size=657614 2023-12-03T11:28:27.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.464+0000 7fe67fa49780 1 < canceled multipart upload key=P05UIP1IU4Z7 upload=D5ZTYLRY1XAW tag=ZNM8750NC0WA type=write size=3803342 2023-12-03T11:28:27.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.466+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=G4HIK1VSAYIY type=write size=446639 2023-12-03T11:28:27.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.468+0000 7fe67fa49780 1 < suggested remove operation key=0G8KNJBJ9K1Z tag=ITY2R5QKQ80F type=del 2023-12-03T11:28:27.472 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.471+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~F1HXFCSLRMNI.0 size=1048576 2023-12-03T11:28:27.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.472+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~F1HXFCSLRMNI.1 size=307329 2023-12-03T11:28:27.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.472+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=F1HXFCSLRMNI tag=GHQ4FZUEYDTZ type=write size=2404481 2023-12-03T11:28:27.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.474+0000 7fe67fa49780 1 < suggested update operation key=SIES92K9QVJV tag=6QYXTZGAXXMQ type=write size=545075 2023-12-03T11:28:27.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.475+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=EWP0PZSA1ZD0 type=del size=275167 2023-12-03T11:28:27.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.477+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~2210Y5N7W1TB.0 size=721770 2023-12-03T11:28:27.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.479+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=2210Y5N7W1TB tag=3V66DCBQ21HA type=write size=1770346 2023-12-03T11:28:27.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.481+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~XKEC0AY6D4FX.0 size=490737 2023-12-03T11:28:27.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.481+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=XKEC0AY6D4FX tag=519BWY4W147R type=write size=1539313 2023-12-03T11:28:27.485 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.484+0000 7fe67fa49780 1 < suggested update operation key=Q6GBIBMIJRKV tag=WKKGF1SH4TL4 type=del size=3404246 2023-12-03T11:28:27.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.486+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~4IVNMEV7J2A6.0 size=634299 2023-12-03T11:28:27.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.486+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=4IVNMEV7J2A6 tag=TCVNDFZT3MLG type=write size=1682875 2023-12-03T11:28:27.490 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.489+0000 7fe67fa49780 1 < suggested remove operation key=SXVBDBJ5B09V tag=C2VMJK0QD8XU type=write 2023-12-03T11:28:27.491 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.490+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=HX5HPADY7QOR type=del size=646823 2023-12-03T11:28:27.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.492+0000 7fe67fa49780 -1 < failed to complete operation key=SIES92K9QVJV tag=M9X8Q36UAH2M type=del size=2243550: (22) Invalid argument 2023-12-03T11:28:27.494 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.493+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=C2JRZNSSGOP9 type=del size=1773031 2023-12-03T11:28:27.497 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.494+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=ZNLXH510Y6LJ type=del 2023-12-03T11:28:27.497 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.495+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=EJ4IXKPVJ8LH type=write size=228427 2023-12-03T11:28:27.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.498+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=YN8ERXI442CP type=del 2023-12-03T11:28:27.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.500+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~HWZSL35RJSAN.0 size=1048576 2023-12-03T11:28:27.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.501+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~HWZSL35RJSAN.1 size=1048576 2023-12-03T11:28:27.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.501+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~HWZSL35RJSAN.2 size=701012 2023-12-03T11:28:27.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.501+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=HWZSL35RJSAN tag=F25IEDVNQJ82 type=write size=3846740 2023-12-03T11:28:27.505 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.504+0000 7fe67fa49780 1 < suggested update operation key=Q6GBIBMIJRKV tag=Q0Y17CKWR5N3 type=write size=292720 2023-12-03T11:28:27.506 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.505+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=2N10CA5HF4IP type=del size=2571198 2023-12-03T11:28:27.507 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.506+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=S1N0UON0J3O5 type=del 2023-12-03T11:28:27.509 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.508+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~W6W4TZGTG4U7.0 size=723884 2023-12-03T11:28:27.509 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.508+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=W6W4TZGTG4U7 tag=J3GATJN80847 type=write size=1772460 2023-12-03T11:28:27.510 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.509+0000 7fe67fa49780 1 < completed write operation key=URVD2U16EW75 tag=5LVD83FHY14K type=write size=695399 2023-12-03T11:28:27.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.511+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~3LL9D7VPX2C4.0 size=907000 2023-12-03T11:28:27.513 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.511+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=3LL9D7VPX2C4 tag=PJBE9729ZWTV type=write size=1955576 2023-12-03T11:28:27.514 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.513+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=8UC52AUHH2A3 type=del 2023-12-03T11:28:27.515 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.514+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=XHVFQOZ6E956 type=del size=890308 2023-12-03T11:28:27.516 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.515+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~3U2TVYBWXA8V.0 size=1048576 2023-12-03T11:28:27.516 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.515+0000 7fe67fa49780 1 < canceled part key=_multipart_H8MBLWXG7BCZ.2~3U2TVYBWXA8V.1 size=707282 2023-12-03T11:28:27.519 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.518+0000 7fe67fa49780 1 < canceled multipart upload key=H8MBLWXG7BCZ upload=3U2TVYBWXA8V tag=X4X17XAPKDBU type=write size=2804434 2023-12-03T11:28:27.521 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.520+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~61TQN000EBNH.0 size=1048576 2023-12-03T11:28:27.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.521+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~61TQN000EBNH.1 size=487384 2023-12-03T11:28:27.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.521+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=61TQN000EBNH tag=KFWH2QVFNWB9 type=write size=2584536 2023-12-03T11:28:27.524 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.523+0000 7fe67fa49780 1 < suggested remove operation key=983BDZLASC3S tag=5KSAJVFTBG9U type=del 2023-12-03T11:28:27.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.526+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~XH037U8DU50D.0 size=1048576 2023-12-03T11:28:27.528 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.527+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~XH037U8DU50D.1 size=826977 2023-12-03T11:28:27.528 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.527+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=XH037U8DU50D tag=UHFAZJ40QF11 type=write size=2924129 2023-12-03T11:28:27.529 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.528+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=LDHLBEQUIWN5 type=del 2023-12-03T11:28:27.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.530+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=Z7WEFFBPR1OG type=del size=219427 2023-12-03T11:28:27.532 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.531+0000 7fe67fa49780 1 < completed write operation key=YEMPVKMDANPG tag=G4HIK1VSAYIY type=write size=446639 2023-12-03T11:28:27.534 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.533+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~6QIFYTDPHLXU.0 size=607215 2023-12-03T11:28:27.534 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.533+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=6QIFYTDPHLXU tag=HG1557V5YZRZ type=write size=1655791 2023-12-03T11:28:27.535 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.534+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~F1HXFCSLRMNI.0 size=1048576 2023-12-03T11:28:27.536 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.535+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~F1HXFCSLRMNI.1 size=307329 2023-12-03T11:28:27.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.537+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=F1HXFCSLRMNI tag=GHQ4FZUEYDTZ type=write size=2404481 2023-12-03T11:28:27.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.539+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=JXNSYIEYFHGL type=write size=755495 2023-12-03T11:28:27.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.541+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=EWP0PZSA1ZD0 type=del 2023-12-03T11:28:27.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.542+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=6CO4UVZ356BG type=del size=1725326 2023-12-03T11:28:27.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.542+0000 7fe67fa49780 1 < canceled part key=_multipart_DDHGOWEI7WEI.2~XKEC0AY6D4FX.0 size=490737 2023-12-03T11:28:27.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.545+0000 7fe67fa49780 1 < canceled multipart upload key=DDHGOWEI7WEI upload=XKEC0AY6D4FX tag=519BWY4W147R type=write size=1539313 2023-12-03T11:28:27.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.547+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~SNOSVEBTS797.0 size=1048576 2023-12-03T11:28:27.549 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.548+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~SNOSVEBTS797.1 size=1048576 2023-12-03T11:28:27.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.549+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~SNOSVEBTS797.2 size=858935 2023-12-03T11:28:27.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.549+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=SNOSVEBTS797 tag=8QTTNPZULWAV type=write size=4004663 2023-12-03T11:28:27.551 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.550+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~4IVNMEV7J2A6.0 size=634299 2023-12-03T11:28:27.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.553+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=4IVNMEV7J2A6 tag=TCVNDFZT3MLG type=write size=1682875 2023-12-03T11:28:27.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.555+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~91KZ85XHBKZ2.0 size=711312 2023-12-03T11:28:27.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.555+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=91KZ85XHBKZ2 tag=KHKWHS9T1QKH type=write size=1759888 2023-12-03T11:28:27.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.557+0000 7fe67fa49780 1 < suggested remove operation key=OH2XUEEYL9JO tag=HX5HPADY7QOR type=del 2023-12-03T11:28:27.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.558+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=Y6C14UL56ZEY type=del size=1964688 2023-12-03T11:28:27.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.559+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=C2JRZNSSGOP9 type=del 2023-12-03T11:28:27.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.562+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~6CA14LZ0BCTI.0 size=1048576 2023-12-03T11:28:27.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.562+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~6CA14LZ0BCTI.1 size=1048576 2023-12-03T11:28:27.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.563+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~6CA14LZ0BCTI.2 size=173326 2023-12-03T11:28:27.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.563+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=6CA14LZ0BCTI tag=QIGYK0AZJJVU type=write size=3319054 2023-12-03T11:28:27.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.565+0000 7fe67fa49780 1 < completed write operation key=ASODFGLQ5VNY tag=EJ4IXKPVJ8LH type=write size=228427 2023-12-03T11:28:27.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.566+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=HUZRLBEZQU9V type=del size=815039 2023-12-03T11:28:27.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.567+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~HWZSL35RJSAN.0 size=1048576 2023-12-03T11:28:27.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.568+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~HWZSL35RJSAN.1 size=1048576 2023-12-03T11:28:27.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.569+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~HWZSL35RJSAN.2 size=701012 2023-12-03T11:28:27.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.571+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=HWZSL35RJSAN tag=F25IEDVNQJ82 type=write size=3846740 2023-12-03T11:28:27.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.572+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=K7TJW5M0IXB1 type=del size=3106579 2023-12-03T11:28:27.574 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.573+0000 7fe67fa49780 1 < canceled operation key=CC1X1OP7L6BJ tag=2N10CA5HF4IP type=del size=2571198 2023-12-03T11:28:27.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.574+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=GPYU2U9USU8L type=del size=2874704 2023-12-03T11:28:27.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.576+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~W6W4TZGTG4U7.0 size=723884 2023-12-03T11:28:27.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.578+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=W6W4TZGTG4U7 tag=J3GATJN80847 type=write size=1772460 2023-12-03T11:28:27.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.580+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~9VR5V9CA7EEJ.0 size=1048576 2023-12-03T11:28:27.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.581+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~9VR5V9CA7EEJ.1 size=1048576 2023-12-03T11:28:27.582 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.581+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~9VR5V9CA7EEJ.2 size=377773 2023-12-03T11:28:27.583 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.581+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=9VR5V9CA7EEJ tag=B402MXXRU182 type=write size=3523501 2023-12-03T11:28:27.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.583+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~3LL9D7VPX2C4.0 size=907000 2023-12-03T11:28:27.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.585+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=3LL9D7VPX2C4 tag=PJBE9729ZWTV type=write size=1955576 2023-12-03T11:28:27.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.586+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=CVYLEMSADRV3 type=del size=1086947 2023-12-03T11:28:27.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.587+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=XHVFQOZ6E956 type=del 2023-12-03T11:28:27.590 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.589+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~ZL5ZRDZ2WU79.0 size=623283 2023-12-03T11:28:27.590 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.589+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=ZL5ZRDZ2WU79 tag=7A189WCEPL1I type=write size=1671859 2023-12-03T11:28:27.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.590+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~61TQN000EBNH.0 size=1048576 2023-12-03T11:28:27.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.590+0000 7fe67fa49780 1 < canceled part key=_multipart_YEMPVKMDANPG.2~61TQN000EBNH.1 size=487384 2023-12-03T11:28:27.593 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.592+0000 7fe67fa49780 1 < canceled multipart upload key=YEMPVKMDANPG upload=61TQN000EBNH tag=KFWH2QVFNWB9 type=write size=2584536 2023-12-03T11:28:27.595 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.594+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~KIMWRVSRRRXA.0 size=252179 2023-12-03T11:28:27.596 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.594+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=KIMWRVSRRRXA tag=KPV1VCRO41FI type=write size=1300755 2023-12-03T11:28:27.596 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.595+0000 7fe67fa49780 1 < canceled part key=_multipart_XZHCD4R4EVZR.2~XH037U8DU50D.0 size=1048576 2023-12-03T11:28:27.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.596+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~XH037U8DU50D.1 size=826977 2023-12-03T11:28:27.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.597+0000 7fe67fa49780 1 < canceled multipart upload key=XZHCD4R4EVZR upload=XH037U8DU50D tag=UHFAZJ40QF11 type=write size=2924129 2023-12-03T11:28:27.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.600+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~2A76XOEI6W6B.0 size=1048576 2023-12-03T11:28:27.601 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.600+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~2A76XOEI6W6B.1 size=628013 2023-12-03T11:28:27.601 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.600+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=2A76XOEI6W6B tag=SSQQJUNOFW94 type=write size=2725165 2023-12-03T11:28:27.603 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.602+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=Z7WEFFBPR1OG type=del 2023-12-03T11:28:27.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.604+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~AV45NOJMTD61.0 size=1048576 2023-12-03T11:28:27.606 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.605+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~AV45NOJMTD61.1 size=89434 2023-12-03T11:28:27.606 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.605+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=AV45NOJMTD61 tag=U8U3P718IKCJ type=write size=2186586 2023-12-03T11:28:27.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.606+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~6QIFYTDPHLXU.0 size=607215 2023-12-03T11:28:27.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.608+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=6QIFYTDPHLXU tag=HG1557V5YZRZ type=write size=1655791 2023-12-03T11:28:27.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.609+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=94IZ1SALEGO2 type=write size=946832 2023-12-03T11:28:27.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.611+0000 7fe67fa49780 1 < completed write operation key=0G8KNJBJ9K1Z tag=JXNSYIEYFHGL type=write size=755495 2023-12-03T11:28:27.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.612+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=GGZUYWTAJN9M type=del size=1144650 2023-12-03T11:28:27.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.613+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=6CO4UVZ356BG type=del 2023-12-03T11:28:27.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.615+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~004XTKV5EYRN.0 size=1048576 2023-12-03T11:28:27.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.616+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~004XTKV5EYRN.1 size=48006 2023-12-03T11:28:27.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.616+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=004XTKV5EYRN tag=ZK2ABU6QWV43 type=write size=2145158 2023-12-03T11:28:27.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.616+0000 7fe67fa49780 1 < canceled part key=_multipart_OH2XUEEYL9JO.2~SNOSVEBTS797.0 size=1048576 2023-12-03T11:28:27.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.617+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~SNOSVEBTS797.1 size=1048576 2023-12-03T11:28:27.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.618+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~SNOSVEBTS797.2 size=858935 2023-12-03T11:28:27.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.620+0000 7fe67fa49780 1 < canceled multipart upload key=OH2XUEEYL9JO upload=SNOSVEBTS797 tag=8QTTNPZULWAV type=write size=4004663 2023-12-03T11:28:27.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.622+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~PK8UCXBLADPA.0 size=1048576 2023-12-03T11:28:27.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.623+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~PK8UCXBLADPA.1 size=338471 2023-12-03T11:28:27.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.623+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=PK8UCXBLADPA tag=XSCQKB4LWK0R type=write size=2435623 2023-12-03T11:28:27.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.624+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~91KZ85XHBKZ2.0 size=711312 2023-12-03T11:28:27.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.626+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=91KZ85XHBKZ2 tag=KHKWHS9T1QKH type=write size=1759888 2023-12-03T11:28:27.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.627+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=BM0CI6B41E00 type=write size=819807 2023-12-03T11:28:27.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.628+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=Y6C14UL56ZEY type=del 2023-12-03T11:28:27.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.630+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~PWMGC7TKZXMR.0 size=1048576 2023-12-03T11:28:27.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.631+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~PWMGC7TKZXMR.1 size=1048576 2023-12-03T11:28:27.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.632+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~PWMGC7TKZXMR.2 size=925353 2023-12-03T11:28:27.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.632+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=PWMGC7TKZXMR tag=PNU06B1MZZC4 type=write size=4071081 2023-12-03T11:28:27.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.633+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~6CA14LZ0BCTI.0 size=1048576 2023-12-03T11:28:27.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.633+0000 7fe67fa49780 1 < canceled part key=_multipart_CIB1NZHJGO46.2~6CA14LZ0BCTI.1 size=1048576 2023-12-03T11:28:27.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.634+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~6CA14LZ0BCTI.2 size=173326 2023-12-03T11:28:27.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.637+0000 7fe67fa49780 1 < canceled multipart upload key=CIB1NZHJGO46 upload=6CA14LZ0BCTI tag=QIGYK0AZJJVU type=write size=3319054 2023-12-03T11:28:27.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.638+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=7S2JDCBRIOHI type=del size=2894834 2023-12-03T11:28:27.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.640+0000 7fe67fa49780 1 < suggested remove operation key=Z1NFEIZNYYO2 tag=HUZRLBEZQU9V type=del 2023-12-03T11:28:27.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.642+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~1BXFFF21SNXB.0 size=1048576 2023-12-03T11:28:27.644 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.643+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~1BXFFF21SNXB.1 size=1048576 2023-12-03T11:28:27.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.645+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~1BXFFF21SNXB.2 size=730624 2023-12-03T11:28:27.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.645+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=1BXFFF21SNXB tag=FCUR4PXRIJAM type=write size=3876352 2023-12-03T11:28:27.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.646+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=K7TJW5M0IXB1 type=del 2023-12-03T11:28:27.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.647+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=9GURO978KEEY type=del size=668433 2023-12-03T11:28:27.650 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.649+0000 7fe67fa49780 1 < suggested remove operation key=006X4CSXV0KA tag=GPYU2U9USU8L type=del 2023-12-03T11:28:27.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.651+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~L6WQ6FKAD8QA.0 size=1048576 2023-12-03T11:28:27.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.652+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~L6WQ6FKAD8QA.1 size=1048576 2023-12-03T11:28:27.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.653+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~L6WQ6FKAD8QA.2 size=269179 2023-12-03T11:28:27.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.653+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=L6WQ6FKAD8QA tag=2CHGPXKOGTYO type=write size=3414907 2023-12-03T11:28:27.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.654+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~9VR5V9CA7EEJ.0 size=1048576 2023-12-03T11:28:27.656 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.655+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~9VR5V9CA7EEJ.1 size=1048576 2023-12-03T11:28:27.656 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.655+0000 7fe67fa49780 1 < canceled part key=_multipart_Q6GBIBMIJRKV.2~9VR5V9CA7EEJ.2 size=377773 2023-12-03T11:28:27.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.657+0000 7fe67fa49780 1 < canceled multipart upload key=Q6GBIBMIJRKV upload=9VR5V9CA7EEJ tag=B402MXXRU182 type=write size=3523501 2023-12-03T11:28:27.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.659+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~EGGA9B48TCMR.0 size=899643 2023-12-03T11:28:27.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.659+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=EGGA9B48TCMR tag=ROSQQZ19F1FC type=write size=1948219 2023-12-03T11:28:27.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.660+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=CVYLEMSADRV3 type=del 2023-12-03T11:28:27.663 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.662+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=6LD1OY7KO3SN type=del size=135938 2023-12-03T11:28:27.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.663+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~ZL5ZRDZ2WU79.0 size=623283 2023-12-03T11:28:27.666 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.665+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=ZL5ZRDZ2WU79 tag=7A189WCEPL1I type=write size=1671859 2023-12-03T11:28:27.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.666+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=7F97UPAQODGQ type=del size=1630491 2023-12-03T11:28:27.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.667+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~KIMWRVSRRRXA.0 size=252179 2023-12-03T11:28:27.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.669+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=KIMWRVSRRRXA tag=KPV1VCRO41FI type=write size=1300755 2023-12-03T11:28:27.672 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.671+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~1ZMQR3Y8EFI7.0 size=1048576 2023-12-03T11:28:27.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.672+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~1ZMQR3Y8EFI7.1 size=659473 2023-12-03T11:28:27.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.672+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=1ZMQR3Y8EFI7 tag=ODA4NCDPC623 type=write size=2756625 2023-12-03T11:28:27.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.673+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~2A76XOEI6W6B.0 size=1048576 2023-12-03T11:28:27.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.674+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~2A76XOEI6W6B.1 size=628013 2023-12-03T11:28:27.677 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.676+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=2A76XOEI6W6B tag=SSQQJUNOFW94 type=write size=2725165 2023-12-03T11:28:27.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.679+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~1LVAIFFFZQ6W.0 size=251906 2023-12-03T11:28:27.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.679+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=1LVAIFFFZQ6W tag=IXSXQJ3K0UXH type=write size=1300482 2023-12-03T11:28:27.681 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.680+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~AV45NOJMTD61.0 size=1048576 2023-12-03T11:28:27.682 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.681+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~AV45NOJMTD61.1 size=89434 2023-12-03T11:28:27.684 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.683+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=AV45NOJMTD61 tag=U8U3P718IKCJ type=write size=2186586 2023-12-03T11:28:27.685 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.684+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=XB1W89OF41TQ type=del size=3294251 2023-12-03T11:28:27.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.685+0000 7fe67fa49780 1 < completed write operation key=V9ZVWHO8IF8L tag=94IZ1SALEGO2 type=write size=946832 2023-12-03T11:28:27.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.687+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~UT2UGQW0NECT.0 size=1048576 2023-12-03T11:28:27.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.688+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~UT2UGQW0NECT.1 size=555018 2023-12-03T11:28:27.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.688+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=UT2UGQW0NECT tag=COH9T1VT61KQ type=write size=2652170 2023-12-03T11:28:27.690 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.689+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=GGZUYWTAJN9M type=del 2023-12-03T11:28:27.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.691+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=UN2YMPL4B1VZ type=write size=106994 2023-12-03T11:28:27.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.692+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~004XTKV5EYRN.0 size=1048576 2023-12-03T11:28:27.694 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.693+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~004XTKV5EYRN.1 size=48006 2023-12-03T11:28:27.696 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.695+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=004XTKV5EYRN tag=ZK2ABU6QWV43 type=write size=2145158 2023-12-03T11:28:27.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.698+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~C507Y6HG1KK0.0 size=792844 2023-12-03T11:28:27.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.698+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=C507Y6HG1KK0 tag=D52DNOYXJX0C type=write size=1841420 2023-12-03T11:28:27.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.699+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~PK8UCXBLADPA.0 size=1048576 2023-12-03T11:28:27.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.700+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~PK8UCXBLADPA.1 size=338471 2023-12-03T11:28:27.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.702+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=PK8UCXBLADPA tag=XSCQKB4LWK0R type=write size=2435623 2023-12-03T11:28:27.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.704+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=0WOA40FU4G51 type=del size=1257374 2023-12-03T11:28:27.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.705+0000 7fe67fa49780 1 < completed write operation key=TXVHRE03Z3DA tag=BM0CI6B41E00 type=write size=819807 2023-12-03T11:28:27.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.706+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=R9PT5SI1W91C type=del size=1375352 2023-12-03T11:28:27.708 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.707+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~PWMGC7TKZXMR.0 size=1048576 2023-12-03T11:28:27.709 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.708+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~PWMGC7TKZXMR.1 size=1048576 2023-12-03T11:28:27.710 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.709+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~PWMGC7TKZXMR.2 size=925353 2023-12-03T11:28:27.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.712+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=PWMGC7TKZXMR tag=PNU06B1MZZC4 type=write size=4071081 2023-12-03T11:28:27.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.714+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~Q3LALNHJIN90.0 size=1048576 2023-12-03T11:28:27.716 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.715+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~Q3LALNHJIN90.1 size=1048576 2023-12-03T11:28:27.717 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.716+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~Q3LALNHJIN90.2 size=868041 2023-12-03T11:28:27.717 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.716+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=Q3LALNHJIN90 tag=PIPJ4IMLU6WB type=write size=4013769 2023-12-03T11:28:27.720 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.719+0000 7fe67fa49780 1 < suggested update operation key=SXVBDBJ5B09V tag=7S2JDCBRIOHI type=del size=2894834 2023-12-03T11:28:27.724 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.723+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~9RHY6VTJ6XA0.0 size=1048576 2023-12-03T11:28:27.725 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.724+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~9RHY6VTJ6XA0.1 size=310523 2023-12-03T11:28:27.725 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.724+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=9RHY6VTJ6XA0 tag=D4ER4Z5AEVNK type=write size=2407675 2023-12-03T11:28:27.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.725+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~1BXFFF21SNXB.0 size=1048576 2023-12-03T11:28:27.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.726+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~1BXFFF21SNXB.1 size=1048576 2023-12-03T11:28:27.728 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.727+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~1BXFFF21SNXB.2 size=730624 2023-12-03T11:28:27.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.729+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=1BXFFF21SNXB tag=FCUR4PXRIJAM type=write size=3876352 2023-12-03T11:28:27.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.733+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~OUIAPFS9U640.0 size=1048576 2023-12-03T11:28:27.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.734+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~OUIAPFS9U640.1 size=719118 2023-12-03T11:28:27.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.734+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=OUIAPFS9U640 tag=HWTE7PL53MYC type=write size=2816270 2023-12-03T11:28:27.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.735+0000 7fe67fa49780 1 < canceled operation key=983BDZLASC3S tag=9GURO978KEEY type=del size=668433 2023-12-03T11:28:27.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.736+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=3AXCLJVRI957 type=del size=1122377 2023-12-03T11:28:27.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.737+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~L6WQ6FKAD8QA.0 size=1048576 2023-12-03T11:28:27.739 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.738+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~L6WQ6FKAD8QA.1 size=1048576 2023-12-03T11:28:27.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.739+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~L6WQ6FKAD8QA.2 size=269179 2023-12-03T11:28:27.742 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.741+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=L6WQ6FKAD8QA tag=2CHGPXKOGTYO type=write size=3414907 2023-12-03T11:28:27.743 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.742+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=KPT638KQ9YUB type=del size=4050048 2023-12-03T11:28:27.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.744+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~EGGA9B48TCMR.0 size=899643 2023-12-03T11:28:27.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.746+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=EGGA9B48TCMR tag=ROSQQZ19F1FC type=write size=1948219 2023-12-03T11:28:27.749 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.748+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~3APV05SSHOKM.0 size=1048576 2023-12-03T11:28:27.750 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.749+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~3APV05SSHOKM.1 size=169292 2023-12-03T11:28:27.750 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.749+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=3APV05SSHOKM tag=JAZZUM578UNJ type=write size=2266444 2023-12-03T11:28:27.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.751+0000 7fe67fa49780 1 < suggested update operation key=0G8KNJBJ9K1Z tag=6LD1OY7KO3SN type=del size=135938 2023-12-03T11:28:27.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.753+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=ERCO5DWQKJD6 type=write size=203379 2023-12-03T11:28:27.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.754+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=7F97UPAQODGQ type=del 2023-12-03T11:28:27.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.755+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=N60Q5QEREV4Q type=del size=2918136 2023-12-03T11:28:27.757 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.756+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~1ZMQR3Y8EFI7.0 size=1048576 2023-12-03T11:28:27.758 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.757+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~1ZMQR3Y8EFI7.1 size=659473 2023-12-03T11:28:27.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.759+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=1ZMQR3Y8EFI7 tag=ODA4NCDPC623 type=write size=2756625 2023-12-03T11:28:27.762 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.761+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~FG8CV36062LN.0 size=1048576 2023-12-03T11:28:27.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.762+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~FG8CV36062LN.1 size=1048576 2023-12-03T11:28:27.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.763+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~FG8CV36062LN.2 size=861993 2023-12-03T11:28:27.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.763+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=FG8CV36062LN tag=VYIOIUKQ3YKW type=write size=4007721 2023-12-03T11:28:27.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.764+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~1LVAIFFFZQ6W.0 size=251906 2023-12-03T11:28:27.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.766+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=1LVAIFFFZQ6W tag=IXSXQJ3K0UXH type=write size=1300482 2023-12-03T11:28:27.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.768+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~93S0J6LZOVHQ.0 size=856491 2023-12-03T11:28:27.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.768+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=93S0J6LZOVHQ tag=X6HHOIM6OJLH type=write size=1905067 2023-12-03T11:28:27.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.769+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=XB1W89OF41TQ type=del 2023-12-03T11:28:27.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.770+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=G6TUGO7G10NW type=del size=1411696 2023-12-03T11:28:27.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.771+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~UT2UGQW0NECT.0 size=1048576 2023-12-03T11:28:27.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.772+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~UT2UGQW0NECT.1 size=555018 2023-12-03T11:28:27.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.774+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=UT2UGQW0NECT tag=COH9T1VT61KQ type=write size=2652170 2023-12-03T11:28:27.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.777+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~0DJ78BKMPIGE.0 size=1048576 2023-12-03T11:28:27.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.778+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~0DJ78BKMPIGE.1 size=229123 2023-12-03T11:28:27.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.778+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=0DJ78BKMPIGE tag=RNA8AYOJX0SE type=write size=2326275 2023-12-03T11:28:27.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.779+0000 7fe67fa49780 1 < completed write operation key=V9ZVWHO8IF8L tag=UN2YMPL4B1VZ type=write size=106994 2023-12-03T11:28:27.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.781+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~60ZO5KW0GG18.0 size=338863 2023-12-03T11:28:27.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.781+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=60ZO5KW0GG18 tag=2Z259QZ4JRMA type=write size=1387439 2023-12-03T11:28:27.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.782+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~C507Y6HG1KK0.0 size=792844 2023-12-03T11:28:27.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.784+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=C507Y6HG1KK0 tag=D52DNOYXJX0C type=write size=1841420 2023-12-03T11:28:27.786 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.785+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=EV7E08X7B2DJ type=write size=382076 2023-12-03T11:28:27.787 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.786+0000 7fe67fa49780 -1 < failed to complete operation key=0G8KNJBJ9K1Z tag=0WOA40FU4G51 type=del size=1257374: (22) Invalid argument 2023-12-03T11:28:27.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.788+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~R0YRQVTT4MW0.0 size=1048576 2023-12-03T11:28:27.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.789+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~R0YRQVTT4MW0.1 size=1048576 2023-12-03T11:28:27.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.790+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~R0YRQVTT4MW0.2 size=615495 2023-12-03T11:28:27.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.790+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=R0YRQVTT4MW0 tag=DV4S4CF68YWB type=write size=3761223 2023-12-03T11:28:27.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.792+0000 7fe67fa49780 1 < suggested update operation key=9AUO0SRFTAUJ tag=R9PT5SI1W91C type=del size=1375352 2023-12-03T11:28:27.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.794+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=D0IJ5VR6EL5J type=del size=1924542 2023-12-03T11:28:27.796 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.795+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~Q3LALNHJIN90.0 size=1048576 2023-12-03T11:28:27.797 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.796+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~Q3LALNHJIN90.1 size=1048576 2023-12-03T11:28:27.798 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.797+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~Q3LALNHJIN90.2 size=868041 2023-12-03T11:28:27.800 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.799+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=Q3LALNHJIN90 tag=PIPJ4IMLU6WB type=write size=4013769 2023-12-03T11:28:27.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.800+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=0XTQXZ56RZ2T type=del size=2474462 2023-12-03T11:28:27.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.800+0000 7fe67fa49780 1 < canceled part key=_multipart_TXVHRE03Z3DA.2~9RHY6VTJ6XA0.0 size=1048576 2023-12-03T11:28:27.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.801+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~9RHY6VTJ6XA0.1 size=310523 2023-12-03T11:28:27.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.803+0000 7fe67fa49780 1 < canceled multipart upload key=TXVHRE03Z3DA upload=9RHY6VTJ6XA0 tag=D4ER4Z5AEVNK type=write size=2407675 2023-12-03T11:28:27.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.805+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~LPY8A0S9N11R.0 size=93631 2023-12-03T11:28:27.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.805+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=LPY8A0S9N11R tag=ANQNR0C6RTDM type=write size=1142207 2023-12-03T11:28:27.807 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.806+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~OUIAPFS9U640.0 size=1048576 2023-12-03T11:28:27.808 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.807+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~OUIAPFS9U640.1 size=719118 2023-12-03T11:28:27.810 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.809+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=OUIAPFS9U640 tag=HWTE7PL53MYC type=write size=2816270 2023-12-03T11:28:27.812 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.811+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~TMUS3YTHKNUY.0 size=730714 2023-12-03T11:28:27.812 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.811+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=TMUS3YTHKNUY tag=9DMWB2SOR2DG type=write size=1779290 2023-12-03T11:28:27.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.812+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=3AXCLJVRI957 type=del 2023-12-03T11:28:27.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.813+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=BDDCQ0DQRLJJ type=del size=2546244 2023-12-03T11:28:27.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.816+0000 7fe67fa49780 1 < suggested update operation key=H8MBLWXG7BCZ tag=KPT638KQ9YUB type=del size=4050048 2023-12-03T11:28:27.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.818+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~27BBXQK8TIKB.0 size=1048576 2023-12-03T11:28:27.820 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.819+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~27BBXQK8TIKB.1 size=654493 2023-12-03T11:28:27.820 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.819+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=27BBXQK8TIKB tag=ZURWPX2GV79M type=write size=2751645 2023-12-03T11:28:27.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.820+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~3APV05SSHOKM.0 size=1048576 2023-12-03T11:28:27.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.820+0000 7fe67fa49780 1 < canceled part key=_multipart_P05UIP1IU4Z7.2~3APV05SSHOKM.1 size=169292 2023-12-03T11:28:27.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.822+0000 7fe67fa49780 1 < canceled multipart upload key=P05UIP1IU4Z7 upload=3APV05SSHOKM tag=JAZZUM578UNJ type=write size=2266444 2023-12-03T11:28:27.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.824+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~H17GCDA0M4RT.0 size=1048576 2023-12-03T11:28:27.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.824+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~H17GCDA0M4RT.1 size=916108 2023-12-03T11:28:27.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.824+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=H17GCDA0M4RT tag=8453UXEGHW5U type=write size=3013260 2023-12-03T11:28:27.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.826+0000 7fe67fa49780 1 < completed write operation key=DDHGOWEI7WEI tag=ERCO5DWQKJD6 type=write size=203379 2023-12-03T11:28:27.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.827+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=M8Y4TO4T5VES type=del size=1319335 2023-12-03T11:28:27.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.829+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=N60Q5QEREV4Q type=del 2023-12-03T11:28:27.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.831+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~CL0RMSA3SZZO.0 size=1048576 2023-12-03T11:28:27.833 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.832+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~CL0RMSA3SZZO.1 size=1048576 2023-12-03T11:28:27.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.833+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~CL0RMSA3SZZO.2 size=833291 2023-12-03T11:28:27.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.833+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=CL0RMSA3SZZO tag=QUICOPFKSPQU type=write size=3979019 2023-12-03T11:28:27.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.834+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~FG8CV36062LN.0 size=1048576 2023-12-03T11:28:27.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.835+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~FG8CV36062LN.1 size=1048576 2023-12-03T11:28:27.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.836+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~FG8CV36062LN.2 size=861993 2023-12-03T11:28:27.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.837+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=FG8CV36062LN tag=VYIOIUKQ3YKW type=write size=4007721 2023-12-03T11:28:27.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.839+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~7NC55ISARI4B.0 size=589170 2023-12-03T11:28:27.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.840+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=7NC55ISARI4B tag=CL6J1BJBKR6R type=write size=1637746 2023-12-03T11:28:27.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.841+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~93S0J6LZOVHQ.0 size=856491 2023-12-03T11:28:27.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.842+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=93S0J6LZOVHQ tag=X6HHOIM6OJLH type=write size=1905067 2023-12-03T11:28:27.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.844+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=07RVB9RW3WA8 type=del size=457878 2023-12-03T11:28:27.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.846+0000 7fe67fa49780 1 < suggested update operation key=SXVBDBJ5B09V tag=G6TUGO7G10NW type=del size=1411696 2023-12-03T11:28:27.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.848+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~1SCTFURN9VKG.0 size=283076 2023-12-03T11:28:27.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.848+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=1SCTFURN9VKG tag=RM78TBZKPK9Z type=write size=1331652 2023-12-03T11:28:27.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.849+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~0DJ78BKMPIGE.0 size=1048576 2023-12-03T11:28:27.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.850+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~0DJ78BKMPIGE.1 size=229123 2023-12-03T11:28:27.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.853+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=0DJ78BKMPIGE tag=RNA8AYOJX0SE type=write size=2326275 2023-12-03T11:28:27.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.855+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~YSUQ3MC8GAV6.0 size=1048576 2023-12-03T11:28:27.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.856+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~YSUQ3MC8GAV6.1 size=209479 2023-12-03T11:28:27.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.856+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=YSUQ3MC8GAV6 tag=5VQT96AQQHQS type=write size=2306631 2023-12-03T11:28:27.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.857+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~60ZO5KW0GG18.0 size=338863 2023-12-03T11:28:27.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.859+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=60ZO5KW0GG18 tag=2Z259QZ4JRMA type=write size=1387439 2023-12-03T11:28:27.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.860+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=17SQIW5R6T1P type=del size=3342795 2023-12-03T11:28:27.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.862+0000 7fe67fa49780 1 < completed write operation key=983BDZLASC3S tag=EV7E08X7B2DJ type=write size=382076 2023-12-03T11:28:27.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.863+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=P8HI467RAR64 type=write size=848390 2023-12-03T11:28:27.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.864+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~R0YRQVTT4MW0.0 size=1048576 2023-12-03T11:28:27.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.865+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~R0YRQVTT4MW0.1 size=1048576 2023-12-03T11:28:27.867 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.866+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~R0YRQVTT4MW0.2 size=615495 2023-12-03T11:28:27.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.867+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=R0YRQVTT4MW0 tag=DV4S4CF68YWB type=write size=3761223 2023-12-03T11:28:27.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.869+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~KPCX7F7PI6PU.0 size=1048576 2023-12-03T11:28:27.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.870+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~KPCX7F7PI6PU.1 size=423897 2023-12-03T11:28:27.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.870+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=KPCX7F7PI6PU tag=5MLHFSHUBD2V type=write size=2521049 2023-12-03T11:28:27.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.871+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=D0IJ5VR6EL5J type=del 2023-12-03T11:28:27.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.872+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=VAFM85POA690 type=del size=465131 2023-12-03T11:28:27.875 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.875+0000 7fe67fa49780 1 < suggested update operation key=SXVBDBJ5B09V tag=0XTQXZ56RZ2T type=del size=2474462 2023-12-03T11:28:27.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.876+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=5N7UXJ9KQLT7 type=del size=251540 2023-12-03T11:28:27.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.877+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~LPY8A0S9N11R.0 size=93631 2023-12-03T11:28:27.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.879+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=LPY8A0S9N11R tag=ANQNR0C6RTDM type=write size=1142207 2023-12-03T11:28:27.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.880+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=2SPWQK47XUQ2 type=del size=1669516 2023-12-03T11:28:27.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.881+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~TMUS3YTHKNUY.0 size=730714 2023-12-03T11:28:27.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.883+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=TMUS3YTHKNUY tag=9DMWB2SOR2DG type=write size=1779290 2023-12-03T11:28:27.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.884+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=SCJ05PKG2HOZ type=del size=656387 2023-12-03T11:28:27.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.885+0000 7fe67fa49780 1 < canceled operation key=N87KA638VE01 tag=BDDCQ0DQRLJJ type=del size=2546244 2023-12-03T11:28:27.888 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.887+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~ABN6GE0Z7NF6.0 size=1048576 2023-12-03T11:28:27.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.888+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~ABN6GE0Z7NF6.1 size=180520 2023-12-03T11:28:27.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.888+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=ABN6GE0Z7NF6 tag=7YR55A114FJE type=write size=2277672 2023-12-03T11:28:27.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.888+0000 7fe67fa49780 1 < canceled part key=_multipart_XZHCD4R4EVZR.2~27BBXQK8TIKB.0 size=1048576 2023-12-03T11:28:27.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.889+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~27BBXQK8TIKB.1 size=654493 2023-12-03T11:28:27.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.891+0000 7fe67fa49780 1 < canceled multipart upload key=XZHCD4R4EVZR upload=27BBXQK8TIKB tag=ZURWPX2GV79M type=write size=2751645 2023-12-03T11:28:27.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.892+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=RLK53GT2FHLZ type=del size=353091 2023-12-03T11:28:27.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.893+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~H17GCDA0M4RT.0 size=1048576 2023-12-03T11:28:27.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.893+0000 7fe67fa49780 1 < canceled part key=_multipart_0G8KNJBJ9K1Z.2~H17GCDA0M4RT.1 size=916108 2023-12-03T11:28:27.896 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.895+0000 7fe67fa49780 1 < canceled multipart upload key=0G8KNJBJ9K1Z upload=H17GCDA0M4RT tag=8453UXEGHW5U type=write size=3013260 2023-12-03T11:28:27.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.896+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=2UL0KXMZ53RB type=del size=1985889 2023-12-03T11:28:27.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.898+0000 7fe67fa49780 1 < suggested update operation key=YEMPVKMDANPG tag=M8Y4TO4T5VES type=del size=1319335 2023-12-03T11:28:27.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.899+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=GKM75RU17Y8P type=del size=4181106 2023-12-03T11:28:27.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.900+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~CL0RMSA3SZZO.0 size=1048576 2023-12-03T11:28:27.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.900+0000 7fe67fa49780 1 < canceled part key=_multipart_SIES92K9QVJV.2~CL0RMSA3SZZO.1 size=1048576 2023-12-03T11:28:27.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.901+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~CL0RMSA3SZZO.2 size=833291 2023-12-03T11:28:27.904 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.903+0000 7fe67fa49780 1 < canceled multipart upload key=SIES92K9QVJV upload=CL0RMSA3SZZO tag=QUICOPFKSPQU type=write size=3979019 2023-12-03T11:28:27.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.905+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=9BY9QOEYS96V type=del size=2330178 2023-12-03T11:28:27.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.905+0000 7fe67fa49780 1 < canceled part key=_multipart_P05UIP1IU4Z7.2~7NC55ISARI4B.0 size=589170 2023-12-03T11:28:27.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.907+0000 7fe67fa49780 1 < canceled multipart upload key=P05UIP1IU4Z7 upload=7NC55ISARI4B tag=CL6J1BJBKR6R type=write size=1637746 2023-12-03T11:28:27.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.908+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=WV4Q8IORJ1QM type=del size=646013 2023-12-03T11:28:27.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.909+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=07RVB9RW3WA8 type=del 2023-12-03T11:28:27.911 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.910+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=Q0VFA8TJ8SXP type=write size=719662 2023-12-03T11:28:27.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.911+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~1SCTFURN9VKG.0 size=283076 2023-12-03T11:28:27.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.913+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=1SCTFURN9VKG tag=RM78TBZKPK9Z type=write size=1331652 2023-12-03T11:28:27.915 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.914+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=SLVQU8YCG17B type=del size=4159746 2023-12-03T11:28:27.916 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.915+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~YSUQ3MC8GAV6.0 size=1048576 2023-12-03T11:28:27.917 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.916+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~YSUQ3MC8GAV6.1 size=209479 2023-12-03T11:28:27.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.918+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=YSUQ3MC8GAV6 tag=5VQT96AQQHQS type=write size=2306631 2023-12-03T11:28:27.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.919+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=U36WOCQAYJ0N type=del size=1535284 2023-12-03T11:28:27.921 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.921+0000 7fe67fa49780 1 < canceled operation key=Z1NFEIZNYYO2 tag=17SQIW5R6T1P type=del size=3342795 2023-12-03T11:28:27.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.923+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~JWEELAFN94S2.0 size=45230 2023-12-03T11:28:27.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.923+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=JWEELAFN94S2 tag=PFKF6H2784VU type=write size=1093806 2023-12-03T11:28:27.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.924+0000 7fe67fa49780 1 < completed write operation key=9AUO0SRFTAUJ tag=P8HI467RAR64 type=write size=848390 2023-12-03T11:28:27.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.926+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~PDDO8WTWD6TW.0 size=39899 2023-12-03T11:28:27.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.926+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=PDDO8WTWD6TW tag=2Y4XJB2HD6J9 type=write size=1088475 2023-12-03T11:28:27.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.927+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~KPCX7F7PI6PU.0 size=1048576 2023-12-03T11:28:27.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.928+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~KPCX7F7PI6PU.1 size=423897 2023-12-03T11:28:27.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.930+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=KPCX7F7PI6PU tag=5MLHFSHUBD2V type=write size=2521049 2023-12-03T11:28:27.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.933+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~UAG5FDME6XYF.0 size=1048576 2023-12-03T11:28:27.936 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.935+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~UAG5FDME6XYF.1 size=1048576 2023-12-03T11:28:27.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.936+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~UAG5FDME6XYF.2 size=423452 2023-12-03T11:28:27.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.936+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=UAG5FDME6XYF tag=VGP3A5FWTPNH type=write size=3569180 2023-12-03T11:28:27.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.938+0000 7fe67fa49780 1 < suggested update operation key=9AUO0SRFTAUJ tag=VAFM85POA690 type=del size=465131 2023-12-03T11:28:27.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.940+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~FHZZMW0G1TY8.0 size=1048576 2023-12-03T11:28:27.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.941+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~FHZZMW0G1TY8.1 size=1048576 2023-12-03T11:28:27.944 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.943+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~FHZZMW0G1TY8.2 size=857824 2023-12-03T11:28:27.944 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.943+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=FHZZMW0G1TY8 tag=5S6AVZ94EVRG type=write size=4003552 2023-12-03T11:28:27.945 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.944+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=5N7UXJ9KQLT7 type=del 2023-12-03T11:28:27.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.945+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=8UJR4KWOU1YO type=del size=103067 2023-12-03T11:28:27.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.947+0000 7fe67fa49780 1 < suggested update operation key=OH2XUEEYL9JO tag=2SPWQK47XUQ2 type=del size=1669516 2023-12-03T11:28:27.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.948+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=02JKTNMBQM79 type=del size=291265 2023-12-03T11:28:27.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.949+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=SCJ05PKG2HOZ type=del 2023-12-03T11:28:27.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.951+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=CIQCOWTIS1VC type=write size=1035687 2023-12-03T11:28:27.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.952+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~ABN6GE0Z7NF6.0 size=1048576 2023-12-03T11:28:27.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.953+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~ABN6GE0Z7NF6.1 size=180520 2023-12-03T11:28:27.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.955+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=ABN6GE0Z7NF6 tag=7YR55A114FJE type=write size=2277672 2023-12-03T11:28:27.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.957+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~QK51Y23QFW34.0 size=241666 2023-12-03T11:28:27.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.957+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=QK51Y23QFW34 tag=R2NC75X2GHE1 type=write size=1290242 2023-12-03T11:28:27.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.958+0000 7fe67fa49780 -1 < failed to complete operation key=YEMPVKMDANPG tag=RLK53GT2FHLZ type=del size=353091: (22) Invalid argument 2023-12-03T11:28:27.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.959+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=CUF0IVG8GTS8 type=del size=451853 2023-12-03T11:28:27.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.960+0000 7fe67fa49780 1 < canceled operation key=TXVHRE03Z3DA tag=2UL0KXMZ53RB type=del size=1985889 2023-12-03T11:28:27.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.961+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=YLOW8ZKAB6A2 type=del size=4002062 2023-12-03T11:28:27.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.963+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=GKM75RU17Y8P type=del 2023-12-03T11:28:27.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.964+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=KXQ63OGXR90J type=del size=1967084 2023-12-03T11:28:27.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.965+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=9BY9QOEYS96V type=del 2023-12-03T11:28:27.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.967+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~7JS59LUMRNXP.0 size=293266 2023-12-03T11:28:27.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.967+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=7JS59LUMRNXP tag=H7WLBG4JAQVF type=write size=1341842 2023-12-03T11:28:27.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.968+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=WV4Q8IORJ1QM type=del 2023-12-03T11:28:27.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.970+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~0YJVCJPLMUWF.0 size=1048576 2023-12-03T11:28:27.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.971+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~0YJVCJPLMUWF.1 size=1048576 2023-12-03T11:28:27.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.972+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~0YJVCJPLMUWF.2 size=401601 2023-12-03T11:28:27.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.972+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=0YJVCJPLMUWF tag=U12A5USKVQT5 type=write size=3547329 2023-12-03T11:28:27.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.974+0000 7fe67fa49780 1 < completed write operation key=DDHGOWEI7WEI tag=Q0VFA8TJ8SXP type=write size=719662 2023-12-03T11:28:27.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.975+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=KMOFIZPDVJN9 type=del size=1742646 2023-12-03T11:28:27.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.976+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=SLVQU8YCG17B type=del 2023-12-03T11:28:27.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.977+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=CI1M9KJZY8K9 type=del size=2523355 2023-12-03T11:28:27.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.979+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=U36WOCQAYJ0N type=del 2023-12-03T11:28:27.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.980+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=83QSJ20G03V7 type=write size=79174 2023-12-03T11:28:27.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.981+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~JWEELAFN94S2.0 size=45230 2023-12-03T11:28:27.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.983+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=JWEELAFN94S2 tag=PFKF6H2784VU type=write size=1093806 2023-12-03T11:28:27.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.984+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=W621D4GC96JG type=del size=1918828 2023-12-03T11:28:27.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.986+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~PDDO8WTWD6TW.0 size=39899 2023-12-03T11:28:27.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.988+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=PDDO8WTWD6TW tag=2Y4XJB2HD6J9 type=write size=1088475 2023-12-03T11:28:27.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.989+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=HI0W00EUDCC2 type=del size=265327 2023-12-03T11:28:27.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.990+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~UAG5FDME6XYF.0 size=1048576 2023-12-03T11:28:27.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.990+0000 7fe67fa49780 1 < canceled part key=_multipart_URVD2U16EW75.2~UAG5FDME6XYF.1 size=1048576 2023-12-03T11:28:27.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.991+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~UAG5FDME6XYF.2 size=423452 2023-12-03T11:28:27.994 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.993+0000 7fe67fa49780 1 < canceled multipart upload key=URVD2U16EW75 upload=UAG5FDME6XYF tag=VGP3A5FWTPNH type=write size=3569180 2023-12-03T11:28:27.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.995+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=HJXGMOBS39QZ type=del size=2266696 2023-12-03T11:28:27.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.996+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~FHZZMW0G1TY8.0 size=1048576 2023-12-03T11:28:27.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.996+0000 7fe67fa49780 1 < canceled part key=_multipart_ASODFGLQ5VNY.2~FHZZMW0G1TY8.1 size=1048576 2023-12-03T11:28:27.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.997+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~FHZZMW0G1TY8.2 size=857824 2023-12-03T11:28:28.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:27.999+0000 7fe67fa49780 1 < canceled multipart upload key=ASODFGLQ5VNY upload=FHZZMW0G1TY8 tag=5S6AVZ94EVRG type=write size=4003552 2023-12-03T11:28:28.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.001+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=GQZG3EG4X3ZZ type=del size=2610798 2023-12-03T11:28:28.004 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.003+0000 7fe67fa49780 1 < suggested remove operation key=KMC5YD2M3I45 tag=8UJR4KWOU1YO type=del 2023-12-03T11:28:28.005 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.004+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=LXCHGUVZ83WE type=del size=3099748 2023-12-03T11:28:28.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.006+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=02JKTNMBQM79 type=del 2023-12-03T11:28:28.008 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.007+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=UDVY54QWZCW3 type=del size=2717616 2023-12-03T11:28:28.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.008+0000 7fe67fa49780 1 < completed write operation key=PFBGR7OF7JQG tag=CIQCOWTIS1VC type=write size=1035687 2023-12-03T11:28:28.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.009+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=BZEFRDXOPPPI type=del size=1979426 2023-12-03T11:28:28.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.011+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~QK51Y23QFW34.0 size=241666 2023-12-03T11:28:28.014 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.013+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=QK51Y23QFW34 tag=R2NC75X2GHE1 type=write size=1290242 2023-12-03T11:28:28.015 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.014+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=FUVAUI44CC13 type=del size=1241594 2023-12-03T11:28:28.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.015+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=CUF0IVG8GTS8 type=del 2023-12-03T11:28:28.018 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.017+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~U7A8KSL9DOPP.0 size=1048576 2023-12-03T11:28:28.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.018+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~U7A8KSL9DOPP.1 size=822695 2023-12-03T11:28:28.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.018+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=U7A8KSL9DOPP tag=SGSEXC8ALFOB type=write size=2919847 2023-12-03T11:28:28.022 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.021+0000 7fe67fa49780 1 < suggested remove operation key=IIW1Y6QYEODQ tag=YLOW8ZKAB6A2 type=del 2023-12-03T11:28:28.023 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.022+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=IOF1C6LK7T28 type=write size=560855 2023-12-03T11:28:28.024 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.023+0000 7fe67fa49780 1 < canceled operation key=9OD4G28SDLB4 tag=KXQ63OGXR90J type=del size=1967084 2023-12-03T11:28:28.026 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.025+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~AJCW5OQ7MGZC.0 size=1048576 2023-12-03T11:28:28.027 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.026+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~AJCW5OQ7MGZC.1 size=969047 2023-12-03T11:28:28.027 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.026+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=AJCW5OQ7MGZC tag=0YKLRH8LVAPE type=write size=3066199 2023-12-03T11:28:28.028 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.027+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~7JS59LUMRNXP.0 size=293266 2023-12-03T11:28:28.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.029+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=7JS59LUMRNXP tag=H7WLBG4JAQVF type=write size=1341842 2023-12-03T11:28:28.031 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.030+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=35M7T7RZQXJO type=del size=1191434 2023-12-03T11:28:28.033 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.032+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~0YJVCJPLMUWF.0 size=1048576 2023-12-03T11:28:28.034 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.033+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~0YJVCJPLMUWF.1 size=1048576 2023-12-03T11:28:28.035 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.034+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~0YJVCJPLMUWF.2 size=401601 2023-12-03T11:28:28.037 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.036+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=0YJVCJPLMUWF tag=U12A5USKVQT5 type=write size=3547329 2023-12-03T11:28:28.038 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.037+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=PS3C5LVSQLKK type=write size=232894 2023-12-03T11:28:28.040 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.039+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=KMOFIZPDVJN9 type=del 2023-12-03T11:28:28.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.041+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~US5O4VIMUI83.0 size=1048576 2023-12-03T11:28:28.043 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.042+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~US5O4VIMUI83.1 size=1048576 2023-12-03T11:28:28.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.043+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~US5O4VIMUI83.2 size=773940 2023-12-03T11:28:28.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.043+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=US5O4VIMUI83 tag=89IYS6X9R2LK type=write size=3919668 2023-12-03T11:28:28.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.044+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=CI1M9KJZY8K9 type=del 2023-12-03T11:28:28.048 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.047+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~05P4KKUR98ZK.0 size=1048576 2023-12-03T11:28:28.049 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.048+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~05P4KKUR98ZK.1 size=1048576 2023-12-03T11:28:28.050 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.050+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~05P4KKUR98ZK.2 size=389066 2023-12-03T11:28:28.051 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.050+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=05P4KKUR98ZK tag=GYFWH9L2OIYB type=write size=3534794 2023-12-03T11:28:28.052 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.051+0000 7fe67fa49780 1 < completed write operation key=A7GOX2W0WB83 tag=83QSJ20G03V7 type=write size=79174 2023-12-03T11:28:28.054 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.053+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~5L0PGTUIQE77.0 size=1048576 2023-12-03T11:28:28.055 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.054+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~5L0PGTUIQE77.1 size=1048576 2023-12-03T11:28:28.056 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.055+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~5L0PGTUIQE77.2 size=564764 2023-12-03T11:28:28.056 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.055+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=5L0PGTUIQE77 tag=201LZ3G1UYPB type=write size=3710492 2023-12-03T11:28:28.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.057+0000 7fe67fa49780 1 < suggested remove operation key=YEMPVKMDANPG tag=W621D4GC96JG type=del 2023-12-03T11:28:28.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.059+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=VBCHJ4OGXAFZ type=del size=2984953 2023-12-03T11:28:28.061 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.060+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=HI0W00EUDCC2 type=del 2023-12-03T11:28:28.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.061+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=UDBYLYF7AIJ2 type=del size=3654302 2023-12-03T11:28:28.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.062+0000 7fe67fa49780 -1 < failed to complete operation key=IIW1Y6QYEODQ tag=HJXGMOBS39QZ type=del size=2266696: (22) Invalid argument 2023-12-03T11:28:28.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.063+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=XCGQIVGL8PZH type=del size=1793385 2023-12-03T11:28:28.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.066+0000 7fe67fa49780 1 < suggested remove operation key=8UZJU9PNWIB6 tag=GQZG3EG4X3ZZ type=del 2023-12-03T11:28:28.068 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.067+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=0DR6Z4OJ7496 type=del size=2091139 2023-12-03T11:28:28.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.068+0000 7fe67fa49780 1 < canceled operation key=UL24DVOA31Y7 tag=LXCHGUVZ83WE type=del size=3099748 2023-12-03T11:28:28.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.070+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~RDZVAY2LF7WN.0 size=378582 2023-12-03T11:28:28.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.070+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=RDZVAY2LF7WN tag=F1USLD84LACW type=write size=1427158 2023-12-03T11:28:28.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.071+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=UDVY54QWZCW3 type=del 2023-12-03T11:28:28.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.074+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~0TEWZUDBZ2VB.0 size=1048576 2023-12-03T11:28:28.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.075+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~0TEWZUDBZ2VB.1 size=296314 2023-12-03T11:28:28.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.075+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=0TEWZUDBZ2VB tag=9VQIXR5HZY9O type=write size=2393466 2023-12-03T11:28:28.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.077+0000 7fe67fa49780 1 < suggested update operation key=A7GOX2W0WB83 tag=BZEFRDXOPPPI type=del size=1979426 2023-12-03T11:28:28.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.079+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~XQVG9DGY530O.0 size=1048576 2023-12-03T11:28:28.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.080+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~XQVG9DGY530O.1 size=207690 2023-12-03T11:28:28.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.080+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=XQVG9DGY530O tag=NYRHS2OM4T6Y type=write size=2304842 2023-12-03T11:28:28.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.081+0000 7fe67fa49780 -1 < failed to complete operation key=YEMPVKMDANPG tag=FUVAUI44CC13 type=del size=1241594: (22) Invalid argument 2023-12-03T11:28:28.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.082+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=NQ3ZEFGKSH8V type=del size=2158229 2023-12-03T11:28:28.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.083+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~U7A8KSL9DOPP.0 size=1048576 2023-12-03T11:28:28.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.084+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~U7A8KSL9DOPP.1 size=822695 2023-12-03T11:28:28.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.086+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=U7A8KSL9DOPP tag=SGSEXC8ALFOB type=write size=2919847 2023-12-03T11:28:28.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.088+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~C6FOCDTV2JB6.0 size=31289 2023-12-03T11:28:28.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.088+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=C6FOCDTV2JB6 tag=O9NUPWCMZVSU type=write size=1079865 2023-12-03T11:28:28.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.089+0000 7fe67fa49780 1 < completed write operation key=IIW1Y6QYEODQ tag=IOF1C6LK7T28 type=write size=560855 2023-12-03T11:28:28.093 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.092+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~O2LKZ03DN7VN.0 size=1048576 2023-12-03T11:28:28.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.093+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~O2LKZ03DN7VN.1 size=1048576 2023-12-03T11:28:28.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.094+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~O2LKZ03DN7VN.2 size=4457 2023-12-03T11:28:28.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.094+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=O2LKZ03DN7VN tag=59470RW1EMAB type=write size=3150185 2023-12-03T11:28:28.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.095+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~AJCW5OQ7MGZC.0 size=1048576 2023-12-03T11:28:28.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.095+0000 7fe67fa49780 1 < canceled part key=_multipart_Y0VRZR6S8FP6.2~AJCW5OQ7MGZC.1 size=969047 2023-12-03T11:28:28.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.097+0000 7fe67fa49780 1 < canceled multipart upload key=Y0VRZR6S8FP6 upload=AJCW5OQ7MGZC tag=0YKLRH8LVAPE type=write size=3066199 2023-12-03T11:28:28.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.098+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=O2Z9YB30D28E type=del size=1960773 2023-12-03T11:28:28.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.099+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=35M7T7RZQXJO type=del 2023-12-03T11:28:28.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.100+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=T9PJ8ENVTTUH type=del size=2519934 2023-12-03T11:28:28.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.101+0000 7fe67fa49780 1 < completed write operation key=CC1X1OP7L6BJ tag=PS3C5LVSQLKK type=write size=232894 2023-12-03T11:28:28.103 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.103+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=QQ5N9X8UC95J type=write size=1019948 2023-12-03T11:28:28.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.103+0000 7fe67fa49780 1 < canceled part key=_multipart_Q6GBIBMIJRKV.2~US5O4VIMUI83.0 size=1048576 2023-12-03T11:28:28.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.104+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~US5O4VIMUI83.1 size=1048576 2023-12-03T11:28:28.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.105+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~US5O4VIMUI83.2 size=773940 2023-12-03T11:28:28.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.107+0000 7fe67fa49780 1 < canceled multipart upload key=Q6GBIBMIJRKV upload=US5O4VIMUI83 tag=89IYS6X9R2LK type=write size=3919668 2023-12-03T11:28:28.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.108+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=FYYO6CFEMXT2 type=del size=352751 2023-12-03T11:28:28.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.109+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~05P4KKUR98ZK.0 size=1048576 2023-12-03T11:28:28.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.110+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~05P4KKUR98ZK.1 size=1048576 2023-12-03T11:28:28.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.111+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~05P4KKUR98ZK.2 size=389066 2023-12-03T11:28:28.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.113+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=05P4KKUR98ZK tag=GYFWH9L2OIYB type=write size=3534794 2023-12-03T11:28:28.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.115+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~G96WHO8Z0207.0 size=1048576 2023-12-03T11:28:28.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.115+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~G96WHO8Z0207.1 size=1048576 2023-12-03T11:28:28.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.116+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~G96WHO8Z0207.2 size=416375 2023-12-03T11:28:28.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.116+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=G96WHO8Z0207 tag=Y5YEBIDA71TI type=write size=3562103 2023-12-03T11:28:28.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.117+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~5L0PGTUIQE77.0 size=1048576 2023-12-03T11:28:28.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.118+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~5L0PGTUIQE77.1 size=1048576 2023-12-03T11:28:28.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.119+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~5L0PGTUIQE77.2 size=564764 2023-12-03T11:28:28.122 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.121+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=5L0PGTUIQE77 tag=201LZ3G1UYPB type=write size=3710492 2023-12-03T11:28:28.124 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.124+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~YZFHJ0IMWFSD.0 size=627076 2023-12-03T11:28:28.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.124+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=YZFHJ0IMWFSD tag=N02PKVT1BO0O type=write size=1675652 2023-12-03T11:28:28.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.125+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=VBCHJ4OGXAFZ type=del 2023-12-03T11:28:28.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.126+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=YVQYBPSBQX1F type=write size=628577 2023-12-03T11:28:28.128 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.127+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=UDBYLYF7AIJ2 type=del 2023-12-03T11:28:28.129 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.128+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=K0G79IQ1L6BI type=del size=2463137 2023-12-03T11:28:28.130 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.129+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=XCGQIVGL8PZH type=del 2023-12-03T11:28:28.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.131+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~8DSWXQS1LLLQ.0 size=201885 2023-12-03T11:28:28.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.131+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=8DSWXQS1LLLQ tag=UNSP6FLJXPG3 type=write size=1250461 2023-12-03T11:28:28.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.133+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=0DR6Z4OJ7496 type=del 2023-12-03T11:28:28.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.134+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=CHGJ22ATKLBC type=del size=2209254 2023-12-03T11:28:28.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.135+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~RDZVAY2LF7WN.0 size=378582 2023-12-03T11:28:28.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.137+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=RDZVAY2LF7WN tag=F1USLD84LACW type=write size=1427158 2023-12-03T11:28:28.139 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.139+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=JYOG85WX0005 type=write size=407078 2023-12-03T11:28:28.140 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.139+0000 7fe67fa49780 1 < canceled part key=_multipart_URVD2U16EW75.2~0TEWZUDBZ2VB.0 size=1048576 2023-12-03T11:28:28.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.140+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~0TEWZUDBZ2VB.1 size=296314 2023-12-03T11:28:28.142 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.142+0000 7fe67fa49780 1 < canceled multipart upload key=URVD2U16EW75 upload=0TEWZUDBZ2VB tag=9VQIXR5HZY9O type=write size=2393466 2023-12-03T11:28:28.145 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.144+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~YJ9CB3734CTD.0 size=679826 2023-12-03T11:28:28.145 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.144+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=YJ9CB3734CTD tag=C0M84QYWJG19 type=write size=1728402 2023-12-03T11:28:28.146 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.145+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~XQVG9DGY530O.0 size=1048576 2023-12-03T11:28:28.147 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.146+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~XQVG9DGY530O.1 size=207690 2023-12-03T11:28:28.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.148+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=XQVG9DGY530O tag=NYRHS2OM4T6Y type=write size=2304842 2023-12-03T11:28:28.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.150+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=92U3Y9LVMAUP type=del size=140520 2023-12-03T11:28:28.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.151+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=NQ3ZEFGKSH8V type=del 2023-12-03T11:28:28.153 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.152+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=N33KU1H5SCKH type=del size=766322 2023-12-03T11:28:28.154 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.153+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~C6FOCDTV2JB6.0 size=31289 2023-12-03T11:28:28.156 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.155+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=C6FOCDTV2JB6 tag=O9NUPWCMZVSU type=write size=1079865 2023-12-03T11:28:28.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.157+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~PT5WPJE383A5.0 size=8815 2023-12-03T11:28:28.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.157+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=PT5WPJE383A5 tag=8419SGX87ED1 type=write size=1057391 2023-12-03T11:28:28.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.160+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~O2LKZ03DN7VN.0 size=1048576 2023-12-03T11:28:28.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.161+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~O2LKZ03DN7VN.1 size=1048576 2023-12-03T11:28:28.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.161+0000 7fe67fa49780 1 < canceled part key=_multipart_0G8KNJBJ9K1Z.2~O2LKZ03DN7VN.2 size=4457 2023-12-03T11:28:28.164 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.163+0000 7fe67fa49780 1 < canceled multipart upload key=0G8KNJBJ9K1Z upload=O2LKZ03DN7VN tag=59470RW1EMAB type=write size=3150185 2023-12-03T11:28:28.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.164+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=Q9NJKI7XFJ09 type=del size=2635723 2023-12-03T11:28:28.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.165+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=O2Z9YB30D28E type=del 2023-12-03T11:28:28.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.166+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=H5K8E5F4F5D6 type=del size=1329285 2023-12-03T11:28:28.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.169+0000 7fe67fa49780 1 < suggested update operation key=ASODFGLQ5VNY tag=T9PJ8ENVTTUH type=del size=2519934 2023-12-03T11:28:28.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.170+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=KAZJOC0AEK48 type=del size=4115771 2023-12-03T11:28:28.172 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.171+0000 7fe67fa49780 1 < canceled operation key=CIB1NZHJGO46 tag=QQ5N9X8UC95J type=write size=1019948 2023-12-03T11:28:28.174 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.173+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~KAM5GCAHTIOD.0 size=1048576 2023-12-03T11:28:28.175 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.174+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~KAM5GCAHTIOD.1 size=275413 2023-12-03T11:28:28.175 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.174+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=KAM5GCAHTIOD tag=M1DI2SA9VOIO type=write size=2372565 2023-12-03T11:28:28.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.176+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=FYYO6CFEMXT2 type=del 2023-12-03T11:28:28.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.177+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=USTVQ2EMOVCQ type=del size=3580472 2023-12-03T11:28:28.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.178+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~G96WHO8Z0207.0 size=1048576 2023-12-03T11:28:28.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.179+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~G96WHO8Z0207.1 size=1048576 2023-12-03T11:28:28.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.180+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~G96WHO8Z0207.2 size=416375 2023-12-03T11:28:28.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.183+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=G96WHO8Z0207 tag=Y5YEBIDA71TI type=write size=3562103 2023-12-03T11:28:28.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.184+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=WR0YJWNWE0JG type=write size=1033008 2023-12-03T11:28:28.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.185+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~YZFHJ0IMWFSD.0 size=627076 2023-12-03T11:28:28.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.187+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=YZFHJ0IMWFSD tag=N02PKVT1BO0O type=write size=1675652 2023-12-03T11:28:28.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.189+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~IMQ0KC3VW8X8.0 size=1048576 2023-12-03T11:28:28.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.190+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~IMQ0KC3VW8X8.1 size=1048576 2023-12-03T11:28:28.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.191+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~IMQ0KC3VW8X8.2 size=203165 2023-12-03T11:28:28.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.191+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=IMQ0KC3VW8X8 tag=KV9GNKTLMLXF type=write size=3348893 2023-12-03T11:28:28.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.193+0000 7fe67fa49780 1 < suggested update operation key=SIES92K9QVJV tag=YVQYBPSBQX1F type=write size=628577 2023-12-03T11:28:28.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.195+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~T7D3MOEK75DX.0 size=1048576 2023-12-03T11:28:28.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.196+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~T7D3MOEK75DX.1 size=1048576 2023-12-03T11:28:28.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.197+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~T7D3MOEK75DX.2 size=539995 2023-12-03T11:28:28.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.197+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=T7D3MOEK75DX tag=8QI9RGCX879T type=write size=3685723 2023-12-03T11:28:28.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.200+0000 7fe67fa49780 1 < suggested remove operation key=Q6GBIBMIJRKV tag=K0G79IQ1L6BI type=del 2023-12-03T11:28:28.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.201+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=SCQ4Q0OIX6GO type=del size=2454940 2023-12-03T11:28:28.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.202+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~8DSWXQS1LLLQ.0 size=201885 2023-12-03T11:28:28.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.204+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=8DSWXQS1LLLQ tag=UNSP6FLJXPG3 type=write size=1250461 2023-12-03T11:28:28.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.206+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~O4EKI4YTL201.0 size=1048576 2023-12-03T11:28:28.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.207+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~O4EKI4YTL201.1 size=1048576 2023-12-03T11:28:28.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.208+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~O4EKI4YTL201.2 size=806913 2023-12-03T11:28:28.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.208+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=O4EKI4YTL201 tag=H38O45GYVCOX type=write size=3952641 2023-12-03T11:28:28.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.209+0000 7fe67fa49780 -1 < failed to complete operation key=ASODFGLQ5VNY tag=CHGJ22ATKLBC type=del size=2209254: (22) Invalid argument 2023-12-03T11:28:28.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.210+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=D06ON2VRLFIR type=del size=4132147 2023-12-03T11:28:28.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.211+0000 7fe67fa49780 1 < completed write operation key=H8MBLWXG7BCZ tag=JYOG85WX0005 type=write size=407078 2023-12-03T11:28:28.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.214+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~VB69QHDDVBNQ.0 size=1048576 2023-12-03T11:28:28.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.214+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~VB69QHDDVBNQ.1 size=887599 2023-12-03T11:28:28.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.214+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=VB69QHDDVBNQ tag=GAAZ7UP60N4Q type=write size=2984751 2023-12-03T11:28:28.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.216+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~YJ9CB3734CTD.0 size=679826 2023-12-03T11:28:28.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.218+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=YJ9CB3734CTD tag=C0M84QYWJG19 type=write size=1728402 2023-12-03T11:28:28.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.220+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~GO82WKW65AWZ.0 size=1048576 2023-12-03T11:28:28.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.221+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~GO82WKW65AWZ.1 size=96318 2023-12-03T11:28:28.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.221+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=GO82WKW65AWZ tag=NJJ71OLKWAEC type=write size=2193470 2023-12-03T11:28:28.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.223+0000 7fe67fa49780 1 < suggested remove operation key=H8MBLWXG7BCZ tag=92U3Y9LVMAUP type=del 2023-12-03T11:28:28.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.225+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~VJ5A8DU5VC28.0 size=1048576 2023-12-03T11:28:28.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.226+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~VJ5A8DU5VC28.1 size=1023420 2023-12-03T11:28:28.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.226+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=VJ5A8DU5VC28 tag=4WX0JWR50R8L type=write size=3120572 2023-12-03T11:28:28.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.227+0000 7fe67fa49780 1 < canceled operation key=006X4CSXV0KA tag=N33KU1H5SCKH type=del size=766322 2023-12-03T11:28:28.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.228+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=3QS94R464480 type=del size=2120798 2023-12-03T11:28:28.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.230+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~PT5WPJE383A5.0 size=8815 2023-12-03T11:28:28.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.232+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=PT5WPJE383A5 tag=8419SGX87ED1 type=write size=1057391 2023-12-03T11:28:28.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.234+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~26GWLIZ8D8MM.0 size=916737 2023-12-03T11:28:28.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.234+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=26GWLIZ8D8MM tag=FZUVSXNZKSIU type=write size=1965313 2023-12-03T11:28:28.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.235+0000 7fe67fa49780 -1 < failed to complete operation key=H8MBLWXG7BCZ tag=Q9NJKI7XFJ09 type=del size=2635723: (22) Invalid argument 2023-12-03T11:28:28.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.236+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=JJG3EIB3FBW9 type=del size=522413 2023-12-03T11:28:28.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.239+0000 7fe67fa49780 1 < suggested remove operation key=Y0VRZR6S8FP6 tag=H5K8E5F4F5D6 type=del 2023-12-03T11:28:28.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.240+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=OCE3SALRSOM8 type=del size=3024328 2023-12-03T11:28:28.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.243+0000 7fe67fa49780 1 < suggested update operation key=YEMPVKMDANPG tag=KAZJOC0AEK48 type=del size=4115771 2023-12-03T11:28:28.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.244+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=P1CX1P0VQXQA type=del size=980892 2023-12-03T11:28:28.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.245+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~KAM5GCAHTIOD.0 size=1048576 2023-12-03T11:28:28.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.245+0000 7fe67fa49780 1 < canceled part key=_multipart_2GX6IWVZH25N.2~KAM5GCAHTIOD.1 size=275413 2023-12-03T11:28:28.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.247+0000 7fe67fa49780 1 < canceled multipart upload key=2GX6IWVZH25N upload=KAM5GCAHTIOD tag=M1DI2SA9VOIO type=write size=2372565 2023-12-03T11:28:28.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.249+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=XSUGM4G2LIVP type=del size=2547271 2023-12-03T11:28:28.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.251+0000 7fe67fa49780 1 < suggested remove operation key=983BDZLASC3S tag=USTVQ2EMOVCQ type=del 2023-12-03T11:28:28.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.252+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=PGCNSYJAXIST type=del size=3172613 2023-12-03T11:28:28.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.254+0000 7fe67fa49780 1 < suggested update operation key=CC1X1OP7L6BJ tag=WR0YJWNWE0JG type=write size=1033008 2023-12-03T11:28:28.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.256+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~O24O7M8T4HQP.0 size=740894 2023-12-03T11:28:28.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.256+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=O24O7M8T4HQP tag=JG4BS92W8U8C type=write size=1789470 2023-12-03T11:28:28.259 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.258+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~IMQ0KC3VW8X8.0 size=1048576 2023-12-03T11:28:28.259 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.258+0000 7fe67fa49780 1 < canceled part key=_multipart_V9ZVWHO8IF8L.2~IMQ0KC3VW8X8.1 size=1048576 2023-12-03T11:28:28.259 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.258+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~IMQ0KC3VW8X8.2 size=203165 2023-12-03T11:28:28.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.261+0000 7fe67fa49780 1 < canceled multipart upload key=V9ZVWHO8IF8L upload=IMQ0KC3VW8X8 tag=KV9GNKTLMLXF type=write size=3348893 2023-12-03T11:28:28.264 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.263+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~LE3HEUHNWB9P.0 size=925947 2023-12-03T11:28:28.264 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.263+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=LE3HEUHNWB9P tag=0GO3N3GDVBLP type=write size=1974523 2023-12-03T11:28:28.265 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.264+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~T7D3MOEK75DX.0 size=1048576 2023-12-03T11:28:28.266 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.265+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~T7D3MOEK75DX.1 size=1048576 2023-12-03T11:28:28.266 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.265+0000 7fe67fa49780 1 < canceled part key=_multipart_UL24DVOA31Y7.2~T7D3MOEK75DX.2 size=539995 2023-12-03T11:28:28.268 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.267+0000 7fe67fa49780 1 < canceled multipart upload key=UL24DVOA31Y7 upload=T7D3MOEK75DX tag=8QI9RGCX879T type=write size=3685723 2023-12-03T11:28:28.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.269+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=L6Q8H8DVIPX3 type=del size=1249146 2023-12-03T11:28:28.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.270+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=SCQ4Q0OIX6GO type=del 2023-12-03T11:28:28.274 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.273+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~3CXUY93SA3G8.0 size=1048576 2023-12-03T11:28:28.275 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.274+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~3CXUY93SA3G8.1 size=486149 2023-12-03T11:28:28.275 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.274+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=3CXUY93SA3G8 tag=DT57LX2LVKWH type=write size=2583301 2023-12-03T11:28:28.276 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.275+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~O4EKI4YTL201.0 size=1048576 2023-12-03T11:28:28.276 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.275+0000 7fe67fa49780 1 < canceled part key=_multipart_IIW1Y6QYEODQ.2~O4EKI4YTL201.1 size=1048576 2023-12-03T11:28:28.277 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.276+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~O4EKI4YTL201.2 size=806913 2023-12-03T11:28:28.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.277+0000 7fe67fa49780 1 < canceled multipart upload key=IIW1Y6QYEODQ upload=O4EKI4YTL201 tag=H38O45GYVCOX type=write size=3952641 2023-12-03T11:28:28.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.279+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=2Z6WTF0JRPO5 type=write size=619960 2023-12-03T11:28:28.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.280+0000 7fe67fa49780 -1 < failed to complete operation key=CC1X1OP7L6BJ tag=D06ON2VRLFIR type=del size=4132147: (22) Invalid argument 2023-12-03T11:28:28.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.281+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=SDP906BR13F0 type=write size=4600 2023-12-03T11:28:28.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.282+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~VB69QHDDVBNQ.0 size=1048576 2023-12-03T11:28:28.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.282+0000 7fe67fa49780 1 < canceled part key=_multipart_TXVHRE03Z3DA.2~VB69QHDDVBNQ.1 size=887599 2023-12-03T11:28:28.286 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.284+0000 7fe67fa49780 1 < canceled multipart upload key=TXVHRE03Z3DA upload=VB69QHDDVBNQ tag=GAAZ7UP60N4Q type=write size=2984751 2023-12-03T11:28:28.286 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.285+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=JPSK9EHGDJ6O type=write size=191558 2023-12-03T11:28:28.287 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.285+0000 7fe67fa49780 1 < canceled part key=_multipart_SIES92K9QVJV.2~GO82WKW65AWZ.0 size=1048576 2023-12-03T11:28:28.287 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.286+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~GO82WKW65AWZ.1 size=96318 2023-12-03T11:28:28.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.288+0000 7fe67fa49780 1 < canceled multipart upload key=SIES92K9QVJV upload=GO82WKW65AWZ tag=NJJ71OLKWAEC type=write size=2193470 2023-12-03T11:28:28.291 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.290+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~CNR7ZEAIHQ7S.0 size=80053 2023-12-03T11:28:28.291 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.290+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=CNR7ZEAIHQ7S tag=7LCLNDIIWACJ type=write size=1128629 2023-12-03T11:28:28.292 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.291+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~VJ5A8DU5VC28.0 size=1048576 2023-12-03T11:28:28.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.292+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~VJ5A8DU5VC28.1 size=1023420 2023-12-03T11:28:28.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.294+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=VJ5A8DU5VC28 tag=4WX0JWR50R8L type=write size=3120572 2023-12-03T11:28:28.297 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.297+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~GD5801V7VON9.0 size=1048576 2023-12-03T11:28:28.298 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.297+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~GD5801V7VON9.1 size=1048576 2023-12-03T11:28:28.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.298+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~GD5801V7VON9.2 size=541434 2023-12-03T11:28:28.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.298+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=GD5801V7VON9 tag=WAHUQX6W48IR type=write size=3687162 2023-12-03T11:28:28.300 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.299+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=3QS94R464480 type=del 2023-12-03T11:28:28.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.301+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~4ZX2IKS1KKMO.0 size=1048576 2023-12-03T11:28:28.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.302+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~4ZX2IKS1KKMO.1 size=325676 2023-12-03T11:28:28.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.302+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=4ZX2IKS1KKMO tag=DL4AMGSDAO8D type=write size=2422828 2023-12-03T11:28:28.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.303+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~26GWLIZ8D8MM.0 size=916737 2023-12-03T11:28:28.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.305+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=26GWLIZ8D8MM tag=FZUVSXNZKSIU type=write size=1965313 2023-12-03T11:28:28.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.306+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=K7UTWYFRROFO type=del size=2722246 2023-12-03T11:28:28.308 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.307+0000 7fe67fa49780 1 < canceled operation key=0G8KNJBJ9K1Z tag=JJG3EIB3FBW9 type=del size=522413 2023-12-03T11:28:28.310 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.308+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=5J48Z91M0H6U type=del size=148546 2023-12-03T11:28:28.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.310+0000 7fe67fa49780 1 < canceled operation key=H8MBLWXG7BCZ tag=OCE3SALRSOM8 type=del size=3024328 2023-12-03T11:28:28.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.312+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~F0L5JQW9U1GE.0 size=1048576 2023-12-03T11:28:28.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.313+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~F0L5JQW9U1GE.1 size=1048576 2023-12-03T11:28:28.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.313+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~F0L5JQW9U1GE.2 size=198930 2023-12-03T11:28:28.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.313+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=F0L5JQW9U1GE tag=5ITIYMGMC0EL type=write size=3344658 2023-12-03T11:28:28.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.316+0000 7fe67fa49780 1 < suggested remove operation key=Q6GBIBMIJRKV tag=P1CX1P0VQXQA type=del 2023-12-03T11:28:28.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.317+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=RIP0NI1GZNGE type=del size=3473856 2023-12-03T11:28:28.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.318+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=XSUGM4G2LIVP type=del 2023-12-03T11:28:28.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.320+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~HW53HGUQ2IMI.0 size=385839 2023-12-03T11:28:28.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.320+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=HW53HGUQ2IMI tag=1Q8BPOW9ZV4M type=write size=1434415 2023-12-03T11:28:28.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.321+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=PGCNSYJAXIST type=del 2023-12-03T11:28:28.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.322+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=JHG73I13OZ8H type=write size=300187 2023-12-03T11:28:28.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.324+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~O24O7M8T4HQP.0 size=740894 2023-12-03T11:28:28.326 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.326+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=O24O7M8T4HQP tag=JG4BS92W8U8C type=write size=1789470 2023-12-03T11:28:28.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.328+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~B9QUFS677XVN.0 size=354246 2023-12-03T11:28:28.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.328+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=B9QUFS677XVN tag=8TAH5GVB1HF4 type=write size=1402822 2023-12-03T11:28:28.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.329+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~LE3HEUHNWB9P.0 size=925947 2023-12-03T11:28:28.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.331+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=LE3HEUHNWB9P tag=0GO3N3GDVBLP type=write size=1974523 2023-12-03T11:28:28.333 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.332+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=TPJ3EIEDANZJ type=del size=1116299 2023-12-03T11:28:28.334 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.333+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=L6Q8H8DVIPX3 type=del 2023-12-03T11:28:28.335 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.334+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=6DBZPLW5TOD3 type=del size=1753084 2023-12-03T11:28:28.335 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.334+0000 7fe67fa49780 1 < canceled part key=_multipart_Q6GBIBMIJRKV.2~3CXUY93SA3G8.0 size=1048576 2023-12-03T11:28:28.336 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.334+0000 7fe67fa49780 1 < canceled part key=_multipart_Q6GBIBMIJRKV.2~3CXUY93SA3G8.1 size=486149 2023-12-03T11:28:28.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.336+0000 7fe67fa49780 1 < canceled multipart upload key=Q6GBIBMIJRKV upload=3CXUY93SA3G8 tag=DT57LX2LVKWH type=write size=2583301 2023-12-03T11:28:28.338 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.337+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=DWTS280PG8F0 type=del size=1702473 2023-12-03T11:28:28.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.339+0000 7fe67fa49780 1 < completed write operation key=N87KA638VE01 tag=2Z6WTF0JRPO5 type=write size=619960 2023-12-03T11:28:28.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.341+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~2QS2XNUOW2Z0.0 size=331101 2023-12-03T11:28:28.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.341+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=2QS2XNUOW2Z0 tag=54GPPHU6M3KF type=write size=1379677 2023-12-03T11:28:28.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.342+0000 7fe67fa49780 1 < completed write operation key=8UZJU9PNWIB6 tag=SDP906BR13F0 type=write size=4600 2023-12-03T11:28:28.344 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.343+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=CSNSOAPL2HN3 type=del size=2676276 2023-12-03T11:28:28.345 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.344+0000 7fe67fa49780 -1 < no bi entry to suggest for operation key=Q6GBIBMIJRKV tag=JPSK9EHGDJ6O type=write size=191558: (2) No such file or directory 2023-12-03T11:28:28.347 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.346+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~VCBEYF1XNI5M.0 size=1048576 2023-12-03T11:28:28.347 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.347+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~VCBEYF1XNI5M.1 size=1048576 2023-12-03T11:28:28.349 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.348+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~VCBEYF1XNI5M.2 size=921774 2023-12-03T11:28:28.349 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.348+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=VCBEYF1XNI5M tag=MHKKQZIJV58B type=write size=4067502 2023-12-03T11:28:28.349 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.348+0000 7fe67fa49780 1 < canceled part key=_multipart_0G8KNJBJ9K1Z.2~CNR7ZEAIHQ7S.0 size=80053 2023-12-03T11:28:28.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.350+0000 7fe67fa49780 1 < canceled multipart upload key=0G8KNJBJ9K1Z upload=CNR7ZEAIHQ7S tag=7LCLNDIIWACJ type=write size=1128629 2023-12-03T11:28:28.352 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.351+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=KKE8GWW3RBZB type=del size=756367 2023-12-03T11:28:28.353 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.353+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~GD5801V7VON9.0 size=1048576 2023-12-03T11:28:28.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.354+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~GD5801V7VON9.1 size=1048576 2023-12-03T11:28:28.356 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.355+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~GD5801V7VON9.2 size=541434 2023-12-03T11:28:28.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.357+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=GD5801V7VON9 tag=WAHUQX6W48IR type=write size=3687162 2023-12-03T11:28:28.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.358+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=5S9PGSEBO8MY type=del size=3443570 2023-12-03T11:28:28.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.360+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~4ZX2IKS1KKMO.0 size=1048576 2023-12-03T11:28:28.362 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.361+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~4ZX2IKS1KKMO.1 size=325676 2023-12-03T11:28:28.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.363+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=4ZX2IKS1KKMO tag=DL4AMGSDAO8D type=write size=2422828 2023-12-03T11:28:28.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.364+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=7NV54VTQXC3U type=write size=128472 2023-12-03T11:28:28.366 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.365+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=K7UTWYFRROFO type=del 2023-12-03T11:28:28.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.366+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=H18XH7JRCBPH type=del size=1572804 2023-12-03T11:28:28.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.367+0000 7fe67fa49780 -1 < failed to complete operation key=Q6GBIBMIJRKV tag=5J48Z91M0H6U type=del size=148546: (22) Invalid argument 2023-12-03T11:28:28.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.369+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=M35F0FNJHF76 type=del size=3434032 2023-12-03T11:28:28.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.370+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~F0L5JQW9U1GE.0 size=1048576 2023-12-03T11:28:28.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.373+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~F0L5JQW9U1GE.1 size=1048576 2023-12-03T11:28:28.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.375+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~F0L5JQW9U1GE.2 size=198930 2023-12-03T11:28:28.379 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.378+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=F0L5JQW9U1GE tag=5ITIYMGMC0EL type=write size=3344658 2023-12-03T11:28:28.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.379+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=HRS0ON1FOL5C type=del size=617586 2023-12-03T11:28:28.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.380+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=RIP0NI1GZNGE type=del 2023-12-03T11:28:28.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.383+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~NBO35TWO4VC7.0 size=1048576 2023-12-03T11:28:28.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.385+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~NBO35TWO4VC7.1 size=1048576 2023-12-03T11:28:28.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.386+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~NBO35TWO4VC7.2 size=740831 2023-12-03T11:28:28.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.386+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=NBO35TWO4VC7 tag=EBKH3FUOUW1B type=write size=3886559 2023-12-03T11:28:28.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.387+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~HW53HGUQ2IMI.0 size=385839 2023-12-03T11:28:28.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.389+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=HW53HGUQ2IMI tag=1Q8BPOW9ZV4M type=write size=1434415 2023-12-03T11:28:28.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.391+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=JFEOM2TXAHQ5 type=del size=1885723 2023-12-03T11:28:28.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.392+0000 7fe67fa49780 1 < completed write operation key=PFBGR7OF7JQG tag=JHG73I13OZ8H type=write size=300187 2023-12-03T11:28:28.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.394+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~WJ9Z2N4G1PZH.0 size=1048576 2023-12-03T11:28:28.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.395+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~WJ9Z2N4G1PZH.1 size=1048576 2023-12-03T11:28:28.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.396+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~WJ9Z2N4G1PZH.2 size=82012 2023-12-03T11:28:28.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.396+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=WJ9Z2N4G1PZH tag=VQSWIOSERXTR type=write size=3227740 2023-12-03T11:28:28.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.398+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~B9QUFS677XVN.0 size=354246 2023-12-03T11:28:28.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.400+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=B9QUFS677XVN tag=8TAH5GVB1HF4 type=write size=1402822 2023-12-03T11:28:28.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.402+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~9UR264BMNBRB.0 size=1048576 2023-12-03T11:28:28.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.403+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~9UR264BMNBRB.1 size=755119 2023-12-03T11:28:28.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.403+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=9UR264BMNBRB tag=I9X6S5DT10T6 type=write size=2852271 2023-12-03T11:28:28.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.404+0000 7fe67fa49780 1 < canceled operation key=IIW1Y6QYEODQ tag=TPJ3EIEDANZJ type=del size=1116299 2023-12-03T11:28:28.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.407+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~F771Z4WAJCIB.0 size=1048576 2023-12-03T11:28:28.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.408+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~F771Z4WAJCIB.1 size=712246 2023-12-03T11:28:28.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.408+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=F771Z4WAJCIB tag=JI89HS8IS2AS type=write size=2809398 2023-12-03T11:28:28.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.409+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=6DBZPLW5TOD3 type=del 2023-12-03T11:28:28.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.412+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~7WFES5JAR9TP.0 size=1048576 2023-12-03T11:28:28.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.413+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~7WFES5JAR9TP.1 size=1048576 2023-12-03T11:28:28.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.413+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~7WFES5JAR9TP.2 size=323402 2023-12-03T11:28:28.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.413+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=7WFES5JAR9TP tag=ZWMK7EN7QKEN type=write size=3469130 2023-12-03T11:28:28.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.415+0000 7fe67fa49780 1 < canceled operation key=006X4CSXV0KA tag=DWTS280PG8F0 type=del size=1702473 2023-12-03T11:28:28.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.416+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=6FVANQ17X6IL type=del size=4022374 2023-12-03T11:28:28.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.417+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~2QS2XNUOW2Z0.0 size=331101 2023-12-03T11:28:28.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.419+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=2QS2XNUOW2Z0 tag=54GPPHU6M3KF type=write size=1379677 2023-12-03T11:28:28.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.422+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~OT630I2RXO4H.0 size=1048576 2023-12-03T11:28:28.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.423+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~OT630I2RXO4H.1 size=1048576 2023-12-03T11:28:28.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.424+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~OT630I2RXO4H.2 size=202067 2023-12-03T11:28:28.425 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.424+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=OT630I2RXO4H tag=230L9KDKMYM2 type=write size=3347795 2023-12-03T11:28:28.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.425+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=CSNSOAPL2HN3 type=del 2023-12-03T11:28:28.428 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.427+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~UBQAZ4DATHVV.0 size=1048576 2023-12-03T11:28:28.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.428+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~UBQAZ4DATHVV.1 size=1048576 2023-12-03T11:28:28.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.429+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~UBQAZ4DATHVV.2 size=563318 2023-12-03T11:28:28.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.429+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=UBQAZ4DATHVV tag=73KQVNOLM50F type=write size=3709046 2023-12-03T11:28:28.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.430+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~VCBEYF1XNI5M.0 size=1048576 2023-12-03T11:28:28.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.431+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~VCBEYF1XNI5M.1 size=1048576 2023-12-03T11:28:28.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.432+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~VCBEYF1XNI5M.2 size=921774 2023-12-03T11:28:28.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.435+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=VCBEYF1XNI5M tag=MHKKQZIJV58B type=write size=4067502 2023-12-03T11:28:28.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.438+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~9NN18Y7GLI1N.0 size=693042 2023-12-03T11:28:28.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.438+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=9NN18Y7GLI1N tag=XIFUMAEWPEH9 type=write size=1741618 2023-12-03T11:28:28.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.440+0000 7fe67fa49780 1 < suggested remove operation key=N87KA638VE01 tag=KKE8GWW3RBZB type=del 2023-12-03T11:28:28.442 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.441+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=R1K343CD5Z2I type=del size=1808920 2023-12-03T11:28:28.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.443+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=5S9PGSEBO8MY type=del 2023-12-03T11:28:28.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.444+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=MJKOGGM7EK0S type=del size=687127 2023-12-03T11:28:28.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.445+0000 7fe67fa49780 1 < canceled operation key=Z1NFEIZNYYO2 tag=7NV54VTQXC3U type=write size=128472 2023-12-03T11:28:28.448 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.447+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~4PRI6Q8MDCZX.0 size=1048576 2023-12-03T11:28:28.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.448+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~4PRI6Q8MDCZX.1 size=789338 2023-12-03T11:28:28.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.448+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=4PRI6Q8MDCZX tag=V02GDH7N8RFJ type=write size=2886490 2023-12-03T11:28:28.450 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.449+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=H18XH7JRCBPH type=del 2023-12-03T11:28:28.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.450+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=6IQIHUXAEOVG type=write size=71328 2023-12-03T11:28:28.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.453+0000 7fe67fa49780 1 < suggested remove operation key=PFBGR7OF7JQG tag=M35F0FNJHF76 type=del 2023-12-03T11:28:28.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.454+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=0UJNLN40OH34 type=write size=390480 2023-12-03T11:28:28.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.455+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=HRS0ON1FOL5C type=del 2023-12-03T11:28:28.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.457+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~0KJ163AP637Z.0 size=746015 2023-12-03T11:28:28.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.457+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=0KJ163AP637Z tag=PY0Q3ZYJG5LA type=write size=1794591 2023-12-03T11:28:28.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.458+0000 7fe67fa49780 1 < canceled part key=_multipart_KMC5YD2M3I45.2~NBO35TWO4VC7.0 size=1048576 2023-12-03T11:28:28.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.458+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~NBO35TWO4VC7.1 size=1048576 2023-12-03T11:28:28.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.460+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~NBO35TWO4VC7.2 size=740831 2023-12-03T11:28:28.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.462+0000 7fe67fa49780 1 < canceled multipart upload key=KMC5YD2M3I45 upload=NBO35TWO4VC7 tag=EBKH3FUOUW1B type=write size=3886559 2023-12-03T11:28:28.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.463+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=50S0IRN42KPU type=del size=36854 2023-12-03T11:28:28.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.464+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=JFEOM2TXAHQ5 type=del 2023-12-03T11:28:28.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.465+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=XJAUR8ENN716 type=del size=3567972 2023-12-03T11:28:28.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.467+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~WJ9Z2N4G1PZH.0 size=1048576 2023-12-03T11:28:28.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.467+0000 7fe67fa49780 1 < canceled part key=_multipart_8UZJU9PNWIB6.2~WJ9Z2N4G1PZH.1 size=1048576 2023-12-03T11:28:28.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.468+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~WJ9Z2N4G1PZH.2 size=82012 2023-12-03T11:28:28.471 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.470+0000 7fe67fa49780 1 < canceled multipart upload key=8UZJU9PNWIB6 upload=WJ9Z2N4G1PZH tag=VQSWIOSERXTR type=write size=3227740 2023-12-03T11:28:28.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.472+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~S2CBF4HTC164.0 size=185738 2023-12-03T11:28:28.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.472+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=S2CBF4HTC164 tag=YHQW0PY0XK25 type=write size=1234314 2023-12-03T11:28:28.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.474+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~9UR264BMNBRB.0 size=1048576 2023-12-03T11:28:28.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.474+0000 7fe67fa49780 1 < canceled part key=_multipart_N87KA638VE01.2~9UR264BMNBRB.1 size=755119 2023-12-03T11:28:28.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.476+0000 7fe67fa49780 1 < canceled multipart upload key=N87KA638VE01 upload=9UR264BMNBRB tag=I9X6S5DT10T6 type=write size=2852271 2023-12-03T11:28:28.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.478+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~GVOQZWIFWKL8.0 size=705267 2023-12-03T11:28:28.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.478+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=GVOQZWIFWKL8 tag=IS22U72TWZ21 type=write size=1753843 2023-12-03T11:28:28.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.478+0000 7fe67fa49780 1 < canceled part key=_multipart_Q6GBIBMIJRKV.2~F771Z4WAJCIB.0 size=1048576 2023-12-03T11:28:28.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.479+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~F771Z4WAJCIB.1 size=712246 2023-12-03T11:28:28.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.481+0000 7fe67fa49780 1 < canceled multipart upload key=Q6GBIBMIJRKV upload=F771Z4WAJCIB tag=JI89HS8IS2AS type=write size=2809398 2023-12-03T11:28:28.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.482+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=O80R6SOVQFKX type=del size=2743257 2023-12-03T11:28:28.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.482+0000 7fe67fa49780 1 < canceled part key=_multipart_ASODFGLQ5VNY.2~7WFES5JAR9TP.0 size=1048576 2023-12-03T11:28:28.484 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.483+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~7WFES5JAR9TP.1 size=1048576 2023-12-03T11:28:28.485 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.484+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~7WFES5JAR9TP.2 size=323402 2023-12-03T11:28:28.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.486+0000 7fe67fa49780 1 < canceled multipart upload key=ASODFGLQ5VNY upload=7WFES5JAR9TP tag=ZWMK7EN7QKEN type=write size=3469130 2023-12-03T11:28:28.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.487+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=KXNQK0ZEEHXP type=del size=979074 2023-12-03T11:28:28.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.489+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=6FVANQ17X6IL type=del 2023-12-03T11:28:28.491 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.490+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=CM44KSIMQ4SV type=del size=1334139 2023-12-03T11:28:28.492 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.491+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~OT630I2RXO4H.0 size=1048576 2023-12-03T11:28:28.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.492+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~OT630I2RXO4H.1 size=1048576 2023-12-03T11:28:28.494 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.493+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~OT630I2RXO4H.2 size=202067 2023-12-03T11:28:28.496 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.495+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=OT630I2RXO4H tag=230L9KDKMYM2 type=write size=3347795 2023-12-03T11:28:28.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.497+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~45WKMBH7V3MW.0 size=1048576 2023-12-03T11:28:28.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.499+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~45WKMBH7V3MW.1 size=1048576 2023-12-03T11:28:28.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.500+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~45WKMBH7V3MW.2 size=662855 2023-12-03T11:28:28.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.500+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=45WKMBH7V3MW tag=XVLQCTPLCQCV type=write size=3808583 2023-12-03T11:28:28.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.502+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~UBQAZ4DATHVV.0 size=1048576 2023-12-03T11:28:28.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.503+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~UBQAZ4DATHVV.1 size=1048576 2023-12-03T11:28:28.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.504+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~UBQAZ4DATHVV.2 size=563318 2023-12-03T11:28:28.507 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.506+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=UBQAZ4DATHVV tag=73KQVNOLM50F type=write size=3709046 2023-12-03T11:28:28.508 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.507+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=OKMDQG3XAMJ5 type=del size=1808101 2023-12-03T11:28:28.508 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.507+0000 7fe67fa49780 1 < canceled part key=_multipart_URVD2U16EW75.2~9NN18Y7GLI1N.0 size=693042 2023-12-03T11:28:28.510 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.509+0000 7fe67fa49780 1 < canceled multipart upload key=URVD2U16EW75 upload=9NN18Y7GLI1N tag=XIFUMAEWPEH9 type=write size=1741618 2023-12-03T11:28:28.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.510+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=UTGTV713N3NT type=del size=1578503 2023-12-03T11:28:28.513 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.512+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=R1K343CD5Z2I type=del 2023-12-03T11:28:28.514 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.513+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=ZTB6WTJITUMG type=del size=2601978 2023-12-03T11:28:28.515 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.514+0000 7fe67fa49780 1 < canceled operation key=983BDZLASC3S tag=MJKOGGM7EK0S type=del size=687127 2023-12-03T11:28:28.516 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.515+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=83L81GYSZOL4 type=del size=2931627 2023-12-03T11:28:28.517 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.516+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~4PRI6Q8MDCZX.0 size=1048576 2023-12-03T11:28:28.518 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.517+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~4PRI6Q8MDCZX.1 size=789338 2023-12-03T11:28:28.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.519+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=4PRI6Q8MDCZX tag=V02GDH7N8RFJ type=write size=2886490 2023-12-03T11:28:28.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.521+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~8VMY4K3HR7G2.0 size=836709 2023-12-03T11:28:28.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.521+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=8VMY4K3HR7G2 tag=3Z2EHILH1RK5 type=write size=1885285 2023-12-03T11:28:28.523 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.522+0000 7fe67fa49780 1 < completed write operation key=006X4CSXV0KA tag=6IQIHUXAEOVG type=write size=71328 2023-12-03T11:28:28.525 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.524+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~P44LMRKZ3AMS.0 size=1048576 2023-12-03T11:28:28.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.525+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~P44LMRKZ3AMS.1 size=352400 2023-12-03T11:28:28.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.525+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=P44LMRKZ3AMS tag=N19UFNPSYJNI type=write size=2449552 2023-12-03T11:28:28.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.526+0000 7fe67fa49780 1 < completed write operation key=DDHGOWEI7WEI tag=0UJNLN40OH34 type=write size=390480 2023-12-03T11:28:28.529 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.528+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=77SRDDWGUV0T type=del size=2746345 2023-12-03T11:28:28.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.530+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~0KJ163AP637Z.0 size=746015 2023-12-03T11:28:28.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.532+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=0KJ163AP637Z tag=PY0Q3ZYJG5LA type=write size=1794591 2023-12-03T11:28:28.535 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.534+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=QZEMS1S5P4M1 type=del size=644441 2023-12-03T11:28:28.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.536+0000 7fe67fa49780 1 < suggested remove operation key=XZHCD4R4EVZR tag=50S0IRN42KPU type=del 2023-12-03T11:28:28.539 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.538+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~J5RQWUDRP13U.0 size=1048576 2023-12-03T11:28:28.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.539+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~J5RQWUDRP13U.1 size=1048576 2023-12-03T11:28:28.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.540+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~J5RQWUDRP13U.2 size=1000155 2023-12-03T11:28:28.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.540+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=J5RQWUDRP13U tag=TULMN5Z7EQN4 type=write size=4145883 2023-12-03T11:28:28.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.541+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=XJAUR8ENN716 type=del 2023-12-03T11:28:28.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.542+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=UJNG3JK3XH5F type=del size=3926749 2023-12-03T11:28:28.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.543+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~S2CBF4HTC164.0 size=185738 2023-12-03T11:28:28.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.545+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=S2CBF4HTC164 tag=YHQW0PY0XK25 type=write size=1234314 2023-12-03T11:28:28.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.547+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~P27EZ88VFOGT.0 size=1048576 2023-12-03T11:28:28.549 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.548+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~P27EZ88VFOGT.1 size=1048576 2023-12-03T11:28:28.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.549+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~P27EZ88VFOGT.2 size=163292 2023-12-03T11:28:28.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.549+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=P27EZ88VFOGT tag=4ZEEPO5RYBH9 type=write size=3309020 2023-12-03T11:28:28.551 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.550+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~GVOQZWIFWKL8.0 size=705267 2023-12-03T11:28:28.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.552+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=GVOQZWIFWKL8 tag=IS22U72TWZ21 type=write size=1753843 2023-12-03T11:28:28.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.553+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=5MZDXXDIZYDD type=write size=1022371 2023-12-03T11:28:28.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.554+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=O80R6SOVQFKX type=del 2023-12-03T11:28:28.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.556+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~HGQAW06JCMAL.0 size=1048576 2023-12-03T11:28:28.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.557+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~HGQAW06JCMAL.1 size=98300 2023-12-03T11:28:28.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.557+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=HGQAW06JCMAL tag=KEYIBRHT2HYT type=write size=2195452 2023-12-03T11:28:28.560 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.559+0000 7fe67fa49780 1 < suggested remove operation key=V9ZVWHO8IF8L tag=KXNQK0ZEEHXP type=del 2023-12-03T11:28:28.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.561+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~MSVX2JHCQVM5.0 size=1048576 2023-12-03T11:28:28.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.562+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~MSVX2JHCQVM5.1 size=312365 2023-12-03T11:28:28.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.562+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=MSVX2JHCQVM5 tag=COLWYPGMD02J type=write size=2409517 2023-12-03T11:28:28.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.563+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=CM44KSIMQ4SV type=del 2023-12-03T11:28:28.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.565+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~3ZAVG3VDP0G9.0 size=1048576 2023-12-03T11:28:28.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.566+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~3ZAVG3VDP0G9.1 size=1048576 2023-12-03T11:28:28.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.566+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~3ZAVG3VDP0G9.2 size=265176 2023-12-03T11:28:28.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.567+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=3ZAVG3VDP0G9 tag=UI39YQWFU3B3 type=write size=3410904 2023-12-03T11:28:28.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.568+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~45WKMBH7V3MW.0 size=1048576 2023-12-03T11:28:28.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.568+0000 7fe67fa49780 1 < canceled part key=_multipart_OH2XUEEYL9JO.2~45WKMBH7V3MW.1 size=1048576 2023-12-03T11:28:28.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.569+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~45WKMBH7V3MW.2 size=662855 2023-12-03T11:28:28.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.570+0000 7fe67fa49780 1 < canceled multipart upload key=OH2XUEEYL9JO upload=45WKMBH7V3MW tag=XVLQCTPLCQCV type=write size=3808583 2023-12-03T11:28:28.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.572+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=NLS77THZ3LZZ type=del size=4064991 2023-12-03T11:28:28.574 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.573+0000 7fe67fa49780 1 < canceled operation key=OH2XUEEYL9JO tag=OKMDQG3XAMJ5 type=del size=1808101 2023-12-03T11:28:28.576 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.575+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~C5RIJG8J0Z0M.0 size=784580 2023-12-03T11:28:28.576 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.575+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=C5RIJG8J0Z0M tag=KO07B1FB8Z93 type=write size=1833156 2023-12-03T11:28:28.578 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.577+0000 7fe67fa49780 1 < suggested remove operation key=6LQ18VAE3ZN6 tag=UTGTV713N3NT type=del 2023-12-03T11:28:28.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.578+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=LIOEM3I286L7 type=del size=694616 2023-12-03T11:28:28.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.579+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=ZTB6WTJITUMG type=del 2023-12-03T11:28:28.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.581+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=DMMKJK3OB3IW type=del size=2425923 2023-12-03T11:28:28.583 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.582+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=83L81GYSZOL4 type=del 2023-12-03T11:28:28.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.583+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=3UNR9C9QAUJ8 type=del size=2445448 2023-12-03T11:28:28.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.583+0000 7fe67fa49780 1 < canceled part key=_multipart_KMC5YD2M3I45.2~8VMY4K3HR7G2.0 size=836709 2023-12-03T11:28:28.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.585+0000 7fe67fa49780 1 < canceled multipart upload key=KMC5YD2M3I45 upload=8VMY4K3HR7G2 tag=3Z2EHILH1RK5 type=write size=1885285 2023-12-03T11:28:28.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.587+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~Z98DDQB875KS.0 size=1048576 2023-12-03T11:28:28.589 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.588+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~Z98DDQB875KS.1 size=1048576 2023-12-03T11:28:28.590 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.589+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~Z98DDQB875KS.2 size=179469 2023-12-03T11:28:28.590 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.589+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=Z98DDQB875KS tag=XCXA2T258TND type=write size=3325197 2023-12-03T11:28:28.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.590+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~P44LMRKZ3AMS.0 size=1048576 2023-12-03T11:28:28.592 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.591+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~P44LMRKZ3AMS.1 size=352400 2023-12-03T11:28:28.594 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.593+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=P44LMRKZ3AMS tag=N19UFNPSYJNI type=write size=2449552 2023-12-03T11:28:28.595 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.594+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=OB6EJH900875 type=del size=1387776 2023-12-03T11:28:28.596 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.595+0000 7fe67fa49780 1 < canceled operation key=IIW1Y6QYEODQ tag=77SRDDWGUV0T type=del size=2746345 2023-12-03T11:28:28.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.596+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=7XIH0VO0JQUL type=del size=3749482 2023-12-03T11:28:28.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.598+0000 7fe67fa49780 1 < suggested remove operation key=YEMPVKMDANPG tag=QZEMS1S5P4M1 type=del 2023-12-03T11:28:28.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.601+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~FOR8F0JNLT4M.0 size=1048576 2023-12-03T11:28:28.603 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.601+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~FOR8F0JNLT4M.1 size=487636 2023-12-03T11:28:28.603 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.601+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=FOR8F0JNLT4M tag=8WPV7TMQYRRR type=write size=2584788 2023-12-03T11:28:28.604 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.603+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~J5RQWUDRP13U.0 size=1048576 2023-12-03T11:28:28.604 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.604+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~J5RQWUDRP13U.1 size=1048576 2023-12-03T11:28:28.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.604+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~J5RQWUDRP13U.2 size=1000155 2023-12-03T11:28:28.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.607+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=J5RQWUDRP13U tag=TULMN5Z7EQN4 type=write size=4145883 2023-12-03T11:28:28.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.608+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=DCNN5G0AL0GF type=del size=1854882 2023-12-03T11:28:28.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.611+0000 7fe67fa49780 1 < suggested update operation key=9OD4G28SDLB4 tag=UJNG3JK3XH5F type=del size=3926749 2023-12-03T11:28:28.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.612+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=CZENYZF7O3N8 type=del size=815879 2023-12-03T11:28:28.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.613+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~P27EZ88VFOGT.0 size=1048576 2023-12-03T11:28:28.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.614+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~P27EZ88VFOGT.1 size=1048576 2023-12-03T11:28:28.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.615+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~P27EZ88VFOGT.2 size=163292 2023-12-03T11:28:28.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.617+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=P27EZ88VFOGT tag=4ZEEPO5RYBH9 type=write size=3309020 2023-12-03T11:28:28.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.618+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=HDSD80QO0GB5 type=del size=1381998 2023-12-03T11:28:28.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.620+0000 7fe67fa49780 1 < completed write operation key=SXVBDBJ5B09V tag=5MZDXXDIZYDD type=write size=1022371 2023-12-03T11:28:28.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.622+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~LGS62CNYRDCL.0 size=281113 2023-12-03T11:28:28.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.622+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=LGS62CNYRDCL tag=240OJTKIWMJS type=write size=1329689 2023-12-03T11:28:28.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.623+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~HGQAW06JCMAL.0 size=1048576 2023-12-03T11:28:28.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.624+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~HGQAW06JCMAL.1 size=98300 2023-12-03T11:28:28.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.626+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=HGQAW06JCMAL tag=KEYIBRHT2HYT type=write size=2195452 2023-12-03T11:28:28.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.627+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=BVU8H1EN2Y7X type=del size=3631350 2023-12-03T11:28:28.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.628+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~MSVX2JHCQVM5.0 size=1048576 2023-12-03T11:28:28.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.629+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~MSVX2JHCQVM5.1 size=312365 2023-12-03T11:28:28.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.631+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=MSVX2JHCQVM5 tag=COLWYPGMD02J type=write size=2409517 2023-12-03T11:28:28.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.632+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=MPP0T3AV13LH type=write size=206370 2023-12-03T11:28:28.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.633+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~3ZAVG3VDP0G9.0 size=1048576 2023-12-03T11:28:28.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.634+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~3ZAVG3VDP0G9.1 size=1048576 2023-12-03T11:28:28.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.635+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~3ZAVG3VDP0G9.2 size=265176 2023-12-03T11:28:28.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.637+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=3ZAVG3VDP0G9 tag=UI39YQWFU3B3 type=write size=3410904 2023-12-03T11:28:28.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.638+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=MG5MY0188I2P type=del size=924057 2023-12-03T11:28:28.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.640+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=NLS77THZ3LZZ type=del 2023-12-03T11:28:28.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.641+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=CQGE9YS1WZPC type=del size=782952 2023-12-03T11:28:28.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.642+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~C5RIJG8J0Z0M.0 size=784580 2023-12-03T11:28:28.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.644+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=C5RIJG8J0Z0M tag=KO07B1FB8Z93 type=write size=1833156 2023-12-03T11:28:28.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.645+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=U600TW31D3EM type=del size=237666 2023-12-03T11:28:28.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.646+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=LIOEM3I286L7 type=del 2023-12-03T11:28:28.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.648+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~9HOAD5NUQWN6.0 size=972567 2023-12-03T11:28:28.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.648+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=9HOAD5NUQWN6 tag=WWKIC6X8H09X type=write size=2021143 2023-12-03T11:28:28.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.650+0000 7fe67fa49780 1 < suggested update operation key=TXVHRE03Z3DA tag=DMMKJK3OB3IW type=del size=2425923 2023-12-03T11:28:28.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.652+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=LUXGKUBX7AGC type=write size=191112 2023-12-03T11:28:28.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.653+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=3UNR9C9QAUJ8 type=del 2023-12-03T11:28:28.656 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.655+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~1GTL7W2329Q5.0 size=1048576 2023-12-03T11:28:28.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.656+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~1GTL7W2329Q5.1 size=546225 2023-12-03T11:28:28.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.656+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=1GTL7W2329Q5 tag=2515Z80VIL7D type=write size=2643377 2023-12-03T11:28:28.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.657+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~Z98DDQB875KS.0 size=1048576 2023-12-03T11:28:28.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.658+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~Z98DDQB875KS.1 size=1048576 2023-12-03T11:28:28.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.659+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~Z98DDQB875KS.2 size=179469 2023-12-03T11:28:28.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.661+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=Z98DDQB875KS tag=XCXA2T258TND type=write size=3325197 2023-12-03T11:28:28.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.664+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~9VKMM9IX5MJO.0 size=748277 2023-12-03T11:28:28.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.664+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=9VKMM9IX5MJO tag=9MHGQQ4U74M0 type=write size=1796853 2023-12-03T11:28:28.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.666+0000 7fe67fa49780 1 < suggested update operation key=Q6GBIBMIJRKV tag=OB6EJH900875 type=del size=1387776 2023-12-03T11:28:28.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.667+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=9QK5RWAVLAHL type=write size=623127 2023-12-03T11:28:28.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.668+0000 7fe67fa49780 -1 < failed to complete operation key=Q6GBIBMIJRKV tag=7XIH0VO0JQUL type=del size=3749482: (22) Invalid argument 2023-12-03T11:28:28.672 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.671+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~61MNQFZH45YX.0 size=1048576 2023-12-03T11:28:28.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.672+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~61MNQFZH45YX.1 size=329997 2023-12-03T11:28:28.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.672+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=61MNQFZH45YX tag=R8O1PLCVZ0QP type=write size=2427149 2023-12-03T11:28:28.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.673+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~FOR8F0JNLT4M.0 size=1048576 2023-12-03T11:28:28.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.674+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~FOR8F0JNLT4M.1 size=487636 2023-12-03T11:28:28.677 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.676+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=FOR8F0JNLT4M tag=8WPV7TMQYRRR type=write size=2584788 2023-12-03T11:28:28.679 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.678+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~JFA5NZB495QL.0 size=1048576 2023-12-03T11:28:28.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.679+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~JFA5NZB495QL.1 size=1048576 2023-12-03T11:28:28.681 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.680+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~JFA5NZB495QL.2 size=219429 2023-12-03T11:28:28.681 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.680+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=JFA5NZB495QL tag=MOXPGDUF8Q37 type=write size=3365157 2023-12-03T11:28:28.683 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.682+0000 7fe67fa49780 1 < suggested update operation key=2GX6IWVZH25N tag=DCNN5G0AL0GF type=del size=1854882 2023-12-03T11:28:28.685 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.685+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~BESJNYCTX7HT.0 size=1048576 2023-12-03T11:28:28.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.686+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~BESJNYCTX7HT.1 size=191310 2023-12-03T11:28:28.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.686+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=BESJNYCTX7HT tag=4G4W4JGD1IU9 type=write size=2288462 2023-12-03T11:28:28.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.688+0000 7fe67fa49780 1 < suggested update operation key=6LQ18VAE3ZN6 tag=CZENYZF7O3N8 type=del size=815879 2023-12-03T11:28:28.691 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.690+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~Z13CBK9IQS3M.0 size=1048576 2023-12-03T11:28:28.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.691+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~Z13CBK9IQS3M.1 size=1048576 2023-12-03T11:28:28.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.692+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~Z13CBK9IQS3M.2 size=6823 2023-12-03T11:28:28.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.692+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=Z13CBK9IQS3M tag=CTMWF6O0MHTY type=write size=3152551 2023-12-03T11:28:28.694 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.693+0000 7fe67fa49780 -1 < failed to complete operation key=6LQ18VAE3ZN6 tag=HDSD80QO0GB5 type=del size=1381998: (22) Invalid argument 2023-12-03T11:28:28.696 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.695+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~JSPVAGSQM2NN.0 size=1048576 2023-12-03T11:28:28.697 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.696+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~JSPVAGSQM2NN.1 size=763197 2023-12-03T11:28:28.697 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.696+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=JSPVAGSQM2NN tag=9JJI9NNQQ6VK type=write size=2860349 2023-12-03T11:28:28.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.697+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~LGS62CNYRDCL.0 size=281113 2023-12-03T11:28:28.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.699+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=LGS62CNYRDCL tag=240OJTKIWMJS type=write size=1329689 2023-12-03T11:28:28.702 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.701+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~M8GDJ08T7QPL.0 size=1048576 2023-12-03T11:28:28.703 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.702+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~M8GDJ08T7QPL.1 size=869265 2023-12-03T11:28:28.703 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.702+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=M8GDJ08T7QPL tag=MD5Q0LHH6ZTV type=write size=2966417 2023-12-03T11:28:28.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.704+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=BVU8H1EN2Y7X type=del 2023-12-03T11:28:28.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.706+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~WX1E3JRCD5AP.0 size=977196 2023-12-03T11:28:28.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.706+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=WX1E3JRCD5AP tag=CY1WTIZHAN57 type=write size=2025772 2023-12-03T11:28:28.708 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.707+0000 7fe67fa49780 1 < completed write operation key=H8MBLWXG7BCZ tag=MPP0T3AV13LH type=write size=206370 2023-12-03T11:28:28.710 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.709+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~N2PZLJ0WPOBY.0 size=26159 2023-12-03T11:28:28.710 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.709+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=N2PZLJ0WPOBY tag=8A8R1Y8Z6YWI type=write size=1074735 2023-12-03T11:28:28.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.711+0000 7fe67fa49780 1 < suggested update operation key=Y0VRZR6S8FP6 tag=MG5MY0188I2P type=del size=924057 2023-12-03T11:28:28.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.712+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=2ERSVIEM1GTI type=del size=1651925 2023-12-03T11:28:28.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.714+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=CQGE9YS1WZPC type=del 2023-12-03T11:28:28.717 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.716+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=4RCGBYGVA06X type=del size=349853 2023-12-03T11:28:28.719 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.718+0000 7fe67fa49780 1 < suggested update operation key=983BDZLASC3S tag=U600TW31D3EM type=del size=237666 2023-12-03T11:28:28.720 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.719+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=0T8RM1HS0H2J type=del size=3010252 2023-12-03T11:28:28.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.721+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~9HOAD5NUQWN6.0 size=972567 2023-12-03T11:28:28.725 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.722+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=9HOAD5NUQWN6 tag=WWKIC6X8H09X type=write size=2021143 2023-12-03T11:28:28.725 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.724+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=ZIPVX15I1SEH type=del size=3914437 2023-12-03T11:28:28.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.725+0000 7fe67fa49780 1 < completed write operation key=XZHCD4R4EVZR tag=LUXGKUBX7AGC type=write size=191112 2023-12-03T11:28:28.728 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.727+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~77EYSLX6VKZB.0 size=1048576 2023-12-03T11:28:28.729 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.728+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~77EYSLX6VKZB.1 size=471343 2023-12-03T11:28:28.729 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.728+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=77EYSLX6VKZB tag=3EYHNKVG02E8 type=write size=2568495 2023-12-03T11:28:28.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.729+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~1GTL7W2329Q5.0 size=1048576 2023-12-03T11:28:28.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.730+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~1GTL7W2329Q5.1 size=546225 2023-12-03T11:28:28.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.732+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=1GTL7W2329Q5 tag=2515Z80VIL7D type=write size=2643377 2023-12-03T11:28:28.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.733+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=IT5Y4SGZTE65 type=del size=873997 2023-12-03T11:28:28.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.734+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~9VKMM9IX5MJO.0 size=748277 2023-12-03T11:28:28.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.736+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=9VKMM9IX5MJO tag=9MHGQQ4U74M0 type=write size=1796853 2023-12-03T11:28:28.739 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.738+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~VPJO1AYCBMYL.0 size=15826 2023-12-03T11:28:28.739 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.738+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=VPJO1AYCBMYL tag=858DCD0IHHYB type=write size=1064402 2023-12-03T11:28:28.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.739+0000 7fe67fa49780 1 < completed write operation key=A7GOX2W0WB83 tag=9QK5RWAVLAHL type=write size=623127 2023-12-03T11:28:28.742 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.741+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~WOEGDHFZ0S4I.0 size=1048576 2023-12-03T11:28:28.743 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.742+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~WOEGDHFZ0S4I.1 size=157036 2023-12-03T11:28:28.743 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.742+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=WOEGDHFZ0S4I tag=LBDJ9GXEGGGQ type=write size=2254188 2023-12-03T11:28:28.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.743+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~61MNQFZH45YX.0 size=1048576 2023-12-03T11:28:28.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.744+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~61MNQFZH45YX.1 size=329997 2023-12-03T11:28:28.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.746+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=61MNQFZH45YX tag=R8O1PLCVZ0QP type=write size=2427149 2023-12-03T11:28:28.748 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.747+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=87Y4XM5NDR5U type=del size=1767511 2023-12-03T11:28:28.749 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.749+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~JFA5NZB495QL.0 size=1048576 2023-12-03T11:28:28.751 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.750+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~JFA5NZB495QL.1 size=1048576 2023-12-03T11:28:28.751 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.750+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~JFA5NZB495QL.2 size=219429 2023-12-03T11:28:28.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.752+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=JFA5NZB495QL tag=MOXPGDUF8Q37 type=write size=3365157 2023-12-03T11:28:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.754+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=O58C2EADPS5L type=write size=76137 2023-12-03T11:28:28.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.755+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~BESJNYCTX7HT.0 size=1048576 2023-12-03T11:28:28.757 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.756+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~BESJNYCTX7HT.1 size=191310 2023-12-03T11:28:28.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.758+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=BESJNYCTX7HT tag=4G4W4JGD1IU9 type=write size=2288462 2023-12-03T11:28:28.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.759+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=F6IN6NUWYYZD type=write size=78072 2023-12-03T11:28:28.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.760+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~Z13CBK9IQS3M.0 size=1048576 2023-12-03T11:28:28.762 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.761+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~Z13CBK9IQS3M.1 size=1048576 2023-12-03T11:28:28.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.762+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~Z13CBK9IQS3M.2 size=6823 2023-12-03T11:28:28.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.764+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=Z13CBK9IQS3M tag=CTMWF6O0MHTY type=write size=3152551 2023-12-03T11:28:28.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.766+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~B7LJ53GX0FTB.0 size=1048576 2023-12-03T11:28:28.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.767+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~B7LJ53GX0FTB.1 size=1048576 2023-12-03T11:28:28.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.768+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~B7LJ53GX0FTB.2 size=18880 2023-12-03T11:28:28.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.768+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=B7LJ53GX0FTB tag=M3TTFB3P33IJ type=write size=3164608 2023-12-03T11:28:28.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.769+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~JSPVAGSQM2NN.0 size=1048576 2023-12-03T11:28:28.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.770+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~JSPVAGSQM2NN.1 size=763197 2023-12-03T11:28:28.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.772+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=JSPVAGSQM2NN tag=9JJI9NNQQ6VK type=write size=2860349 2023-12-03T11:28:28.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.773+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=0F0VD2DD6R3H type=del size=143603 2023-12-03T11:28:28.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.774+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~M8GDJ08T7QPL.0 size=1048576 2023-12-03T11:28:28.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.775+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~M8GDJ08T7QPL.1 size=869265 2023-12-03T11:28:28.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.777+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=M8GDJ08T7QPL tag=MD5Q0LHH6ZTV type=write size=2966417 2023-12-03T11:28:28.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.778+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=CUCGOUUM3URH type=del size=1919427 2023-12-03T11:28:28.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.780+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~WX1E3JRCD5AP.0 size=977196 2023-12-03T11:28:28.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.782+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=WX1E3JRCD5AP tag=CY1WTIZHAN57 type=write size=2025772 2023-12-03T11:28:28.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.784+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~E6Q8S04SBQYI.0 size=1048576 2023-12-03T11:28:28.786 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.785+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~E6Q8S04SBQYI.1 size=981588 2023-12-03T11:28:28.786 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.785+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=E6Q8S04SBQYI tag=JPJS3HJSH5QG type=write size=3078740 2023-12-03T11:28:28.787 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.786+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~N2PZLJ0WPOBY.0 size=26159 2023-12-03T11:28:28.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.788+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=N2PZLJ0WPOBY tag=8A8R1Y8Z6YWI type=write size=1074735 2023-12-03T11:28:28.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.789+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=UVSQUGKHGY58 type=del size=1352096 2023-12-03T11:28:28.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.790+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=2ERSVIEM1GTI type=del 2023-12-03T11:28:28.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.791+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=FIQVF55HGS3P type=write size=696046 2023-12-03T11:28:28.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.792+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=4RCGBYGVA06X type=del 2023-12-03T11:28:28.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.794+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=7QW5AE0KRT9Q type=del size=3867130 2023-12-03T11:28:28.796 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.795+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=0T8RM1HS0H2J type=del 2023-12-03T11:28:28.797 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.796+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=D7TLGX4UFPH2 type=del size=213013 2023-12-03T11:28:28.798 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.797+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=ZIPVX15I1SEH type=del 2023-12-03T11:28:28.800 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.799+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=NL2KFK7LK47A type=del size=3384042 2023-12-03T11:28:28.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.800+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~77EYSLX6VKZB.0 size=1048576 2023-12-03T11:28:28.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.801+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~77EYSLX6VKZB.1 size=471343 2023-12-03T11:28:28.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.803+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=77EYSLX6VKZB tag=3EYHNKVG02E8 type=write size=2568495 2023-12-03T11:28:28.805 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.804+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=XT7VPCMY0GL1 type=del size=2581407 2023-12-03T11:28:28.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.805+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=IT5Y4SGZTE65 type=del 2023-12-03T11:28:28.807 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.806+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=O7XMSBMRDKQI type=del size=3223242 2023-12-03T11:28:28.808 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.808+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~VPJO1AYCBMYL.0 size=15826 2023-12-03T11:28:28.810 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.809+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=VPJO1AYCBMYL tag=858DCD0IHHYB type=write size=1064402 2023-12-03T11:28:28.811 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.811+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=9JPTSWKM6Q27 type=del size=3845749 2023-12-03T11:28:28.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.812+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~WOEGDHFZ0S4I.0 size=1048576 2023-12-03T11:28:28.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.813+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~WOEGDHFZ0S4I.1 size=157036 2023-12-03T11:28:28.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.815+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=WOEGDHFZ0S4I tag=LBDJ9GXEGGGQ type=write size=2254188 2023-12-03T11:28:28.817 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.816+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=RRNUP1MOC045 type=del size=1430166 2023-12-03T11:28:28.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.817+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=87Y4XM5NDR5U type=del 2023-12-03T11:28:28.820 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.819+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~A4E3KCYDVXTG.0 size=1048576 2023-12-03T11:28:28.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.820+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~A4E3KCYDVXTG.1 size=725414 2023-12-03T11:28:28.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.820+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=A4E3KCYDVXTG tag=C5OOT2M9GN1H type=write size=2822566 2023-12-03T11:28:28.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.823+0000 7fe67fa49780 1 < suggested remove operation key=9OD4G28SDLB4 tag=O58C2EADPS5L type=write 2023-12-03T11:28:28.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.825+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~5Q8P5E0L41NN.0 size=1048576 2023-12-03T11:28:28.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.826+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~5Q8P5E0L41NN.1 size=551390 2023-12-03T11:28:28.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.826+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=5Q8P5E0L41NN tag=NWM26CWWNR2I type=write size=2648542 2023-12-03T11:28:28.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.828+0000 7fe67fa49780 1 < suggested remove operation key=SXVBDBJ5B09V tag=F6IN6NUWYYZD type=write 2023-12-03T11:28:28.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.829+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=UOU5QY2N1ECB type=del size=1700754 2023-12-03T11:28:28.831 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.830+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~B7LJ53GX0FTB.0 size=1048576 2023-12-03T11:28:28.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.831+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~B7LJ53GX0FTB.1 size=1048576 2023-12-03T11:28:28.833 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.832+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~B7LJ53GX0FTB.2 size=18880 2023-12-03T11:28:28.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.834+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=B7LJ53GX0FTB tag=M3TTFB3P33IJ type=write size=3164608 2023-12-03T11:28:28.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.835+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=MM32OJET2836 type=write size=678530 2023-12-03T11:28:28.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.836+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=0F0VD2DD6R3H type=del 2023-12-03T11:28:28.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.837+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=FQ4MOPMO7FHK type=del size=2039233 2023-12-03T11:28:28.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.839+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=CUCGOUUM3URH type=del 2023-12-03T11:28:28.841 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.840+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=J1XRZ1X72WC1 type=del size=1330056 2023-12-03T11:28:28.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.841+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~E6Q8S04SBQYI.0 size=1048576 2023-12-03T11:28:28.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.841+0000 7fe67fa49780 1 < canceled part key=_multipart_8UZJU9PNWIB6.2~E6Q8S04SBQYI.1 size=981588 2023-12-03T11:28:28.844 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.843+0000 7fe67fa49780 1 < canceled multipart upload key=8UZJU9PNWIB6 upload=E6Q8S04SBQYI tag=JPJS3HJSH5QG type=write size=3078740 2023-12-03T11:28:28.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.844+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=LDB847YOTSZO type=del size=1209644 2023-12-03T11:28:28.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.845+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=UVSQUGKHGY58 type=del 2023-12-03T11:28:28.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.847+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~XDT58W5ESJ76.0 size=151347 2023-12-03T11:28:28.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.847+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=XDT58W5ESJ76 tag=FH9JZTAXRSG3 type=write size=1199923 2023-12-03T11:28:28.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.848+0000 7fe67fa49780 1 < completed write operation key=V9ZVWHO8IF8L tag=FIQVF55HGS3P type=write size=696046 2023-12-03T11:28:28.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.850+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=EZOVN3HWLUX7 type=del size=682881 2023-12-03T11:28:28.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.851+0000 7fe67fa49780 1 < canceled operation key=DDHGOWEI7WEI tag=7QW5AE0KRT9Q type=del size=3867130 2023-12-03T11:28:28.853 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.852+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=GCGTD36TRQAK type=del size=1962875 2023-12-03T11:28:28.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.853+0000 7fe67fa49780 1 < canceled operation key=Y0VRZR6S8FP6 tag=D7TLGX4UFPH2 type=del size=213013 2023-12-03T11:28:28.855 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.854+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=0QA9L9SV27CC type=write size=948928 2023-12-03T11:28:28.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.855+0000 7fe67fa49780 1 < canceled operation key=983BDZLASC3S tag=NL2KFK7LK47A type=del size=3384042 2023-12-03T11:28:28.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.857+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~FC1LRSWC9HXR.0 size=1048576 2023-12-03T11:28:28.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.858+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~FC1LRSWC9HXR.1 size=1048576 2023-12-03T11:28:28.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.859+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~FC1LRSWC9HXR.2 size=451531 2023-12-03T11:28:28.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.859+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=FC1LRSWC9HXR tag=EU12LT7OMMW1 type=write size=3597259 2023-12-03T11:28:28.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.860+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=XT7VPCMY0GL1 type=del 2023-12-03T11:28:28.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.861+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=V7GTJUBYV6WC type=del size=1842892 2023-12-03T11:28:28.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.863+0000 7fe67fa49780 1 < suggested remove operation key=YEMPVKMDANPG tag=O7XMSBMRDKQI type=del 2023-12-03T11:28:28.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.865+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~9W51T7C6Q4CL.0 size=1048576 2023-12-03T11:28:28.867 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.866+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~9W51T7C6Q4CL.1 size=1048576 2023-12-03T11:28:28.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.867+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~9W51T7C6Q4CL.2 size=49365 2023-12-03T11:28:28.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.867+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=9W51T7C6Q4CL tag=L8W2GIW8281R type=write size=3195093 2023-12-03T11:28:28.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.868+0000 7fe67fa49780 1 < canceled operation key=983BDZLASC3S tag=9JPTSWKM6Q27 type=del size=3845749 2023-12-03T11:28:28.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.870+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~APDQ53L3QXG5.0 size=1048576 2023-12-03T11:28:28.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.871+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~APDQ53L3QXG5.1 size=1048576 2023-12-03T11:28:28.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.872+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~APDQ53L3QXG5.2 size=1037803 2023-12-03T11:28:28.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.872+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=APDQ53L3QXG5 tag=ULG1WI4XGF1C type=write size=4183531 2023-12-03T11:28:28.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.873+0000 7fe67fa49780 1 < canceled operation key=UL24DVOA31Y7 tag=RRNUP1MOC045 type=del size=1430166 2023-12-03T11:28:28.875 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.875+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=0R1E195OCJIB type=del size=1830741 2023-12-03T11:28:28.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.876+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~A4E3KCYDVXTG.0 size=1048576 2023-12-03T11:28:28.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.877+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~A4E3KCYDVXTG.1 size=725414 2023-12-03T11:28:28.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.879+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=A4E3KCYDVXTG tag=C5OOT2M9GN1H type=write size=2822566 2023-12-03T11:28:28.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.880+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=JQC9EF31DZXZ type=del size=1945177 2023-12-03T11:28:28.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.881+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~5Q8P5E0L41NN.0 size=1048576 2023-12-03T11:28:28.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.882+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~5Q8P5E0L41NN.1 size=551390 2023-12-03T11:28:28.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.884+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=5Q8P5E0L41NN tag=NWM26CWWNR2I type=write size=2648542 2023-12-03T11:28:28.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.885+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=QAURMB07AC2K type=del size=1600885 2023-12-03T11:28:28.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.886+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=UOU5QY2N1ECB type=del 2023-12-03T11:28:28.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.888+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~C6ZTQS5UN3FY.0 size=1048576 2023-12-03T11:28:28.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.889+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~C6ZTQS5UN3FY.1 size=1048576 2023-12-03T11:28:28.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.890+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~C6ZTQS5UN3FY.2 size=164738 2023-12-03T11:28:28.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.890+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=C6ZTQS5UN3FY tag=Z6DHQOKR1YT2 type=write size=3310466 2023-12-03T11:28:28.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.892+0000 7fe67fa49780 1 < completed write operation key=IIW1Y6QYEODQ tag=MM32OJET2836 type=write size=678530 2023-12-03T11:28:28.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.894+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~1IN749C9C8ZV.0 size=717850 2023-12-03T11:28:28.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.894+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=1IN749C9C8ZV tag=A9PNWNB7B5SW type=write size=1766426 2023-12-03T11:28:28.896 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.895+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=FQ4MOPMO7FHK type=del 2023-12-03T11:28:28.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.896+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=73K2KBYQAQPU type=write size=134967 2023-12-03T11:28:28.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.897+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=J1XRZ1X72WC1 type=del 2023-12-03T11:28:28.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.899+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=UAT3T0K2OPCR type=del size=307653 2023-12-03T11:28:28.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.900+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=LDB847YOTSZO type=del 2023-12-03T11:28:28.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.901+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=KP5B30FFYDQ1 type=del size=3128443 2023-12-03T11:28:28.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.902+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~XDT58W5ESJ76.0 size=151347 2023-12-03T11:28:28.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.904+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=XDT58W5ESJ76 tag=FH9JZTAXRSG3 type=write size=1199923 2023-12-03T11:28:28.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.906+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~TTSTZREF7XCM.0 size=1048576 2023-12-03T11:28:28.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.907+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~TTSTZREF7XCM.1 size=1048576 2023-12-03T11:28:28.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.908+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~TTSTZREF7XCM.2 size=482132 2023-12-03T11:28:28.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.908+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=TTSTZREF7XCM tag=84PE0N4E56ZK type=write size=3627860 2023-12-03T11:28:28.911 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.910+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=EZOVN3HWLUX7 type=del 2023-12-03T11:28:28.913 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.912+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~75CP3RUQPBUI.0 size=4383 2023-12-03T11:28:28.913 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.912+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=75CP3RUQPBUI tag=41FQFLAWQOQ2 type=write size=1052959 2023-12-03T11:28:28.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.913+0000 7fe67fa49780 1 < canceled operation key=IIW1Y6QYEODQ tag=GCGTD36TRQAK type=del size=1962875 2023-12-03T11:28:28.915 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.914+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=9GTFTKASRTQ4 type=del size=2735309 2023-12-03T11:28:28.916 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.915+0000 7fe67fa49780 -1 < no bi entry to suggest for operation key=YEMPVKMDANPG tag=0QA9L9SV27CC type=write size=948928: (2) No such file or directory 2023-12-03T11:28:28.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.917+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~9E4OXSQ3JM31.0 size=1048576 2023-12-03T11:28:28.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.918+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~9E4OXSQ3JM31.1 size=1022941 2023-12-03T11:28:28.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.918+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=9E4OXSQ3JM31 tag=JWLQ1HNNWIU4 type=write size=3120093 2023-12-03T11:28:28.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.919+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~FC1LRSWC9HXR.0 size=1048576 2023-12-03T11:28:28.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.919+0000 7fe67fa49780 1 < canceled part key=_multipart_XZHCD4R4EVZR.2~FC1LRSWC9HXR.1 size=1048576 2023-12-03T11:28:28.921 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.920+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~FC1LRSWC9HXR.2 size=451531 2023-12-03T11:28:28.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.922+0000 7fe67fa49780 1 < canceled multipart upload key=XZHCD4R4EVZR upload=FC1LRSWC9HXR tag=EU12LT7OMMW1 type=write size=3597259 2023-12-03T11:28:28.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.925+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~MPYMLZEDH44S.0 size=1048576 2023-12-03T11:28:28.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.926+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~MPYMLZEDH44S.1 size=468574 2023-12-03T11:28:28.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.926+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=MPYMLZEDH44S tag=O4RI1AJ8C895 type=write size=2565726 2023-12-03T11:28:28.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.927+0000 7fe67fa49780 1 < canceled operation key=N87KA638VE01 tag=V7GTJUBYV6WC type=del size=1842892 2023-12-03T11:28:28.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.928+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=D6CTB1AKCT04 type=del size=1191924 2023-12-03T11:28:28.930 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.929+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~9W51T7C6Q4CL.0 size=1048576 2023-12-03T11:28:28.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.930+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~9W51T7C6Q4CL.1 size=1048576 2023-12-03T11:28:28.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.930+0000 7fe67fa49780 1 < canceled part key=_multipart_983BDZLASC3S.2~9W51T7C6Q4CL.2 size=49365 2023-12-03T11:28:28.934 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.933+0000 7fe67fa49780 1 < canceled multipart upload key=983BDZLASC3S upload=9W51T7C6Q4CL tag=L8W2GIW8281R type=write size=3195093 2023-12-03T11:28:28.936 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.935+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=E2EO8IFQJII2 type=del size=3946249 2023-12-03T11:28:28.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.936+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~APDQ53L3QXG5.0 size=1048576 2023-12-03T11:28:28.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.937+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~APDQ53L3QXG5.1 size=1048576 2023-12-03T11:28:28.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.938+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~APDQ53L3QXG5.2 size=1037803 2023-12-03T11:28:28.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.940+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=APDQ53L3QXG5 tag=ULG1WI4XGF1C type=write size=4183531 2023-12-03T11:28:28.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.941+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=2SK7LE4L7BVP type=del size=2709368 2023-12-03T11:28:28.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.942+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=0R1E195OCJIB type=del 2023-12-03T11:28:28.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.945+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~707LA2JCUONN.0 size=1048576 2023-12-03T11:28:28.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.945+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~707LA2JCUONN.1 size=1048576 2023-12-03T11:28:28.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.946+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~707LA2JCUONN.2 size=489588 2023-12-03T11:28:28.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.946+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=707LA2JCUONN tag=ML4P7H8WBFQ6 type=write size=3635316 2023-12-03T11:28:28.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.947+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=JQC9EF31DZXZ type=del 2023-12-03T11:28:28.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.949+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=3LP05CD4TNMT type=del size=1701088 2023-12-03T11:28:28.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.951+0000 7fe67fa49780 1 < suggested update operation key=8UZJU9PNWIB6 tag=QAURMB07AC2K type=del size=1600885 2023-12-03T11:28:28.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.952+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=JQJC2OB29J71 type=del size=3312419 2023-12-03T11:28:28.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.953+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~C6ZTQS5UN3FY.0 size=1048576 2023-12-03T11:28:28.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.954+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~C6ZTQS5UN3FY.1 size=1048576 2023-12-03T11:28:28.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.954+0000 7fe67fa49780 1 < canceled part key=_multipart_CC1X1OP7L6BJ.2~C6ZTQS5UN3FY.2 size=164738 2023-12-03T11:28:28.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.956+0000 7fe67fa49780 1 < canceled multipart upload key=CC1X1OP7L6BJ upload=C6ZTQS5UN3FY tag=Z6DHQOKR1YT2 type=write size=3310466 2023-12-03T11:28:28.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.958+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~SW9K3V47JJXP.0 size=1048576 2023-12-03T11:28:28.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.959+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~SW9K3V47JJXP.1 size=1048576 2023-12-03T11:28:28.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.959+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~SW9K3V47JJXP.2 size=92895 2023-12-03T11:28:28.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.959+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=SW9K3V47JJXP tag=55VX121E6C5M type=write size=3238623 2023-12-03T11:28:28.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.961+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~1IN749C9C8ZV.0 size=717850 2023-12-03T11:28:28.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.962+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=1IN749C9C8ZV tag=A9PNWNB7B5SW type=write size=1766426 2023-12-03T11:28:28.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.964+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~M3MUO0CD5F8H.0 size=511637 2023-12-03T11:28:28.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.964+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=M3MUO0CD5F8H tag=HU9ZUXDXG1UQ type=write size=1560213 2023-12-03T11:28:28.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.966+0000 7fe67fa49780 1 < completed write operation key=SIES92K9QVJV tag=73K2KBYQAQPU type=write size=134967 2023-12-03T11:28:28.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.967+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=J4LXG5ZHY21B type=del size=2638533 2023-12-03T11:28:28.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.969+0000 7fe67fa49780 1 < suggested remove operation key=N87KA638VE01 tag=UAT3T0K2OPCR type=del 2023-12-03T11:28:28.971 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.970+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=H9LL6NK608PR type=del size=3706636 2023-12-03T11:28:28.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.971+0000 7fe67fa49780 -1 < failed to complete operation key=8UZJU9PNWIB6 tag=KP5B30FFYDQ1 type=del size=3128443: (22) Invalid argument 2023-12-03T11:28:28.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.973+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~UD1959DM82ON.0 size=29403 2023-12-03T11:28:28.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.973+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=UD1959DM82ON tag=A1DONRJ1ZE1K type=write size=1077979 2023-12-03T11:28:28.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.974+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~TTSTZREF7XCM.0 size=1048576 2023-12-03T11:28:28.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.974+0000 7fe67fa49780 1 < canceled part key=_multipart_P05UIP1IU4Z7.2~TTSTZREF7XCM.1 size=1048576 2023-12-03T11:28:28.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.975+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~TTSTZREF7XCM.2 size=482132 2023-12-03T11:28:28.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.977+0000 7fe67fa49780 1 < canceled multipart upload key=P05UIP1IU4Z7 upload=TTSTZREF7XCM tag=84PE0N4E56ZK type=write size=3627860 2023-12-03T11:28:28.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.978+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=APUPK4XCOUM5 type=del size=2309601 2023-12-03T11:28:28.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.979+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~75CP3RUQPBUI.0 size=4383 2023-12-03T11:28:28.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.981+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=75CP3RUQPBUI tag=41FQFLAWQOQ2 type=write size=1052959 2023-12-03T11:28:28.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.982+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=YRUFEZMDZECL type=del size=3109456 2023-12-03T11:28:28.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.984+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=9GTFTKASRTQ4 type=del 2023-12-03T11:28:28.986 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.985+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~87H7ECOFQA3D.0 size=1048576 2023-12-03T11:28:28.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.986+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~87H7ECOFQA3D.1 size=977323 2023-12-03T11:28:28.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.986+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=87H7ECOFQA3D tag=0S1AM5MQ40XC type=write size=3074475 2023-12-03T11:28:28.988 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.988+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~9E4OXSQ3JM31.0 size=1048576 2023-12-03T11:28:28.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.989+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~9E4OXSQ3JM31.1 size=1022941 2023-12-03T11:28:28.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.991+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=9E4OXSQ3JM31 tag=JWLQ1HNNWIU4 type=write size=3120093 2023-12-03T11:28:28.994 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.993+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~XZO9SXXDISD2.0 size=1048576 2023-12-03T11:28:28.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.994+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~XZO9SXXDISD2.1 size=587897 2023-12-03T11:28:28.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.994+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=XZO9SXXDISD2 tag=OJ08MDWPRGBD type=write size=2685049 2023-12-03T11:28:28.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.995+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~MPYMLZEDH44S.0 size=1048576 2023-12-03T11:28:28.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.996+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~MPYMLZEDH44S.1 size=468574 2023-12-03T11:28:28.999 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:28.999+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=MPYMLZEDH44S tag=O4RI1AJ8C895 type=write size=2565726 2023-12-03T11:28:29.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.001+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~0E3XKAV6FK1Y.0 size=1048576 2023-12-03T11:28:29.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.002+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~0E3XKAV6FK1Y.1 size=1048576 2023-12-03T11:28:29.004 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.003+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~0E3XKAV6FK1Y.2 size=1032873 2023-12-03T11:28:29.004 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.003+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=0E3XKAV6FK1Y tag=XQF6711YR3OK type=write size=4178601 2023-12-03T11:28:29.005 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.004+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=D6CTB1AKCT04 type=del 2023-12-03T11:28:29.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.005+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=1CDHZNBPA4XP type=del size=3825027 2023-12-03T11:28:29.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.006+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=E2EO8IFQJII2 type=del 2023-12-03T11:28:29.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.008+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~MJQ45GXGT8VB.0 size=1048576 2023-12-03T11:28:29.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.009+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~MJQ45GXGT8VB.1 size=1048576 2023-12-03T11:28:29.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.010+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~MJQ45GXGT8VB.2 size=698745 2023-12-03T11:28:29.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.010+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=MJQ45GXGT8VB tag=05E2SIR7B2Q8 type=write size=3844473 2023-12-03T11:28:29.014 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.013+0000 7fe67fa49780 1 < suggested update operation key=006X4CSXV0KA tag=2SK7LE4L7BVP type=del size=2709368 2023-12-03T11:28:29.015 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.014+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=FNSYDAQKZ3TU type=del size=2836504 2023-12-03T11:28:29.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.015+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~707LA2JCUONN.0 size=1048576 2023-12-03T11:28:29.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.015+0000 7fe67fa49780 1 < canceled part key=_multipart_H8MBLWXG7BCZ.2~707LA2JCUONN.1 size=1048576 2023-12-03T11:28:29.017 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.016+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~707LA2JCUONN.2 size=489588 2023-12-03T11:28:29.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.018+0000 7fe67fa49780 1 < canceled multipart upload key=H8MBLWXG7BCZ upload=707LA2JCUONN tag=ML4P7H8WBFQ6 type=write size=3635316 2023-12-03T11:28:29.020 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.019+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=U8M72XIJTE2A type=del size=3334283 2023-12-03T11:28:29.021 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.021+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=3LP05CD4TNMT type=del 2023-12-03T11:28:29.023 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.022+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=1MWVBVF0FPJ5 type=write size=196311 2023-12-03T11:28:29.025 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.024+0000 7fe67fa49780 1 < suggested update operation key=ASODFGLQ5VNY tag=JQJC2OB29J71 type=del size=3312419 2023-12-03T11:28:29.027 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.026+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~SJV8W0I0Y156.0 size=1048576 2023-12-03T11:28:29.028 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.027+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~SJV8W0I0Y156.1 size=106291 2023-12-03T11:28:29.028 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.027+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=SJV8W0I0Y156 tag=4UR8WLOBKZUK type=write size=2203443 2023-12-03T11:28:29.029 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.029+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~SW9K3V47JJXP.0 size=1048576 2023-12-03T11:28:29.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.029+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~SW9K3V47JJXP.1 size=1048576 2023-12-03T11:28:29.032 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.031+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~SW9K3V47JJXP.2 size=92895 2023-12-03T11:28:29.034 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.033+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=SW9K3V47JJXP tag=55VX121E6C5M type=write size=3238623 2023-12-03T11:28:29.035 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.034+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=XFSSHTAGFKQJ type=del size=1232601 2023-12-03T11:28:29.036 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.035+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~M3MUO0CD5F8H.0 size=511637 2023-12-03T11:28:29.038 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.038+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=M3MUO0CD5F8H tag=HU9ZUXDXG1UQ type=write size=1560213 2023-12-03T11:28:29.040 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.039+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=ZPZF3AXDHB0W type=del size=154690 2023-12-03T11:28:29.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.041+0000 7fe67fa49780 -1 < failed to complete operation key=006X4CSXV0KA tag=J4LXG5ZHY21B type=del size=2638533: (22) Invalid argument 2023-12-03T11:28:29.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.044+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~3A2RTXHCJH98.0 size=1028960 2023-12-03T11:28:29.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.044+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=3A2RTXHCJH98 tag=ZW4AZ92FC85S type=write size=2077536 2023-12-03T11:28:29.047 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.045+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=H9LL6NK608PR type=del 2023-12-03T11:28:29.048 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.047+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~3LS387WVKZZG.0 size=95050 2023-12-03T11:28:29.048 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.047+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=3LS387WVKZZG tag=TM0JP35YXOD1 type=write size=1143626 2023-12-03T11:28:29.049 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.048+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~UD1959DM82ON.0 size=29403 2023-12-03T11:28:29.051 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.050+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=UD1959DM82ON tag=A1DONRJ1ZE1K type=write size=1077979 2023-12-03T11:28:29.052 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.051+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=2L2GDZKM4HW9 type=del size=2662599 2023-12-03T11:28:29.053 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.052+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=APUPK4XCOUM5 type=del 2023-12-03T11:28:29.055 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.054+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~5WYFQTS0HRJX.0 size=60139 2023-12-03T11:28:29.055 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.054+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=5WYFQTS0HRJX tag=HDEB9X192NRL type=write size=1108715 2023-12-03T11:28:29.057 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.056+0000 7fe67fa49780 1 < canceled operation key=0GQZY07Y2PVI tag=YRUFEZMDZECL type=del size=3109456 2023-12-03T11:28:29.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.057+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=6AUW22N6I1CE type=del size=82195 2023-12-03T11:28:29.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.058+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~87H7ECOFQA3D.0 size=1048576 2023-12-03T11:28:29.060 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.059+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~87H7ECOFQA3D.1 size=977323 2023-12-03T11:28:29.061 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.060+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=87H7ECOFQA3D tag=0S1AM5MQ40XC type=write size=3074475 2023-12-03T11:28:29.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.062+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=SSX0EMA1DA9T type=del size=3037853 2023-12-03T11:28:29.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.063+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~XZO9SXXDISD2.0 size=1048576 2023-12-03T11:28:29.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.064+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~XZO9SXXDISD2.1 size=587897 2023-12-03T11:28:29.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.066+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=XZO9SXXDISD2 tag=OJ08MDWPRGBD type=write size=2685049 2023-12-03T11:28:29.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.068+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~DQY9U6ZQM0U8.0 size=802228 2023-12-03T11:28:29.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.068+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=DQY9U6ZQM0U8 tag=C0NROT3KI5R5 type=write size=1850804 2023-12-03T11:28:29.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.069+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~0E3XKAV6FK1Y.0 size=1048576 2023-12-03T11:28:29.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.070+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~0E3XKAV6FK1Y.1 size=1048576 2023-12-03T11:28:29.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.070+0000 7fe67fa49780 1 < canceled part key=_multipart_ASODFGLQ5VNY.2~0E3XKAV6FK1Y.2 size=1032873 2023-12-03T11:28:29.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.072+0000 7fe67fa49780 1 < canceled multipart upload key=ASODFGLQ5VNY upload=0E3XKAV6FK1Y tag=XQF6711YR3OK type=write size=4178601 2023-12-03T11:28:29.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.073+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=CUQJQUHXR63S type=del size=2672982 2023-12-03T11:28:29.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.074+0000 7fe67fa49780 -1 < failed to complete operation key=ASODFGLQ5VNY tag=1CDHZNBPA4XP type=del size=3825027: (22) Invalid argument 2023-12-03T11:28:29.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.075+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=GI050PO2UR0O type=del size=1197336 2023-12-03T11:28:29.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.076+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~MJQ45GXGT8VB.0 size=1048576 2023-12-03T11:28:29.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.077+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~MJQ45GXGT8VB.1 size=1048576 2023-12-03T11:28:29.079 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.078+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~MJQ45GXGT8VB.2 size=698745 2023-12-03T11:28:29.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.080+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=MJQ45GXGT8VB tag=05E2SIR7B2Q8 type=write size=3844473 2023-12-03T11:28:29.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.081+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=LX80XIO4J0MP type=del size=1459369 2023-12-03T11:28:29.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.083+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=FNSYDAQKZ3TU type=del 2023-12-03T11:28:29.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.085+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~8PX0QI6DNZ69.0 size=257920 2023-12-03T11:28:29.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.085+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=8PX0QI6DNZ69 tag=ZMASJCLESDNA type=write size=1306496 2023-12-03T11:28:29.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.086+0000 7fe67fa49780 -1 < failed to complete operation key=ASODFGLQ5VNY tag=U8M72XIJTE2A type=del size=3334283: (22) Invalid argument 2023-12-03T11:28:29.088 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.087+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=V17V3DDM9456 type=write size=522016 2023-12-03T11:28:29.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.088+0000 7fe67fa49780 1 < completed write operation key=SXVBDBJ5B09V tag=1MWVBVF0FPJ5 type=write size=196311 2023-12-03T11:28:29.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.089+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=INCK6AV96RFC type=del size=53964 2023-12-03T11:28:29.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.090+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~SJV8W0I0Y156.0 size=1048576 2023-12-03T11:28:29.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.091+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~SJV8W0I0Y156.1 size=106291 2023-12-03T11:28:29.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.093+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=SJV8W0I0Y156 tag=4UR8WLOBKZUK type=write size=2203443 2023-12-03T11:28:29.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.095+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=H4ICI9WSG982 type=del size=3473744 2023-12-03T11:28:29.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.096+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=XFSSHTAGFKQJ type=del 2023-12-03T11:28:29.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.098+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~TYY1PMSTEAA9.0 size=833311 2023-12-03T11:28:29.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.098+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=TYY1PMSTEAA9 tag=JJWT1T4HJUZO type=write size=1881887 2023-12-03T11:28:29.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.100+0000 7fe67fa49780 1 < suggested update operation key=983BDZLASC3S tag=ZPZF3AXDHB0W type=del size=154690 2023-12-03T11:28:29.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.101+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=6M7UYII0NMKQ type=del size=840872 2023-12-03T11:28:29.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.103+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~3A2RTXHCJH98.0 size=1028960 2023-12-03T11:28:29.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.105+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=3A2RTXHCJH98 tag=ZW4AZ92FC85S type=write size=2077536 2023-12-03T11:28:29.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.106+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=WP0DNLRP62Z0 type=del size=1159052 2023-12-03T11:28:29.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.107+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~3LS387WVKZZG.0 size=95050 2023-12-03T11:28:29.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.109+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=3LS387WVKZZG tag=TM0JP35YXOD1 type=write size=1143626 2023-12-03T11:28:29.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.110+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=MI4YYHRHM38W type=del size=3721024 2023-12-03T11:28:29.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.111+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=2L2GDZKM4HW9 type=del 2023-12-03T11:28:29.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.113+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~D59UCP60MO2R.0 size=935813 2023-12-03T11:28:29.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.113+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=D59UCP60MO2R tag=KI2MK30T71IN type=write size=1984389 2023-12-03T11:28:29.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.114+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~5WYFQTS0HRJX.0 size=60139 2023-12-03T11:28:29.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.116+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=5WYFQTS0HRJX tag=HDEB9X192NRL type=write size=1108715 2023-12-03T11:28:29.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.118+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=0RZXVCDBOYBV type=del size=3567619 2023-12-03T11:28:29.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.119+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=6AUW22N6I1CE type=del 2023-12-03T11:28:29.122 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.121+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~EIMV8IPLZTBS.0 size=874953 2023-12-03T11:28:29.122 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.121+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=EIMV8IPLZTBS tag=0ZE5TMDJG35E type=write size=1923529 2023-12-03T11:28:29.123 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.122+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=SSX0EMA1DA9T type=del 2023-12-03T11:28:29.124 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.123+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=A0ZSX6BV86BO type=del size=488851 2023-12-03T11:28:29.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.124+0000 7fe67fa49780 1 < canceled part key=_multipart_KMC5YD2M3I45.2~DQY9U6ZQM0U8.0 size=802228 2023-12-03T11:28:29.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.126+0000 7fe67fa49780 1 < canceled multipart upload key=KMC5YD2M3I45 upload=DQY9U6ZQM0U8 tag=C0NROT3KI5R5 type=write size=1850804 2023-12-03T11:28:29.129 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.128+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~4GM82C30IKYW.0 size=1048576 2023-12-03T11:28:29.130 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.129+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~4GM82C30IKYW.1 size=689008 2023-12-03T11:28:29.130 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.129+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=4GM82C30IKYW tag=ZPBR3328FHBG type=write size=2786160 2023-12-03T11:28:29.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.130+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=CUQJQUHXR63S type=del 2023-12-03T11:28:29.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.131+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=CA6DWUBDDVJK type=del size=1541382 2023-12-03T11:28:29.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.132+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=GI050PO2UR0O type=del 2023-12-03T11:28:29.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.133+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=8LHPBIO7NLQW type=del size=1374432 2023-12-03T11:28:29.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.134+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=LX80XIO4J0MP type=del 2023-12-03T11:28:29.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.136+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~5YK02HF2DR56.0 size=1048576 2023-12-03T11:28:29.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.137+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~5YK02HF2DR56.1 size=1048576 2023-12-03T11:28:29.139 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.138+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~5YK02HF2DR56.2 size=789220 2023-12-03T11:28:29.139 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.138+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=5YK02HF2DR56 tag=SOYW7AKBJ73Z type=write size=3934948 2023-12-03T11:28:29.140 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.139+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~8PX0QI6DNZ69.0 size=257920 2023-12-03T11:28:29.142 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.141+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=8PX0QI6DNZ69 tag=ZMASJCLESDNA type=write size=1306496 2023-12-03T11:28:29.145 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.144+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~CPKZX3XFAP95.0 size=1048576 2023-12-03T11:28:29.146 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.145+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~CPKZX3XFAP95.1 size=1048576 2023-12-03T11:28:29.147 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.146+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~CPKZX3XFAP95.2 size=191334 2023-12-03T11:28:29.147 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.146+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=CPKZX3XFAP95 tag=MHC6NG43OPS2 type=write size=3337062 2023-12-03T11:28:29.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.147+0000 7fe67fa49780 1 < completed write operation key=H8MBLWXG7BCZ tag=V17V3DDM9456 type=write size=522016 2023-12-03T11:28:29.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.148+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=PGXP52EJML9S type=del size=1518904 2023-12-03T11:28:29.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.150+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=INCK6AV96RFC type=del 2023-12-03T11:28:29.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.151+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=8NSZV7T87NUX type=del size=1021395 2023-12-03T11:28:29.153 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.153+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=H4ICI9WSG982 type=del 2023-12-03T11:28:29.155 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.154+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=CBLJA96VKGHX type=del size=2758834 2023-12-03T11:28:29.156 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.155+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~TYY1PMSTEAA9.0 size=833311 2023-12-03T11:28:29.158 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.157+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=TYY1PMSTEAA9 tag=JJWT1T4HJUZO type=write size=1881887 2023-12-03T11:28:29.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.159+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~HQLCSSOQH1NL.0 size=92564 2023-12-03T11:28:29.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.159+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=HQLCSSOQH1NL tag=LA84XFCYW6IG type=write size=1141140 2023-12-03T11:28:29.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.160+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=6M7UYII0NMKQ type=del 2023-12-03T11:28:29.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.161+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=PWVP048SBSBN type=write size=644263 2023-12-03T11:28:29.163 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.163+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=WP0DNLRP62Z0 type=del 2023-12-03T11:28:29.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.165+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~GFDOLRPZI51X.0 size=1048576 2023-12-03T11:28:29.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.166+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~GFDOLRPZI51X.1 size=668880 2023-12-03T11:28:29.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.166+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=GFDOLRPZI51X tag=9DQ20M5OWUUI type=write size=2766032 2023-12-03T11:28:29.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.168+0000 7fe67fa49780 1 < suggested update operation key=URVD2U16EW75 tag=MI4YYHRHM38W type=del size=3721024 2023-12-03T11:28:29.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.170+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~6E1054YE142D.0 size=559265 2023-12-03T11:28:29.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.170+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=6E1054YE142D tag=E0IGDVM6OLPZ type=write size=1607841 2023-12-03T11:28:29.172 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.171+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~D59UCP60MO2R.0 size=935813 2023-12-03T11:28:29.175 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.174+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=D59UCP60MO2R tag=KI2MK30T71IN type=write size=1984389 2023-12-03T11:28:29.177 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.176+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~F3CXITNNWNY2.0 size=1048576 2023-12-03T11:28:29.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.177+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~F3CXITNNWNY2.1 size=1048576 2023-12-03T11:28:29.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.178+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~F3CXITNNWNY2.2 size=260169 2023-12-03T11:28:29.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.178+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=F3CXITNNWNY2 tag=SRH0N1LTKG9U type=write size=3405897 2023-12-03T11:28:29.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.180+0000 7fe67fa49780 1 < suggested update operation key=H8MBLWXG7BCZ tag=0RZXVCDBOYBV type=del size=3567619 2023-12-03T11:28:29.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.182+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~GD9AA242GF0O.0 size=1048576 2023-12-03T11:28:29.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.183+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~GD9AA242GF0O.1 size=1030492 2023-12-03T11:28:29.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.183+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=GD9AA242GF0O tag=K1ZP3EYJ5B6X type=write size=3127644 2023-12-03T11:28:29.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.184+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~EIMV8IPLZTBS.0 size=874953 2023-12-03T11:28:29.187 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.186+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=EIMV8IPLZTBS tag=0ZE5TMDJG35E type=write size=1923529 2023-12-03T11:28:29.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.187+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=3N2WBX85220F type=del size=1538681 2023-12-03T11:28:29.189 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.188+0000 7fe67fa49780 -1 < failed to complete operation key=H8MBLWXG7BCZ tag=A0ZSX6BV86BO type=del size=488851: (22) Invalid argument 2023-12-03T11:28:29.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.189+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=25H7LTHLKZJI type=del size=327669 2023-12-03T11:28:29.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.190+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~4GM82C30IKYW.0 size=1048576 2023-12-03T11:28:29.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.191+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~4GM82C30IKYW.1 size=689008 2023-12-03T11:28:29.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.193+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=4GM82C30IKYW tag=ZPBR3328FHBG type=write size=2786160 2023-12-03T11:28:29.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.194+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=N1HO6DXB2042 type=del size=872914 2023-12-03T11:28:29.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.195+0000 7fe67fa49780 1 < canceled operation key=0G8KNJBJ9K1Z tag=CA6DWUBDDVJK type=del size=1541382 2023-12-03T11:28:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.197+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~NEAPWICLOJSE.0 size=1048576 2023-12-03T11:28:29.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.198+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~NEAPWICLOJSE.1 size=904208 2023-12-03T11:28:29.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.198+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=NEAPWICLOJSE tag=U1V9KT0VM338 type=write size=3001360 2023-12-03T11:28:29.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.200+0000 7fe67fa49780 1 < suggested remove operation key=ASODFGLQ5VNY tag=8LHPBIO7NLQW type=del 2023-12-03T11:28:29.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.201+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=NMSMPUAMT7PQ type=write size=775117 2023-12-03T11:28:29.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.203+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~5YK02HF2DR56.0 size=1048576 2023-12-03T11:28:29.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.203+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~5YK02HF2DR56.1 size=1048576 2023-12-03T11:28:29.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.204+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~5YK02HF2DR56.2 size=789220 2023-12-03T11:28:29.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.206+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=5YK02HF2DR56 tag=SOYW7AKBJ73Z type=write size=3934948 2023-12-03T11:28:29.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.208+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=3EGDZ0N9VQ36 type=del size=2210542 2023-12-03T11:28:29.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.209+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~CPKZX3XFAP95.0 size=1048576 2023-12-03T11:28:29.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.210+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~CPKZX3XFAP95.1 size=1048576 2023-12-03T11:28:29.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.211+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~CPKZX3XFAP95.2 size=191334 2023-12-03T11:28:29.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.213+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=CPKZX3XFAP95 tag=MHC6NG43OPS2 type=write size=3337062 2023-12-03T11:28:29.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.214+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=I09W9473YTTC type=del size=3134270 2023-12-03T11:28:29.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.215+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=PGXP52EJML9S type=del 2023-12-03T11:28:29.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.217+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~NELHS7C6Z7X8.0 size=968351 2023-12-03T11:28:29.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.217+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=NELHS7C6Z7X8 tag=2APG3ROQWZ1X type=write size=2016927 2023-12-03T11:28:29.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.219+0000 7fe67fa49780 1 < suggested remove operation key=006X4CSXV0KA tag=8NSZV7T87NUX type=del 2023-12-03T11:28:29.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.221+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~BFL9727WCMPU.0 size=1048576 2023-12-03T11:28:29.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.222+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~BFL9727WCMPU.1 size=710045 2023-12-03T11:28:29.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.222+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=BFL9727WCMPU tag=RUVY66N14LUR type=write size=2807197 2023-12-03T11:28:29.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.224+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=CBLJA96VKGHX type=del 2023-12-03T11:28:29.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.225+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=S3EVAZOQHTBA type=del size=3125003 2023-12-03T11:28:29.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.227+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~HQLCSSOQH1NL.0 size=92564 2023-12-03T11:28:29.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.228+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=HQLCSSOQH1NL tag=LA84XFCYW6IG type=write size=1141140 2023-12-03T11:28:29.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.230+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=7P52J67APD8E type=del size=2993236 2023-12-03T11:28:29.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.231+0000 7fe67fa49780 1 < completed write operation key=IIW1Y6QYEODQ tag=PWVP048SBSBN type=write size=644263 2023-12-03T11:28:29.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.232+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=0AU3E0ZWQIWR type=del size=1914157 2023-12-03T11:28:29.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.234+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~GFDOLRPZI51X.0 size=1048576 2023-12-03T11:28:29.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.234+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~GFDOLRPZI51X.1 size=668880 2023-12-03T11:28:29.238 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.237+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=GFDOLRPZI51X tag=9DQ20M5OWUUI type=write size=2766032 2023-12-03T11:28:29.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.239+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~3PW066E4G6AM.0 size=527949 2023-12-03T11:28:29.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.239+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=3PW066E4G6AM tag=EIL2MQMW0ANM type=write size=1576525 2023-12-03T11:28:29.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.240+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~6E1054YE142D.0 size=559265 2023-12-03T11:28:29.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.242+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=6E1054YE142D tag=E0IGDVM6OLPZ type=write size=1607841 2023-12-03T11:28:29.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.243+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=LAPVT5LLROFN type=write size=659954 2023-12-03T11:28:29.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.245+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~F3CXITNNWNY2.0 size=1048576 2023-12-03T11:28:29.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.246+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~F3CXITNNWNY2.1 size=1048576 2023-12-03T11:28:29.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.247+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~F3CXITNNWNY2.2 size=260169 2023-12-03T11:28:29.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.249+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=F3CXITNNWNY2 tag=SRH0N1LTKG9U type=write size=3405897 2023-12-03T11:28:29.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.250+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=BAWHTAFMX88V type=write size=748175 2023-12-03T11:28:29.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.251+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~GD9AA242GF0O.0 size=1048576 2023-12-03T11:28:29.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.252+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~GD9AA242GF0O.1 size=1030492 2023-12-03T11:28:29.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.254+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=GD9AA242GF0O tag=K1ZP3EYJ5B6X type=write size=3127644 2023-12-03T11:28:29.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.256+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~HRSHHC3XGX9Z.0 size=1048576 2023-12-03T11:28:29.258 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.257+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~HRSHHC3XGX9Z.1 size=1048576 2023-12-03T11:28:29.260 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.259+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~HRSHHC3XGX9Z.2 size=890173 2023-12-03T11:28:29.260 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.259+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=HRSHHC3XGX9Z tag=V8LEHQLDTZP5 type=write size=4035901 2023-12-03T11:28:29.261 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.260+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=3N2WBX85220F type=del 2023-12-03T11:28:29.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.262+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~POPO4J0XHCTA.0 size=684694 2023-12-03T11:28:29.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.262+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=POPO4J0XHCTA tag=209BW1E0N55F type=write size=1733270 2023-12-03T11:28:29.264 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.263+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=25H7LTHLKZJI type=del 2023-12-03T11:28:29.266 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.266+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~IW03N33JSVN8.0 size=1048576 2023-12-03T11:28:29.267 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.266+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~IW03N33JSVN8.1 size=986754 2023-12-03T11:28:29.268 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.266+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=IW03N33JSVN8 tag=EOFE0IV3AWE8 type=write size=3083906 2023-12-03T11:28:29.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.268+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=N1HO6DXB2042 type=del 2023-12-03T11:28:29.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.270+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~3RYK493LYIKQ.0 size=472832 2023-12-03T11:28:29.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.270+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=3RYK493LYIKQ tag=LD8J3E6RI1YR type=write size=1521408 2023-12-03T11:28:29.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.271+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~NEAPWICLOJSE.0 size=1048576 2023-12-03T11:28:29.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.272+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~NEAPWICLOJSE.1 size=904208 2023-12-03T11:28:29.275 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.274+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=NEAPWICLOJSE tag=U1V9KT0VM338 type=write size=3001360 2023-12-03T11:28:29.276 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.275+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~LOQP03B1BV7V.0 size=1048576 2023-12-03T11:28:29.277 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.276+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~LOQP03B1BV7V.1 size=142513 2023-12-03T11:28:29.277 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.276+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=LOQP03B1BV7V tag=WTRNFZBTK5S5 type=write size=2239665 2023-12-03T11:28:29.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.277+0000 7fe67fa49780 1 < canceled operation key=YEMPVKMDANPG tag=NMSMPUAMT7PQ type=write size=775117 2023-12-03T11:28:29.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.279+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=4B5FGU17VTCN type=del size=2956517 2023-12-03T11:28:29.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.280+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=3EGDZ0N9VQ36 type=del 2023-12-03T11:28:29.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.281+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=4L6PAXOX0GUV type=del size=4041855 2023-12-03T11:28:29.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.282+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=I09W9473YTTC type=del 2023-12-03T11:28:29.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.283+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=4ZYGC66B902N type=del size=356111 2023-12-03T11:28:29.285 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.284+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~NELHS7C6Z7X8.0 size=968351 2023-12-03T11:28:29.287 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.286+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=NELHS7C6Z7X8 tag=2APG3ROQWZ1X type=write size=2016927 2023-12-03T11:28:29.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.288+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~XRGQM3RW19V6.0 size=1048576 2023-12-03T11:28:29.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.289+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~XRGQM3RW19V6.1 size=1048576 2023-12-03T11:28:29.291 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.290+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~XRGQM3RW19V6.2 size=630427 2023-12-03T11:28:29.291 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.290+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=XRGQM3RW19V6 tag=S5B3NQFWUE0C type=write size=3776155 2023-12-03T11:28:29.292 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.291+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~BFL9727WCMPU.0 size=1048576 2023-12-03T11:28:29.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.292+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~BFL9727WCMPU.1 size=710045 2023-12-03T11:28:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.294+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=BFL9727WCMPU tag=RUVY66N14LUR type=write size=2807197 2023-12-03T11:28:29.297 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.296+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~A4VUF4B05C2P.0 size=1048576 2023-12-03T11:28:29.298 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.297+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~A4VUF4B05C2P.1 size=1048576 2023-12-03T11:28:29.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.298+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~A4VUF4B05C2P.2 size=607573 2023-12-03T11:28:29.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.298+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=A4VUF4B05C2P tag=11O5YW3Z2R20 type=write size=3753301 2023-12-03T11:28:29.300 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.299+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=S3EVAZOQHTBA type=del 2023-12-03T11:28:29.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.300+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=R6QE7YA4KBBI type=del size=1334555 2023-12-03T11:28:29.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.302+0000 7fe67fa49780 1 < suggested remove operation key=CIB1NZHJGO46 tag=7P52J67APD8E type=del 2023-12-03T11:28:29.305 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.304+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~D7TSGOEIJ22Z.0 size=1048576 2023-12-03T11:28:29.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.305+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~D7TSGOEIJ22Z.1 size=155658 2023-12-03T11:28:29.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.305+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=D7TSGOEIJ22Z tag=8PFFBO9836D9 type=write size=2252810 2023-12-03T11:28:29.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.306+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=0AU3E0ZWQIWR type=del 2023-12-03T11:28:29.308 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.307+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=55KEUZR2E66Y type=del size=131396 2023-12-03T11:28:29.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.309+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~3PW066E4G6AM.0 size=527949 2023-12-03T11:28:29.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.310+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=3PW066E4G6AM tag=EIL2MQMW0ANM type=write size=1576525 2023-12-03T11:28:29.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.312+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=RLV8PLOOGBN4 type=write size=739993 2023-12-03T11:28:29.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.313+0000 7fe67fa49780 1 < completed write operation key=KMC5YD2M3I45 tag=LAPVT5LLROFN type=write size=659954 2023-12-03T11:28:29.315 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.314+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=A1E3AMFBWLLR type=del size=1800905 2023-12-03T11:28:29.316 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.315+0000 7fe67fa49780 1 < completed write operation key=6LQ18VAE3ZN6 tag=BAWHTAFMX88V type=write size=748175 2023-12-03T11:28:29.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.316+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=MGT9QZUIYJUV type=del size=2361875 2023-12-03T11:28:29.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.318+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~HRSHHC3XGX9Z.0 size=1048576 2023-12-03T11:28:29.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.319+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~HRSHHC3XGX9Z.1 size=1048576 2023-12-03T11:28:29.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.320+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~HRSHHC3XGX9Z.2 size=890173 2023-12-03T11:28:29.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.322+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=HRSHHC3XGX9Z tag=V8LEHQLDTZP5 type=write size=4035901 2023-12-03T11:28:29.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.323+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=JNMYBS613YID type=write size=651865 2023-12-03T11:28:29.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.324+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~POPO4J0XHCTA.0 size=684694 2023-12-03T11:28:29.327 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.326+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=POPO4J0XHCTA tag=209BW1E0N55F type=write size=1733270 2023-12-03T11:28:29.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.328+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~4NF65DM44OAG.0 size=1048576 2023-12-03T11:28:29.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.329+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~4NF65DM44OAG.1 size=1048576 2023-12-03T11:28:29.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.330+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~4NF65DM44OAG.2 size=232226 2023-12-03T11:28:29.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.330+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=4NF65DM44OAG tag=D5T2WIMX2Q20 type=write size=3377954 2023-12-03T11:28:29.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.331+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~IW03N33JSVN8.0 size=1048576 2023-12-03T11:28:29.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.331+0000 7fe67fa49780 1 < canceled part key=_multipart_CC1X1OP7L6BJ.2~IW03N33JSVN8.1 size=986754 2023-12-03T11:28:29.334 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.334+0000 7fe67fa49780 1 < canceled multipart upload key=CC1X1OP7L6BJ upload=IW03N33JSVN8 tag=EOFE0IV3AWE8 type=write size=3083906 2023-12-03T11:28:29.336 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.335+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=MG2SKNI8OU10 type=del size=3063094 2023-12-03T11:28:29.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.336+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~3RYK493LYIKQ.0 size=472832 2023-12-03T11:28:29.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.338+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=3RYK493LYIKQ tag=LD8J3E6RI1YR type=write size=1521408 2023-12-03T11:28:29.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.340+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~DQSVA42S3469.0 size=652726 2023-12-03T11:28:29.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.340+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=DQSVA42S3469 tag=XDZXCKLCGOAC type=write size=1701302 2023-12-03T11:28:29.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.342+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~LOQP03B1BV7V.0 size=1048576 2023-12-03T11:28:29.344 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.343+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~LOQP03B1BV7V.1 size=142513 2023-12-03T11:28:29.346 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.345+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=LOQP03B1BV7V tag=WTRNFZBTK5S5 type=write size=2239665 2023-12-03T11:28:29.347 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.346+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=BG62CMYWDB0J type=del size=3160843 2023-12-03T11:28:29.348 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.347+0000 7fe67fa49780 1 < canceled operation key=983BDZLASC3S tag=4B5FGU17VTCN type=del size=2956517 2023-12-03T11:28:29.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.349+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~YKV4NFLX96PI.0 size=1048576 2023-12-03T11:28:29.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.350+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~YKV4NFLX96PI.1 size=829556 2023-12-03T11:28:29.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.350+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=YKV4NFLX96PI tag=EN2Z8EWKNJYJ type=write size=2926708 2023-12-03T11:28:29.353 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.352+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=4L6PAXOX0GUV type=del 2023-12-03T11:28:29.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.353+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=6ZH080JM4ZN7 type=write size=33002 2023-12-03T11:28:29.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.354+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=4ZYGC66B902N type=del 2023-12-03T11:28:29.357 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.356+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=VAXNQ5XGTFFO type=del size=651762 2023-12-03T11:28:29.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.357+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~XRGQM3RW19V6.0 size=1048576 2023-12-03T11:28:29.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.358+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~XRGQM3RW19V6.1 size=1048576 2023-12-03T11:28:29.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.359+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~XRGQM3RW19V6.2 size=630427 2023-12-03T11:28:29.362 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.361+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=XRGQM3RW19V6 tag=S5B3NQFWUE0C type=write size=3776155 2023-12-03T11:28:29.363 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.362+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=1ULDJCSW8HA4 type=del size=863397 2023-12-03T11:28:29.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.363+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~A4VUF4B05C2P.0 size=1048576 2023-12-03T11:28:29.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.364+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~A4VUF4B05C2P.1 size=1048576 2023-12-03T11:28:29.366 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.365+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~A4VUF4B05C2P.2 size=607573 2023-12-03T11:28:29.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.368+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=A4VUF4B05C2P tag=11O5YW3Z2R20 type=write size=3753301 2023-12-03T11:28:29.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.370+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~XWFSEWQARAUL.0 size=517604 2023-12-03T11:28:29.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.370+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=XWFSEWQARAUL tag=8ANRIPOZQZPP type=write size=1566180 2023-12-03T11:28:29.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.371+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=R6QE7YA4KBBI type=del 2023-12-03T11:28:29.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.373+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=5WSGIXZ6QZH3 type=write size=288955 2023-12-03T11:28:29.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.377+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~D7TSGOEIJ22Z.0 size=1048576 2023-12-03T11:28:29.379 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.378+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~D7TSGOEIJ22Z.1 size=155658 2023-12-03T11:28:29.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.380+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=D7TSGOEIJ22Z tag=8PFFBO9836D9 type=write size=2252810 2023-12-03T11:28:29.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.381+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=CTL4LBGH01AB type=del size=554753 2023-12-03T11:28:29.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.382+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=55KEUZR2E66Y type=del 2023-12-03T11:28:29.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.384+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~05QGQX4KVYKT.0 size=1044383 2023-12-03T11:28:29.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.384+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=05QGQX4KVYKT tag=EI9NYWA62L78 type=write size=2092959 2023-12-03T11:28:29.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.385+0000 7fe67fa49780 1 < completed write operation key=URVD2U16EW75 tag=RLV8PLOOGBN4 type=write size=739993 2023-12-03T11:28:29.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.387+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~UXND5SNTYQO7.0 size=125104 2023-12-03T11:28:29.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.387+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=UXND5SNTYQO7 tag=U4PW2I85W334 type=write size=1173680 2023-12-03T11:28:29.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.388+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=A1E3AMFBWLLR type=del 2023-12-03T11:28:29.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.390+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=LJLPCI2LMMLP type=del size=2550158 2023-12-03T11:28:29.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.391+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=MGT9QZUIYJUV type=del 2023-12-03T11:28:29.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.392+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=IOYUN689HOHO type=del size=3926334 2023-12-03T11:28:29.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.393+0000 7fe67fa49780 1 < completed write operation key=URVD2U16EW75 tag=JNMYBS613YID type=write size=651865 2023-12-03T11:28:29.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.394+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=050TH1VLK65O type=del size=1599161 2023-12-03T11:28:29.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.395+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~4NF65DM44OAG.0 size=1048576 2023-12-03T11:28:29.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.396+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~4NF65DM44OAG.1 size=1048576 2023-12-03T11:28:29.398 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.397+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~4NF65DM44OAG.2 size=232226 2023-12-03T11:28:29.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.399+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=4NF65DM44OAG tag=D5T2WIMX2Q20 type=write size=3377954 2023-12-03T11:28:29.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.401+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~DVY5AYANYDES.0 size=1048576 2023-12-03T11:28:29.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.402+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~DVY5AYANYDES.1 size=1048576 2023-12-03T11:28:29.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.403+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~DVY5AYANYDES.2 size=461458 2023-12-03T11:28:29.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.403+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=DVY5AYANYDES tag=C0POVZOMCWPJ type=write size=3607186 2023-12-03T11:28:29.406 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.405+0000 7fe67fa49780 1 < suggested update operation key=6LQ18VAE3ZN6 tag=MG2SKNI8OU10 type=del size=3063094 2023-12-03T11:28:29.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.408+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~1OEJQHQ3M3KJ.0 size=1048576 2023-12-03T11:28:29.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.409+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~1OEJQHQ3M3KJ.1 size=1048576 2023-12-03T11:28:29.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.409+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~1OEJQHQ3M3KJ.2 size=866238 2023-12-03T11:28:29.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.409+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=1OEJQHQ3M3KJ tag=0XCSRHD1GM4V type=write size=4011966 2023-12-03T11:28:29.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.411+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~DQSVA42S3469.0 size=652726 2023-12-03T11:28:29.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.413+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=DQSVA42S3469 tag=XDZXCKLCGOAC type=write size=1701302 2023-12-03T11:28:29.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.414+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=2Z2IIQ2UGZIH type=write size=957244 2023-12-03T11:28:29.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.416+0000 7fe67fa49780 1 < suggested remove operation key=A7GOX2W0WB83 tag=BG62CMYWDB0J type=del 2023-12-03T11:28:29.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.418+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=6E0RUSDXWCKK type=del size=3688553 2023-12-03T11:28:29.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.419+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~YKV4NFLX96PI.0 size=1048576 2023-12-03T11:28:29.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.420+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~YKV4NFLX96PI.1 size=829556 2023-12-03T11:28:29.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.422+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=YKV4NFLX96PI tag=EN2Z8EWKNJYJ type=write size=2926708 2023-12-03T11:28:29.425 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.424+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~X4DVPHWZ793Y.0 size=1048576 2023-12-03T11:28:29.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.425+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~X4DVPHWZ793Y.1 size=1037586 2023-12-03T11:28:29.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.425+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=X4DVPHWZ793Y tag=U12YSUGS8H07 type=write size=3134738 2023-12-03T11:28:29.427 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.426+0000 7fe67fa49780 1 < completed write operation key=8UZJU9PNWIB6 tag=6ZH080JM4ZN7 type=write size=33002 2023-12-03T11:28:29.428 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.428+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=P7HYEAZLNCKQ type=del size=84869 2023-12-03T11:28:29.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.429+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=VAXNQ5XGTFFO type=del 2023-12-03T11:28:29.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.431+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~2KN0MUOF41NC.0 size=1048576 2023-12-03T11:28:29.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.432+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~2KN0MUOF41NC.1 size=1048576 2023-12-03T11:28:29.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.433+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~2KN0MUOF41NC.2 size=658028 2023-12-03T11:28:29.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.433+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=2KN0MUOF41NC tag=HKCM438B9M8T type=write size=3803756 2023-12-03T11:28:29.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.433+0000 7fe67fa49780 -1 < no bi entry to suggest for operation key=A7GOX2W0WB83 tag=1ULDJCSW8HA4 type=del size=863397: (2) No such file or directory 2023-12-03T11:28:29.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.435+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~0KKOFNHIYWM0.0 size=1048576 2023-12-03T11:28:29.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.436+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~0KKOFNHIYWM0.1 size=1048576 2023-12-03T11:28:29.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.437+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~0KKOFNHIYWM0.2 size=542499 2023-12-03T11:28:29.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.437+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=0KKOFNHIYWM0 tag=EV3EO7AFRTKV type=write size=3688227 2023-12-03T11:28:29.439 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.438+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~XWFSEWQARAUL.0 size=517604 2023-12-03T11:28:29.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.440+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=XWFSEWQARAUL tag=8ANRIPOZQZPP type=write size=1566180 2023-12-03T11:28:29.442 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.441+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=PW167P12UKC6 type=del size=534149 2023-12-03T11:28:29.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.444+0000 7fe67fa49780 1 < suggested remove operation key=PFBGR7OF7JQG tag=5WSGIXZ6QZH3 type=write 2023-12-03T11:28:29.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.446+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~2S2F0U8C7T1N.0 size=1048576 2023-12-03T11:28:29.448 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.447+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~2S2F0U8C7T1N.1 size=671037 2023-12-03T11:28:29.448 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.447+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=2S2F0U8C7T1N tag=WMAMCO1H3F0W type=write size=2768189 2023-12-03T11:28:29.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.448+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=CTL4LBGH01AB type=del 2023-12-03T11:28:29.450 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.449+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=U24SXA053V6P type=del size=707041 2023-12-03T11:28:29.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.450+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~05QGQX4KVYKT.0 size=1044383 2023-12-03T11:28:29.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.452+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=05QGQX4KVYKT tag=EI9NYWA62L78 type=write size=2092959 2023-12-03T11:28:29.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.454+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~UWKUQHGMY1YK.0 size=1048576 2023-12-03T11:28:29.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.455+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~UWKUQHGMY1YK.1 size=1039170 2023-12-03T11:28:29.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.455+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=UWKUQHGMY1YK tag=3446ROFUAH1S type=write size=3136322 2023-12-03T11:28:29.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.455+0000 7fe67fa49780 1 < canceled part key=_multipart_PFBGR7OF7JQG.2~UXND5SNTYQO7.0 size=125104 2023-12-03T11:28:29.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.457+0000 7fe67fa49780 1 < canceled multipart upload key=PFBGR7OF7JQG upload=UXND5SNTYQO7 tag=U4PW2I85W334 type=write size=1173680 2023-12-03T11:28:29.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.458+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=F9FC0JXS9X21 type=del size=951544 2023-12-03T11:28:29.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.459+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=LJLPCI2LMMLP type=del 2023-12-03T11:28:29.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.461+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=U71MVOZFJZ6I type=del size=1071199 2023-12-03T11:28:29.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.462+0000 7fe67fa49780 1 < canceled operation key=9AUO0SRFTAUJ tag=IOYUN689HOHO type=del size=3926334 2023-12-03T11:28:29.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.464+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~VZMJ0GSGY2H7.0 size=1048576 2023-12-03T11:28:29.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.465+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~VZMJ0GSGY2H7.1 size=1048576 2023-12-03T11:28:29.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.466+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~VZMJ0GSGY2H7.2 size=440114 2023-12-03T11:28:29.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.466+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=VZMJ0GSGY2H7 tag=E7W4CN3PUCTU type=write size=3585842 2023-12-03T11:28:29.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.467+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=050TH1VLK65O type=del 2023-12-03T11:28:29.470 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.469+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~DV1K9I0J5KK8.0 size=1048576 2023-12-03T11:28:29.471 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.470+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~DV1K9I0J5KK8.1 size=1048576 2023-12-03T11:28:29.472 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.471+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~DV1K9I0J5KK8.2 size=30053 2023-12-03T11:28:29.472 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.471+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=DV1K9I0J5KK8 tag=RQ5K7R93CN8J type=write size=3175781 2023-12-03T11:28:29.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.472+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~DVY5AYANYDES.0 size=1048576 2023-12-03T11:28:29.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.473+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~DVY5AYANYDES.1 size=1048576 2023-12-03T11:28:29.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.474+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~DVY5AYANYDES.2 size=461458 2023-12-03T11:28:29.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.476+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=DVY5AYANYDES tag=C0POVZOMCWPJ type=write size=3607186 2023-12-03T11:28:29.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.479+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=U70S64XDMSPP type=del size=2304449 2023-12-03T11:28:29.481 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.480+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~1OEJQHQ3M3KJ.0 size=1048576 2023-12-03T11:28:29.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.481+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~1OEJQHQ3M3KJ.1 size=1048576 2023-12-03T11:28:29.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.482+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~1OEJQHQ3M3KJ.2 size=866238 2023-12-03T11:28:29.485 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.484+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=1OEJQHQ3M3KJ tag=0XCSRHD1GM4V type=write size=4011966 2023-12-03T11:28:29.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.485+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=BYR2EOBCBE3M type=del size=743630 2023-12-03T11:28:29.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.486+0000 7fe67fa49780 1 < completed write operation key=P05UIP1IU4Z7 tag=2Z2IIQ2UGZIH type=write size=957244 2023-12-03T11:28:29.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.488+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=TXO5W60CR8KY type=del size=4136776 2023-12-03T11:28:29.491 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.490+0000 7fe67fa49780 1 < suggested update operation key=Q6GBIBMIJRKV tag=6E0RUSDXWCKK type=del size=3688553 2023-12-03T11:28:29.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.492+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~F4XYR93S3355.0 size=1048576 2023-12-03T11:28:29.494 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.493+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~F4XYR93S3355.1 size=1012224 2023-12-03T11:28:29.494 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.493+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=F4XYR93S3355 tag=YA4X290DEJMM type=write size=3109376 2023-12-03T11:28:29.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.495+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~X4DVPHWZ793Y.0 size=1048576 2023-12-03T11:28:29.497 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.496+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~X4DVPHWZ793Y.1 size=1037586 2023-12-03T11:28:29.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.498+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=X4DVPHWZ793Y tag=U12YSUGS8H07 type=write size=3134738 2023-12-03T11:28:29.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.500+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~3C0I9G9X3HK9.0 size=247351 2023-12-03T11:28:29.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.500+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=3C0I9G9X3HK9 tag=L5UY3BSCUQLA type=write size=1295927 2023-12-03T11:28:29.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.501+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=P7HYEAZLNCKQ type=del 2023-12-03T11:28:29.503 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.502+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=YXDZXBWNUZEO type=del size=1656985 2023-12-03T11:28:29.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.503+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~2KN0MUOF41NC.0 size=1048576 2023-12-03T11:28:29.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.503+0000 7fe67fa49780 1 < canceled part key=_multipart_Z1NFEIZNYYO2.2~2KN0MUOF41NC.1 size=1048576 2023-12-03T11:28:29.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.503+0000 7fe67fa49780 1 < canceled part key=_multipart_Z1NFEIZNYYO2.2~2KN0MUOF41NC.2 size=658028 2023-12-03T11:28:29.506 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.505+0000 7fe67fa49780 1 < canceled multipart upload key=Z1NFEIZNYYO2 upload=2KN0MUOF41NC tag=HKCM438B9M8T type=write size=3803756 2023-12-03T11:28:29.507 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.506+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=V9VA8B2DO9KA type=del size=2643655 2023-12-03T11:28:29.508 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.507+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~0KKOFNHIYWM0.0 size=1048576 2023-12-03T11:28:29.509 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.508+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~0KKOFNHIYWM0.1 size=1048576 2023-12-03T11:28:29.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.510+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~0KKOFNHIYWM0.2 size=542499 2023-12-03T11:28:29.513 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.512+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=0KKOFNHIYWM0 tag=EV3EO7AFRTKV type=write size=3688227 2023-12-03T11:28:29.514 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.513+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=50WW13WW1KOP type=del size=3121628 2023-12-03T11:28:29.516 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.515+0000 7fe67fa49780 1 < suggested remove operation key=DDHGOWEI7WEI tag=PW167P12UKC6 type=del 2023-12-03T11:28:29.518 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.517+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~XR9EGIXRA532.0 size=1048576 2023-12-03T11:28:29.519 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.518+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~XR9EGIXRA532.1 size=1048576 2023-12-03T11:28:29.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.519+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~XR9EGIXRA532.2 size=974337 2023-12-03T11:28:29.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.519+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=XR9EGIXRA532 tag=WFP0TP3FTDCU type=write size=4120065 2023-12-03T11:28:29.521 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.520+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~2S2F0U8C7T1N.0 size=1048576 2023-12-03T11:28:29.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.521+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~2S2F0U8C7T1N.1 size=671037 2023-12-03T11:28:29.524 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.523+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=2S2F0U8C7T1N tag=WMAMCO1H3F0W type=write size=2768189 2023-12-03T11:28:29.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.525+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~3445EAAQ0W9B.0 size=1048576 2023-12-03T11:28:29.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.526+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~3445EAAQ0W9B.1 size=1048576 2023-12-03T11:28:29.528 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.527+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~3445EAAQ0W9B.2 size=6410 2023-12-03T11:28:29.529 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.527+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=3445EAAQ0W9B tag=BY16YXS4A7UL type=write size=3152138 2023-12-03T11:28:29.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.529+0000 7fe67fa49780 1 < suggested remove operation key=IIW1Y6QYEODQ tag=U24SXA053V6P type=del 2023-12-03T11:28:29.532 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.532+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~BXLCLN6GHD9Q.0 size=1048576 2023-12-03T11:28:29.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.532+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~BXLCLN6GHD9Q.1 size=1048576 2023-12-03T11:28:29.534 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.533+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~BXLCLN6GHD9Q.2 size=9904 2023-12-03T11:28:29.534 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.533+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=BXLCLN6GHD9Q tag=82TIQJS4NJLI type=write size=3155632 2023-12-03T11:28:29.535 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.535+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~UWKUQHGMY1YK.0 size=1048576 2023-12-03T11:28:29.536 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.536+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~UWKUQHGMY1YK.1 size=1039170 2023-12-03T11:28:29.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.538+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=UWKUQHGMY1YK tag=3446ROFUAH1S type=write size=3136322 2023-12-03T11:28:29.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.540+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~QK6XK06WUBUC.0 size=1048576 2023-12-03T11:28:29.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.541+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~QK6XK06WUBUC.1 size=1048576 2023-12-03T11:28:29.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.542+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~QK6XK06WUBUC.2 size=624270 2023-12-03T11:28:29.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.542+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=QK6XK06WUBUC tag=PKNGI6QZFN6K type=write size=3769998 2023-12-03T11:28:29.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.544+0000 7fe67fa49780 1 < suggested remove operation key=6LQ18VAE3ZN6 tag=F9FC0JXS9X21 type=del 2023-12-03T11:28:29.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.545+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=53AQ8NG6AGFS type=del size=3959936 2023-12-03T11:28:29.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.546+0000 7fe67fa49780 -1 < failed to complete operation key=IIW1Y6QYEODQ tag=U71MVOZFJZ6I type=del size=1071199: (22) Invalid argument 2023-12-03T11:28:29.551 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.550+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~04Y38TRK1XFF.0 size=1048576 2023-12-03T11:28:29.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.551+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~04Y38TRK1XFF.1 size=480276 2023-12-03T11:28:29.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.551+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=04Y38TRK1XFF tag=LG63E6JS09NY type=write size=2577428 2023-12-03T11:28:29.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.552+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~VZMJ0GSGY2H7.0 size=1048576 2023-12-03T11:28:29.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.553+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~VZMJ0GSGY2H7.1 size=1048576 2023-12-03T11:28:29.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.554+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~VZMJ0GSGY2H7.2 size=440114 2023-12-03T11:28:29.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.556+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=VZMJ0GSGY2H7 tag=E7W4CN3PUCTU type=write size=3585842 2023-12-03T11:28:29.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.557+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=7SKDYZ8RBTIL type=del size=804496 2023-12-03T11:28:29.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.558+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~DV1K9I0J5KK8.0 size=1048576 2023-12-03T11:28:29.560 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.559+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~DV1K9I0J5KK8.1 size=1048576 2023-12-03T11:28:29.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.560+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~DV1K9I0J5KK8.2 size=30053 2023-12-03T11:28:29.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.562+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=DV1K9I0J5KK8 tag=RQ5K7R93CN8J type=write size=3175781 2023-12-03T11:28:29.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.563+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=BMF7Y62GKAIR type=del size=1935736 2023-12-03T11:28:29.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.564+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=U70S64XDMSPP type=del 2023-12-03T11:28:29.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.565+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=FPZC0RPGWK1O type=del size=3161863 2023-12-03T11:28:29.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.567+0000 7fe67fa49780 1 < suggested update operation key=Y0VRZR6S8FP6 tag=BYR2EOBCBE3M type=del size=743630 2023-12-03T11:28:29.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.569+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~D2KNMT0UE0AG.0 size=1048576 2023-12-03T11:28:29.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.570+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~D2KNMT0UE0AG.1 size=340653 2023-12-03T11:28:29.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.570+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=D2KNMT0UE0AG tag=56H93UQFEMFV type=write size=2437805 2023-12-03T11:28:29.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.571+0000 7fe67fa49780 -1 < failed to complete operation key=IIW1Y6QYEODQ tag=TXO5W60CR8KY type=del size=4136776: (22) Invalid argument 2023-12-03T11:28:29.574 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.573+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=7NZUI9XVF9HR type=del size=2188984 2023-12-03T11:28:29.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.574+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~F4XYR93S3355.0 size=1048576 2023-12-03T11:28:29.576 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.575+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~F4XYR93S3355.1 size=1012224 2023-12-03T11:28:29.578 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.577+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=F4XYR93S3355 tag=YA4X290DEJMM type=write size=3109376 2023-12-03T11:28:29.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.578+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=GFZ4O352VOUY type=del size=2835059 2023-12-03T11:28:29.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.579+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~3C0I9G9X3HK9.0 size=247351 2023-12-03T11:28:29.582 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.581+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=3C0I9G9X3HK9 tag=L5UY3BSCUQLA type=write size=1295927 2023-12-03T11:28:29.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.583+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~9CZ95JBXR3KC.0 size=1048576 2023-12-03T11:28:29.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.584+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~9CZ95JBXR3KC.1 size=797850 2023-12-03T11:28:29.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.584+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=9CZ95JBXR3KC tag=2TOUKDDWRIZU type=write size=2895002 2023-12-03T11:28:29.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.587+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=YXDZXBWNUZEO type=del 2023-12-03T11:28:29.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.590+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~2FF5KU24CD3T.0 size=749424 2023-12-03T11:28:29.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.590+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=2FF5KU24CD3T tag=4V0P851AOZGF type=write size=1798000 2023-12-03T11:28:29.593 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.592+0000 7fe67fa49780 -1 < failed to complete operation key=IIW1Y6QYEODQ tag=V9VA8B2DO9KA type=del size=2643655: (22) Invalid argument 2023-12-03T11:28:29.595 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.594+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~Q9ZH6QH12J7P.0 size=1048576 2023-12-03T11:28:29.596 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.595+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~Q9ZH6QH12J7P.1 size=450018 2023-12-03T11:28:29.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.595+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=Q9ZH6QH12J7P tag=57N0K0YYLYIW type=write size=2547170 2023-12-03T11:28:29.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.597+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=50WW13WW1KOP type=del 2023-12-03T11:28:29.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.599+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~0W01BXR2R25P.0 size=131244 2023-12-03T11:28:29.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.599+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=0W01BXR2R25P tag=X389J08Y4VM7 type=write size=1179820 2023-12-03T11:28:29.601 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.600+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~XR9EGIXRA532.0 size=1048576 2023-12-03T11:28:29.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.601+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~XR9EGIXRA532.1 size=1048576 2023-12-03T11:28:29.603 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.602+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~XR9EGIXRA532.2 size=974337 2023-12-03T11:28:29.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.604+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=XR9EGIXRA532 tag=WFP0TP3FTDCU type=write size=4120065 2023-12-03T11:28:29.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.606+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~GAULZH8F8NZQ.0 size=1048576 2023-12-03T11:28:29.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.607+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~GAULZH8F8NZQ.1 size=1048576 2023-12-03T11:28:29.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.608+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~GAULZH8F8NZQ.2 size=87419 2023-12-03T11:28:29.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.608+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=GAULZH8F8NZQ tag=XIU8JY8ZPQH3 type=write size=3233147 2023-12-03T11:28:29.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.610+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~3445EAAQ0W9B.0 size=1048576 2023-12-03T11:28:29.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.611+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~3445EAAQ0W9B.1 size=1048576 2023-12-03T11:28:29.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.612+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~3445EAAQ0W9B.2 size=6410 2023-12-03T11:28:29.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.614+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=3445EAAQ0W9B tag=BY16YXS4A7UL type=write size=3152138 2023-12-03T11:28:29.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.615+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=VNX882YV2Q06 type=del size=2918019 2023-12-03T11:28:29.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.616+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~BXLCLN6GHD9Q.0 size=1048576 2023-12-03T11:28:29.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.617+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~BXLCLN6GHD9Q.1 size=1048576 2023-12-03T11:28:29.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.618+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~BXLCLN6GHD9Q.2 size=9904 2023-12-03T11:28:29.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.620+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=BXLCLN6GHD9Q tag=82TIQJS4NJLI type=write size=3155632 2023-12-03T11:28:29.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.622+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~N9XNDQ206Y69.0 size=1048576 2023-12-03T11:28:29.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.623+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~N9XNDQ206Y69.1 size=1048576 2023-12-03T11:28:29.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.624+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~N9XNDQ206Y69.2 size=584209 2023-12-03T11:28:29.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.624+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=N9XNDQ206Y69 tag=SA2OLSQXPJ9X type=write size=3729937 2023-12-03T11:28:29.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.625+0000 7fe67fa49780 1 < canceled part key=_multipart_9OD4G28SDLB4.2~QK6XK06WUBUC.0 size=1048576 2023-12-03T11:28:29.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.626+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~QK6XK06WUBUC.1 size=1048576 2023-12-03T11:28:29.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.626+0000 7fe67fa49780 1 < canceled part key=_multipart_9OD4G28SDLB4.2~QK6XK06WUBUC.2 size=624270 2023-12-03T11:28:29.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.628+0000 7fe67fa49780 1 < canceled multipart upload key=9OD4G28SDLB4 upload=QK6XK06WUBUC tag=PKNGI6QZFN6K type=write size=3769998 2023-12-03T11:28:29.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.630+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~HL837RPHP42K.0 size=150713 2023-12-03T11:28:29.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.630+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=HL837RPHP42K tag=JU615K1Q4U5Z type=write size=1199289 2023-12-03T11:28:29.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.632+0000 7fe67fa49780 1 < suggested remove operation key=SXVBDBJ5B09V tag=53AQ8NG6AGFS type=del 2023-12-03T11:28:29.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.634+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=JB8D3OKXN7MA type=del size=1391342 2023-12-03T11:28:29.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.635+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~04Y38TRK1XFF.0 size=1048576 2023-12-03T11:28:29.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.636+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~04Y38TRK1XFF.1 size=480276 2023-12-03T11:28:29.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.638+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=04Y38TRK1XFF tag=LG63E6JS09NY type=write size=2577428 2023-12-03T11:28:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.639+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=YQHA730OZNU5 type=del size=2107717 2023-12-03T11:28:29.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.640+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=7SKDYZ8RBTIL type=del 2023-12-03T11:28:29.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.641+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=GHM5KV4CXV6V type=del size=945435 2023-12-03T11:28:29.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.642+0000 7fe67fa49780 1 < canceled operation key=6LQ18VAE3ZN6 tag=BMF7Y62GKAIR type=del size=1935736 2023-12-03T11:28:29.644 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.644+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=9GBZCJKFWI6D type=del size=520264 2023-12-03T11:28:29.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.645+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=FPZC0RPGWK1O type=del 2023-12-03T11:28:29.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.646+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~N07JPV9LZ77A.0 size=1048576 2023-12-03T11:28:29.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.647+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~N07JPV9LZ77A.1 size=1048576 2023-12-03T11:28:29.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.650+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~N07JPV9LZ77A.2 size=464742 2023-12-03T11:28:29.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.650+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=N07JPV9LZ77A tag=BATQKR3O97X9 type=write size=3610470 2023-12-03T11:28:29.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.651+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~D2KNMT0UE0AG.0 size=1048576 2023-12-03T11:28:29.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.652+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~D2KNMT0UE0AG.1 size=340653 2023-12-03T11:28:29.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.654+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=D2KNMT0UE0AG tag=56H93UQFEMFV type=write size=2437805 2023-12-03T11:28:29.656 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.655+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=GJPTX7T50WUG type=del size=1891111 2023-12-03T11:28:29.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.657+0000 7fe67fa49780 1 < canceled operation key=006X4CSXV0KA tag=7NZUI9XVF9HR type=del size=2188984 2023-12-03T11:28:29.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.658+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=63823Q1PYC0C type=del size=1056392 2023-12-03T11:28:29.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.659+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=GFZ4O352VOUY type=del 2023-12-03T11:28:29.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.661+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~FZ80ZUYZWSO5.0 size=15404 2023-12-03T11:28:29.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.661+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=FZ80ZUYZWSO5 tag=CM4CCFXPU38O type=write size=1063980 2023-12-03T11:28:29.663 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.662+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~9CZ95JBXR3KC.0 size=1048576 2023-12-03T11:28:29.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.663+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~9CZ95JBXR3KC.1 size=797850 2023-12-03T11:28:29.666 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.665+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=9CZ95JBXR3KC tag=2TOUKDDWRIZU type=write size=2895002 2023-12-03T11:28:29.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.667+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~LXZJCDF2R70Z.0 size=1048576 2023-12-03T11:28:29.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.668+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~LXZJCDF2R70Z.1 size=1048576 2023-12-03T11:28:29.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.669+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~LXZJCDF2R70Z.2 size=363424 2023-12-03T11:28:29.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.669+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=LXZJCDF2R70Z tag=AOJGJZS24BKX type=write size=3509152 2023-12-03T11:28:29.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.669+0000 7fe67fa49780 1 < canceled part key=_multipart_006X4CSXV0KA.2~2FF5KU24CD3T.0 size=749424 2023-12-03T11:28:29.672 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.671+0000 7fe67fa49780 1 < canceled multipart upload key=006X4CSXV0KA upload=2FF5KU24CD3T tag=4V0P851AOZGF type=write size=1798000 2023-12-03T11:28:29.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.672+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=X54E2813L9HK type=del size=638960 2023-12-03T11:28:29.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.674+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~Q9ZH6QH12J7P.0 size=1048576 2023-12-03T11:28:29.676 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.675+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~Q9ZH6QH12J7P.1 size=450018 2023-12-03T11:28:29.678 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.677+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=Q9ZH6QH12J7P tag=57N0K0YYLYIW type=write size=2547170 2023-12-03T11:28:29.679 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.678+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=D8IM7SWC4B43 type=del size=1724360 2023-12-03T11:28:29.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.679+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~0W01BXR2R25P.0 size=131244 2023-12-03T11:28:29.682 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.681+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=0W01BXR2R25P tag=X389J08Y4VM7 type=write size=1179820 2023-12-03T11:28:29.683 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.682+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=4TCBM52SJH8X type=write size=250449 2023-12-03T11:28:29.685 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.684+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~GAULZH8F8NZQ.0 size=1048576 2023-12-03T11:28:29.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.685+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~GAULZH8F8NZQ.1 size=1048576 2023-12-03T11:28:29.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.686+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~GAULZH8F8NZQ.2 size=87419 2023-12-03T11:28:29.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.688+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=GAULZH8F8NZQ tag=XIU8JY8ZPQH3 type=write size=3233147 2023-12-03T11:28:29.690 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.689+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=X8SPGZOV42MW type=write size=31309 2023-12-03T11:28:29.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.691+0000 7fe67fa49780 1 < suggested remove operation key=0G8KNJBJ9K1Z tag=VNX882YV2Q06 type=del 2023-12-03T11:28:29.694 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.693+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~H1A8PEI3J2O8.0 size=1048576 2023-12-03T11:28:29.695 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.694+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~H1A8PEI3J2O8.1 size=1048576 2023-12-03T11:28:29.696 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.695+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~H1A8PEI3J2O8.2 size=709755 2023-12-03T11:28:29.696 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.695+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=H1A8PEI3J2O8 tag=QHIY0LPB0AF7 type=write size=3855483 2023-12-03T11:28:29.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.697+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~N9XNDQ206Y69.0 size=1048576 2023-12-03T11:28:29.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.698+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~N9XNDQ206Y69.1 size=1048576 2023-12-03T11:28:29.702 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.699+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~N9XNDQ206Y69.2 size=584209 2023-12-03T11:28:29.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.703+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=N9XNDQ206Y69 tag=SA2OLSQXPJ9X type=write size=3729937 2023-12-03T11:28:29.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.705+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~ODW4463JF15N.0 size=297193 2023-12-03T11:28:29.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.705+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=ODW4463JF15N tag=4AJ3XHZTRVCN type=write size=1345769 2023-12-03T11:28:29.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.705+0000 7fe67fa49780 1 < canceled part key=_multipart_A7GOX2W0WB83.2~HL837RPHP42K.0 size=150713 2023-12-03T11:28:29.709 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.708+0000 7fe67fa49780 1 < canceled multipart upload key=A7GOX2W0WB83 upload=HL837RPHP42K tag=JU615K1Q4U5Z type=write size=1199289 2023-12-03T11:28:29.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.710+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~NR15Q0UZ01TK.0 size=1048576 2023-12-03T11:28:29.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.711+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~NR15Q0UZ01TK.1 size=1048576 2023-12-03T11:28:29.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.712+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~NR15Q0UZ01TK.2 size=378239 2023-12-03T11:28:29.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.712+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=NR15Q0UZ01TK tag=J9OVR58321WB type=write size=3523967 2023-12-03T11:28:29.714 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.713+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=JB8D3OKXN7MA type=del 2023-12-03T11:28:29.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.714+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=HM42N6OTHQW0 type=del size=812999 2023-12-03T11:28:29.716 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.715+0000 7fe67fa49780 -1 < failed to complete operation key=0G8KNJBJ9K1Z tag=YQHA730OZNU5 type=del size=2107717: (22) Invalid argument 2023-12-03T11:28:29.718 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.717+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~WDJZWLFUYACU.0 size=1048576 2023-12-03T11:28:29.719 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.718+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~WDJZWLFUYACU.1 size=1048576 2023-12-03T11:28:29.720 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.719+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~WDJZWLFUYACU.2 size=841386 2023-12-03T11:28:29.720 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.719+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=WDJZWLFUYACU tag=1ZAEFADI4D5D type=write size=3987114 2023-12-03T11:28:29.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.721+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=GHM5KV4CXV6V type=del 2023-12-03T11:28:29.723 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.722+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=5CKVES4LA26Q type=del size=2998158 2023-12-03T11:28:29.724 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.723+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=9GBZCJKFWI6D type=del 2023-12-03T11:28:29.725 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.724+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=ZXHXOG860QMM type=del size=4153400 2023-12-03T11:28:29.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.725+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~N07JPV9LZ77A.0 size=1048576 2023-12-03T11:28:29.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.726+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~N07JPV9LZ77A.1 size=1048576 2023-12-03T11:28:29.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.726+0000 7fe67fa49780 1 < canceled part key=_multipart_URVD2U16EW75.2~N07JPV9LZ77A.2 size=464742 2023-12-03T11:28:29.729 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.729+0000 7fe67fa49780 1 < canceled multipart upload key=URVD2U16EW75 upload=N07JPV9LZ77A tag=BATQKR3O97X9 type=write size=3610470 2023-12-03T11:28:29.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.730+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=HIY7W3NL3057 type=write size=384449 2023-12-03T11:28:29.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.731+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=GJPTX7T50WUG type=del 2023-12-03T11:28:29.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.733+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=2L7R24WD2Z2P type=del size=1673042 2023-12-03T11:28:29.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.734+0000 7fe67fa49780 -1 < failed to complete operation key=0G8KNJBJ9K1Z tag=63823Q1PYC0C type=del size=1056392: (22) Invalid argument 2023-12-03T11:28:29.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.736+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~LQ9HJAEI2E5U.0 size=1048576 2023-12-03T11:28:29.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.737+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~LQ9HJAEI2E5U.1 size=1048576 2023-12-03T11:28:29.739 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.738+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~LQ9HJAEI2E5U.2 size=938943 2023-12-03T11:28:29.739 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.738+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=LQ9HJAEI2E5U tag=27U13ZWO47M8 type=write size=4084671 2023-12-03T11:28:29.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.739+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~FZ80ZUYZWSO5.0 size=15404 2023-12-03T11:28:29.742 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.741+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=FZ80ZUYZWSO5 tag=CM4CCFXPU38O type=write size=1063980 2023-12-03T11:28:29.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.743+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~BD6VGIXXAU4V.0 size=1048576 2023-12-03T11:28:29.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.744+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~BD6VGIXXAU4V.1 size=300771 2023-12-03T11:28:29.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.744+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=BD6VGIXXAU4V tag=QLANW5UHV5ZG type=write size=2397923 2023-12-03T11:28:29.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.745+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~LXZJCDF2R70Z.0 size=1048576 2023-12-03T11:28:29.750 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.746+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~LXZJCDF2R70Z.1 size=1048576 2023-12-03T11:28:29.750 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.748+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~LXZJCDF2R70Z.2 size=363424 2023-12-03T11:28:29.751 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.750+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=LXZJCDF2R70Z tag=AOJGJZS24BKX type=write size=3509152 2023-12-03T11:28:29.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.751+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=0DV3U4IZZLU9 type=del size=2363838 2023-12-03T11:28:29.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.752+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=X54E2813L9HK type=del 2023-12-03T11:28:29.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.754+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~UCY1V4RZN2D5.0 size=99040 2023-12-03T11:28:29.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.754+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=UCY1V4RZN2D5 tag=E2543ATFU6QE type=write size=1147616 2023-12-03T11:28:29.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.755+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=D8IM7SWC4B43 type=del 2023-12-03T11:28:29.758 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.757+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~RLSSAQBB7729.0 size=1048576 2023-12-03T11:28:29.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.758+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~RLSSAQBB7729.1 size=1048576 2023-12-03T11:28:29.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.759+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~RLSSAQBB7729.2 size=600196 2023-12-03T11:28:29.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.759+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=RLSSAQBB7729 tag=LCVYD920T8SQ type=write size=3745924 2023-12-03T11:28:29.762 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.761+0000 7fe67fa49780 1 < completed write operation key=OH2XUEEYL9JO tag=4TCBM52SJH8X type=write size=250449 2023-12-03T11:28:29.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.763+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~M9HAX8FR43IM.0 size=1048576 2023-12-03T11:28:29.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.764+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~M9HAX8FR43IM.1 size=766530 2023-12-03T11:28:29.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.764+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=M9HAX8FR43IM tag=ASSNTKL2NZMS type=write size=2863682 2023-12-03T11:28:29.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.765+0000 7fe67fa49780 1 < completed write operation key=UL24DVOA31Y7 tag=X8SPGZOV42MW type=write size=31309 2023-12-03T11:28:29.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.766+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=ZWVIPWJSV4AG type=del size=1233708 2023-12-03T11:28:29.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.768+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~H1A8PEI3J2O8.0 size=1048576 2023-12-03T11:28:29.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.769+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~H1A8PEI3J2O8.1 size=1048576 2023-12-03T11:28:29.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.770+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~H1A8PEI3J2O8.2 size=709755 2023-12-03T11:28:29.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.772+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=H1A8PEI3J2O8 tag=QHIY0LPB0AF7 type=write size=3855483 2023-12-03T11:28:29.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.773+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=0IKNEP71B1PB type=write size=557507 2023-12-03T11:28:29.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.774+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~ODW4463JF15N.0 size=297193 2023-12-03T11:28:29.777 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.776+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=ODW4463JF15N tag=4AJ3XHZTRVCN type=write size=1345769 2023-12-03T11:28:29.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.778+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~DCIDMDZZ1DQ0.0 size=1048576 2023-12-03T11:28:29.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.779+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~DCIDMDZZ1DQ0.1 size=276883 2023-12-03T11:28:29.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.779+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=DCIDMDZZ1DQ0 tag=REMB10ZDKYCB type=write size=2374035 2023-12-03T11:28:29.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.782+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~NR15Q0UZ01TK.0 size=1048576 2023-12-03T11:28:29.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.782+0000 7fe67fa49780 1 < canceled part key=_multipart_9AUO0SRFTAUJ.2~NR15Q0UZ01TK.1 size=1048576 2023-12-03T11:28:29.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.783+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~NR15Q0UZ01TK.2 size=378239 2023-12-03T11:28:29.786 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.785+0000 7fe67fa49780 1 < canceled multipart upload key=9AUO0SRFTAUJ upload=NR15Q0UZ01TK tag=J9OVR58321WB type=write size=3523967 2023-12-03T11:28:29.787 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.786+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=1FP3TNP9WUO2 type=del size=3594420 2023-12-03T11:28:29.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.787+0000 7fe67fa49780 1 < canceled operation key=SXVBDBJ5B09V tag=HM42N6OTHQW0 type=del size=812999 2023-12-03T11:28:29.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.788+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=5QF28O0XFVGI type=del size=60520 2023-12-03T11:28:29.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.788+0000 7fe67fa49780 1 < canceled part key=_multipart_9OD4G28SDLB4.2~WDJZWLFUYACU.0 size=1048576 2023-12-03T11:28:29.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.789+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~WDJZWLFUYACU.1 size=1048576 2023-12-03T11:28:29.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.790+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~WDJZWLFUYACU.2 size=841386 2023-12-03T11:28:29.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.792+0000 7fe67fa49780 1 < canceled multipart upload key=9OD4G28SDLB4 upload=WDJZWLFUYACU tag=1ZAEFADI4D5D type=write size=3987114 2023-12-03T11:28:29.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.794+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~2ODYCVHJLK66.0 size=1048576 2023-12-03T11:28:29.796 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.796+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~2ODYCVHJLK66.1 size=1048576 2023-12-03T11:28:29.797 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.796+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~2ODYCVHJLK66.2 size=64963 2023-12-03T11:28:29.797 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.796+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=2ODYCVHJLK66 tag=BB1IY5PLMLV3 type=write size=3210691 2023-12-03T11:28:29.799 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.798+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=5CKVES4LA26Q type=del 2023-12-03T11:28:29.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.800+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~USWMZMOJIIJC.0 size=1048576 2023-12-03T11:28:29.803 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.802+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~USWMZMOJIIJC.1 size=1048576 2023-12-03T11:28:29.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.803+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~USWMZMOJIIJC.2 size=552692 2023-12-03T11:28:29.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.803+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=USWMZMOJIIJC tag=DT2MAIYAOGFP type=write size=3698420 2023-12-03T11:28:29.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.805+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=ZXHXOG860QMM type=del 2023-12-03T11:28:29.807 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.806+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=4XXTA3YBXMJ2 type=write size=1022008 2023-12-03T11:28:29.809 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.808+0000 7fe67fa49780 1 < suggested remove operation key=P05UIP1IU4Z7 tag=HIY7W3NL3057 type=write 2023-12-03T11:28:29.811 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.810+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~AG7TBWDKTT5G.0 size=904583 2023-12-03T11:28:29.811 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.810+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=AG7TBWDKTT5G tag=82LQV6J8KZ7U type=write size=1953159 2023-12-03T11:28:29.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.812+0000 7fe67fa49780 1 < suggested remove operation key=YEMPVKMDANPG tag=2L7R24WD2Z2P type=del 2023-12-03T11:28:29.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.813+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=MK2U4DKCDVJV type=del size=3271720 2023-12-03T11:28:29.817 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.816+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~LQ9HJAEI2E5U.0 size=1048576 2023-12-03T11:28:29.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.817+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~LQ9HJAEI2E5U.1 size=1048576 2023-12-03T11:28:29.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.817+0000 7fe67fa49780 1 < canceled part key=_multipart_0GQZY07Y2PVI.2~LQ9HJAEI2E5U.2 size=938943 2023-12-03T11:28:29.820 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.819+0000 7fe67fa49780 1 < canceled multipart upload key=0GQZY07Y2PVI upload=LQ9HJAEI2E5U tag=27U13ZWO47M8 type=write size=4084671 2023-12-03T11:28:29.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.820+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=3FOR1TWVZIUG type=del size=2163958 2023-12-03T11:28:29.822 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.821+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~BD6VGIXXAU4V.0 size=1048576 2023-12-03T11:28:29.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.822+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~BD6VGIXXAU4V.1 size=300771 2023-12-03T11:28:29.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.824+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=BD6VGIXXAU4V tag=QLANW5UHV5ZG type=write size=2397923 2023-12-03T11:28:29.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.825+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=88REOJYQW00O type=del size=96250 2023-12-03T11:28:29.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.826+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=0DV3U4IZZLU9 type=del 2023-12-03T11:28:29.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.827+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=GHBXWOGNJXJH type=del size=3653806 2023-12-03T11:28:29.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.829+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~UCY1V4RZN2D5.0 size=99040 2023-12-03T11:28:29.831 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.830+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=UCY1V4RZN2D5 tag=E2543ATFU6QE type=write size=1147616 2023-12-03T11:28:29.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.833+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~9SDXJQ52RYUL.0 size=1048576 2023-12-03T11:28:29.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.834+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~9SDXJQ52RYUL.1 size=473233 2023-12-03T11:28:29.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.834+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=9SDXJQ52RYUL tag=VHON0N426S9D type=write size=2570385 2023-12-03T11:28:29.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.835+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~RLSSAQBB7729.0 size=1048576 2023-12-03T11:28:29.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.836+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~RLSSAQBB7729.1 size=1048576 2023-12-03T11:28:29.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.837+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~RLSSAQBB7729.2 size=600196 2023-12-03T11:28:29.839 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.838+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=RLSSAQBB7729 tag=LCVYD920T8SQ type=write size=3745924 2023-12-03T11:28:29.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.840+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=2HU4GOF2HGOB type=del size=1749363 2023-12-03T11:28:29.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.841+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~M9HAX8FR43IM.0 size=1048576 2023-12-03T11:28:29.843 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.842+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~M9HAX8FR43IM.1 size=766530 2023-12-03T11:28:29.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.846+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=M9HAX8FR43IM tag=ASSNTKL2NZMS type=write size=2863682 2023-12-03T11:28:29.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.848+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~BVX3YYZA1ACZ.0 size=1020239 2023-12-03T11:28:29.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.848+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=BVX3YYZA1ACZ tag=623JT1GSW1OP type=write size=2068815 2023-12-03T11:28:29.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.849+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=ZWVIPWJSV4AG type=del 2023-12-03T11:28:29.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.851+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~4PX39BWWWCKT.0 size=112189 2023-12-03T11:28:29.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.851+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=4PX39BWWWCKT tag=1Y1AXA6PVLBX type=write size=1160765 2023-12-03T11:28:29.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.853+0000 7fe67fa49780 1 < suggested remove operation key=DDHGOWEI7WEI tag=0IKNEP71B1PB type=write 2023-12-03T11:28:29.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.855+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~TKS3NRV1NTRV.0 size=1048576 2023-12-03T11:28:29.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.856+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~TKS3NRV1NTRV.1 size=1048576 2023-12-03T11:28:29.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.857+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~TKS3NRV1NTRV.2 size=524945 2023-12-03T11:28:29.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.857+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=TKS3NRV1NTRV tag=QFLEF71FVY12 type=write size=3670673 2023-12-03T11:28:29.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.857+0000 7fe67fa49780 1 < canceled part key=_multipart_CIB1NZHJGO46.2~DCIDMDZZ1DQ0.0 size=1048576 2023-12-03T11:28:29.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.858+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~DCIDMDZZ1DQ0.1 size=276883 2023-12-03T11:28:29.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.860+0000 7fe67fa49780 1 < canceled multipart upload key=CIB1NZHJGO46 upload=DCIDMDZZ1DQ0 tag=REMB10ZDKYCB type=write size=2374035 2023-12-03T11:28:29.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.861+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=KYFRGFKPZDW4 type=write size=46532 2023-12-03T11:28:29.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.863+0000 7fe67fa49780 1 < canceled operation key=Y0VRZR6S8FP6 tag=1FP3TNP9WUO2 type=del size=3594420 2023-12-03T11:28:29.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.864+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=MUMYZHRQSPXF type=del size=2909885 2023-12-03T11:28:29.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.865+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=5QF28O0XFVGI type=del 2023-12-03T11:28:29.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.867+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~DMYX0USTYO4D.0 size=1048576 2023-12-03T11:28:29.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.868+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~DMYX0USTYO4D.1 size=741158 2023-12-03T11:28:29.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.868+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=DMYX0USTYO4D tag=I0W746EQUONX type=write size=2838310 2023-12-03T11:28:29.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.870+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~2ODYCVHJLK66.0 size=1048576 2023-12-03T11:28:29.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.871+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~2ODYCVHJLK66.1 size=1048576 2023-12-03T11:28:29.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.872+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~2ODYCVHJLK66.2 size=64963 2023-12-03T11:28:29.875 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.874+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=2ODYCVHJLK66 tag=BB1IY5PLMLV3 type=write size=3210691 2023-12-03T11:28:29.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.876+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~VVCH0CKI1HGB.0 size=1048576 2023-12-03T11:28:29.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.877+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~VVCH0CKI1HGB.1 size=1048576 2023-12-03T11:28:29.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.879+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~VVCH0CKI1HGB.2 size=549287 2023-12-03T11:28:29.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.879+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=VVCH0CKI1HGB tag=7TZWAEFDJ2FF type=write size=3695015 2023-12-03T11:28:29.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.880+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~USWMZMOJIIJC.0 size=1048576 2023-12-03T11:28:29.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.881+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~USWMZMOJIIJC.1 size=1048576 2023-12-03T11:28:29.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.881+0000 7fe67fa49780 1 < canceled part key=_multipart_V9ZVWHO8IF8L.2~USWMZMOJIIJC.2 size=552692 2023-12-03T11:28:29.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.883+0000 7fe67fa49780 1 < canceled multipart upload key=V9ZVWHO8IF8L upload=USWMZMOJIIJC tag=DT2MAIYAOGFP type=write size=3698420 2023-12-03T11:28:29.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.884+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=JGCSPVRLUUIZ type=del size=1023968 2023-12-03T11:28:29.888 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.887+0000 7fe67fa49780 1 < suggested update operation key=IIW1Y6QYEODQ tag=4XXTA3YBXMJ2 type=write size=1022008 2023-12-03T11:28:29.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.889+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~VOW3DBLHL8UV.0 size=1048576 2023-12-03T11:28:29.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.890+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~VOW3DBLHL8UV.1 size=813494 2023-12-03T11:28:29.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.890+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=VOW3DBLHL8UV tag=NSXXXBOFZ5KJ type=write size=2910646 2023-12-03T11:28:29.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.891+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~AG7TBWDKTT5G.0 size=904583 2023-12-03T11:28:29.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.894+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=AG7TBWDKTT5G tag=82LQV6J8KZ7U type=write size=1953159 2023-12-03T11:28:29.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.896+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~LZ99OSRSQ1KC.0 size=1048576 2023-12-03T11:28:29.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.897+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~LZ99OSRSQ1KC.1 size=1048576 2023-12-03T11:28:29.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.898+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~LZ99OSRSQ1KC.2 size=630210 2023-12-03T11:28:29.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.898+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=LZ99OSRSQ1KC tag=PSD8P81T0MQI type=write size=3775938 2023-12-03T11:28:29.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.899+0000 7fe67fa49780 1 < canceled operation key=9AUO0SRFTAUJ tag=MK2U4DKCDVJV type=del size=3271720 2023-12-03T11:28:29.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.900+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=FXQ68AKH0QPJ type=del size=1787476 2023-12-03T11:28:29.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.901+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=3FOR1TWVZIUG type=del 2023-12-03T11:28:29.904 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.903+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~6HXM4TODCL2I.0 size=1048576 2023-12-03T11:28:29.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.904+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~6HXM4TODCL2I.1 size=1048576 2023-12-03T11:28:29.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.905+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~6HXM4TODCL2I.2 size=23443 2023-12-03T11:28:29.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.905+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=6HXM4TODCL2I tag=ISIMCK4YPX1K type=write size=3169171 2023-12-03T11:28:29.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.906+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=88REOJYQW00O type=del 2023-12-03T11:28:29.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.908+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~SB1ZCM640G58.0 size=288160 2023-12-03T11:28:29.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.908+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=SB1ZCM640G58 tag=G45FPHQR8OY3 type=write size=1336736 2023-12-03T11:28:29.911 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.910+0000 7fe67fa49780 -1 < failed to complete operation key=IIW1Y6QYEODQ tag=GHBXWOGNJXJH type=del size=3653806: (22) Invalid argument 2023-12-03T11:28:29.913 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.912+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~PTX4OG2F5HAH.0 size=1048576 2023-12-03T11:28:29.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.913+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~PTX4OG2F5HAH.1 size=62885 2023-12-03T11:28:29.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.913+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=PTX4OG2F5HAH tag=OYW0RXFZIH4N type=write size=2160037 2023-12-03T11:28:29.915 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.914+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~9SDXJQ52RYUL.0 size=1048576 2023-12-03T11:28:29.917 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.915+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~9SDXJQ52RYUL.1 size=473233 2023-12-03T11:28:29.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.918+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=9SDXJQ52RYUL tag=VHON0N426S9D type=write size=2570385 2023-12-03T11:28:29.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.919+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=3NHHB938YS0M type=del size=983279 2023-12-03T11:28:29.921 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.920+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=2HU4GOF2HGOB type=del 2023-12-03T11:28:29.922 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.921+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=YM7LX40GPNCO type=write size=247418 2023-12-03T11:28:29.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.923+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~BVX3YYZA1ACZ.0 size=1020239 2023-12-03T11:28:29.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.925+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=BVX3YYZA1ACZ tag=623JT1GSW1OP type=write size=2068815 2023-12-03T11:28:29.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.929+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~W02UI8IQCS1S.0 size=974254 2023-12-03T11:28:29.930 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.929+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=W02UI8IQCS1S tag=UQ0MO1X41SW5 type=write size=2022830 2023-12-03T11:28:29.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.930+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~4PX39BWWWCKT.0 size=112189 2023-12-03T11:28:29.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.932+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=4PX39BWWWCKT tag=1Y1AXA6PVLBX type=write size=1160765 2023-12-03T11:28:29.934 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.933+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=8I5VHQAX0GXJ type=del size=2974372 2023-12-03T11:28:29.935 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.934+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~TKS3NRV1NTRV.0 size=1048576 2023-12-03T11:28:29.936 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.935+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~TKS3NRV1NTRV.1 size=1048576 2023-12-03T11:28:29.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.936+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~TKS3NRV1NTRV.2 size=524945 2023-12-03T11:28:29.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.938+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=TKS3NRV1NTRV tag=QFLEF71FVY12 type=write size=3670673 2023-12-03T11:28:29.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.941+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~IIWDAYTWZ9AF.0 size=1048576 2023-12-03T11:28:29.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.942+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~IIWDAYTWZ9AF.1 size=974255 2023-12-03T11:28:29.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.942+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=IIWDAYTWZ9AF tag=LSZJ8VZCQDMC type=write size=3071407 2023-12-03T11:28:29.944 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.943+0000 7fe67fa49780 1 < completed write operation key=URVD2U16EW75 tag=KYFRGFKPZDW4 type=write size=46532 2023-12-03T11:28:29.945 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.944+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=SHEP3XXFVSB4 type=del size=4107952 2023-12-03T11:28:29.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.945+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=MUMYZHRQSPXF type=del 2023-12-03T11:28:29.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.947+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~BZXDSOW2O5G9.0 size=1048576 2023-12-03T11:28:29.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.948+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~BZXDSOW2O5G9.1 size=1048576 2023-12-03T11:28:29.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.949+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~BZXDSOW2O5G9.2 size=899016 2023-12-03T11:28:29.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.949+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=BZXDSOW2O5G9 tag=CBIDQE7H79BL type=write size=4044744 2023-12-03T11:28:29.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.949+0000 7fe67fa49780 1 < canceled part key=_multipart_983BDZLASC3S.2~DMYX0USTYO4D.0 size=1048576 2023-12-03T11:28:29.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.950+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~DMYX0USTYO4D.1 size=741158 2023-12-03T11:28:29.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.952+0000 7fe67fa49780 1 < canceled multipart upload key=983BDZLASC3S upload=DMYX0USTYO4D tag=I0W746EQUONX type=write size=2838310 2023-12-03T11:28:29.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.953+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=0A8SCQ5GIHU0 type=del size=2098951 2023-12-03T11:28:29.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.955+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~VVCH0CKI1HGB.0 size=1048576 2023-12-03T11:28:29.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.956+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~VVCH0CKI1HGB.1 size=1048576 2023-12-03T11:28:29.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.957+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~VVCH0CKI1HGB.2 size=549287 2023-12-03T11:28:29.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.959+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=VVCH0CKI1HGB tag=7TZWAEFDJ2FF type=write size=3695015 2023-12-03T11:28:29.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.961+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~3A3568LO899I.0 size=291363 2023-12-03T11:28:29.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.961+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=3A3568LO899I tag=CCHYQU43KL6Q type=write size=1339939 2023-12-03T11:28:29.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.962+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=JGCSPVRLUUIZ type=del 2023-12-03T11:28:29.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.964+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=GW492T6JEV3I type=del size=3813063 2023-12-03T11:28:29.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.965+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~VOW3DBLHL8UV.0 size=1048576 2023-12-03T11:28:29.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.966+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~VOW3DBLHL8UV.1 size=813494 2023-12-03T11:28:29.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.968+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=VOW3DBLHL8UV tag=NSXXXBOFZ5KJ type=write size=2910646 2023-12-03T11:28:29.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.969+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=8HMC704SQCD1 type=write size=914358 2023-12-03T11:28:29.971 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.970+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~LZ99OSRSQ1KC.0 size=1048576 2023-12-03T11:28:29.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.971+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~LZ99OSRSQ1KC.1 size=1048576 2023-12-03T11:28:29.973 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.972+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~LZ99OSRSQ1KC.2 size=630210 2023-12-03T11:28:29.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.974+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=LZ99OSRSQ1KC tag=PSD8P81T0MQI type=write size=3775938 2023-12-03T11:28:29.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.977+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=K6YYHO4I73S3 type=del size=3868156 2023-12-03T11:28:29.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.978+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=FXQ68AKH0QPJ type=del 2023-12-03T11:28:29.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.979+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=1387JQ1G75R1 type=del size=2180000 2023-12-03T11:28:29.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.980+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~6HXM4TODCL2I.0 size=1048576 2023-12-03T11:28:29.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.981+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~6HXM4TODCL2I.1 size=1048576 2023-12-03T11:28:29.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.981+0000 7fe67fa49780 1 < canceled part key=_multipart_ASODFGLQ5VNY.2~6HXM4TODCL2I.2 size=23443 2023-12-03T11:28:29.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.983+0000 7fe67fa49780 1 < canceled multipart upload key=ASODFGLQ5VNY upload=6HXM4TODCL2I tag=ISIMCK4YPX1K type=write size=3169171 2023-12-03T11:28:29.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.984+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=GSCNVFYKLUNP type=del size=2125744 2023-12-03T11:28:29.986 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.985+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~SB1ZCM640G58.0 size=288160 2023-12-03T11:28:29.988 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.987+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=SB1ZCM640G58 tag=G45FPHQR8OY3 type=write size=1336736 2023-12-03T11:28:29.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.988+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=THVAWCWJVNYT type=del size=2178130 2023-12-03T11:28:29.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.990+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~PTX4OG2F5HAH.0 size=1048576 2023-12-03T11:28:29.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.991+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~PTX4OG2F5HAH.1 size=62885 2023-12-03T11:28:29.993 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.993+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=PTX4OG2F5HAH tag=OYW0RXFZIH4N type=write size=2160037 2023-12-03T11:28:29.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.994+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=JXL7PQCUC5AH type=del size=4026164 2023-12-03T11:28:29.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.995+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=3NHHB938YS0M type=del 2023-12-03T11:28:29.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.997+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~A2CVF0G5BB4N.0 size=199698 2023-12-03T11:28:29.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.997+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=A2CVF0G5BB4N tag=RP4Z7BCQGTVM type=write size=1248274 2023-12-03T11:28:30.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:29.999+0000 7fe67fa49780 1 < suggested update operation key=0GQZY07Y2PVI tag=YM7LX40GPNCO type=write size=247418 2023-12-03T11:28:30.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.002+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~U5WTUXX70FH4.0 size=1048576 2023-12-03T11:28:30.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.003+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~U5WTUXX70FH4.1 size=914752 2023-12-03T11:28:30.004 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.003+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=U5WTUXX70FH4 tag=0WI1IJF6UZHG type=write size=3011904 2023-12-03T11:28:30.005 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.004+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~W02UI8IQCS1S.0 size=974254 2023-12-03T11:28:30.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.006+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=W02UI8IQCS1S tag=UQ0MO1X41SW5 type=write size=2022830 2023-12-03T11:28:30.008 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.007+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=CWWJDO0COLUB type=write size=404197 2023-12-03T11:28:30.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.008+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=8I5VHQAX0GXJ type=del 2023-12-03T11:28:30.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.010+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~H9UH13D83F6U.0 size=58222 2023-12-03T11:28:30.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.010+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=H9UH13D83F6U tag=NOQ5TZTEMNKQ type=write size=1106798 2023-12-03T11:28:30.012 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.012+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~IIWDAYTWZ9AF.0 size=1048576 2023-12-03T11:28:30.013 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.012+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~IIWDAYTWZ9AF.1 size=974255 2023-12-03T11:28:30.015 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.014+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=IIWDAYTWZ9AF tag=LSZJ8VZCQDMC type=write size=3071407 2023-12-03T11:28:30.018 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.017+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~7Z5XO2YWMYHW.0 size=799862 2023-12-03T11:28:30.018 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.017+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=7Z5XO2YWMYHW tag=CUZW8SVNRFOK type=write size=1848438 2023-12-03T11:28:30.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.018+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=SHEP3XXFVSB4 type=del 2023-12-03T11:28:30.020 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.019+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=BAH0RV8V9QQR type=write size=888172 2023-12-03T11:28:30.020 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.019+0000 7fe67fa49780 1 < canceled part key=_multipart_YEMPVKMDANPG.2~BZXDSOW2O5G9.0 size=1048576 2023-12-03T11:28:30.021 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.020+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~BZXDSOW2O5G9.1 size=1048576 2023-12-03T11:28:30.022 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.021+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~BZXDSOW2O5G9.2 size=899016 2023-12-03T11:28:30.024 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.023+0000 7fe67fa49780 1 < canceled multipart upload key=YEMPVKMDANPG upload=BZXDSOW2O5G9 tag=CBIDQE7H79BL type=write size=4044744 2023-12-03T11:28:30.026 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.025+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~MYKUTCJ2DNOK.0 size=264662 2023-12-03T11:28:30.026 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.025+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=MYKUTCJ2DNOK tag=AKIG8RIQW0PK type=write size=1313238 2023-12-03T11:28:30.027 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.026+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=0A8SCQ5GIHU0 type=del 2023-12-03T11:28:30.028 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.028+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=1W6KJC9NK2RX type=del size=706142 2023-12-03T11:28:30.029 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.028+0000 7fe67fa49780 1 < canceled part key=_multipart_Q6GBIBMIJRKV.2~3A3568LO899I.0 size=291363 2023-12-03T11:28:30.031 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.030+0000 7fe67fa49780 1 < canceled multipart upload key=Q6GBIBMIJRKV upload=3A3568LO899I tag=CCHYQU43KL6Q type=write size=1339939 2023-12-03T11:28:30.033 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.032+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~T47EVDN3XNG3.0 size=642105 2023-12-03T11:28:30.033 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.032+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=T47EVDN3XNG3 tag=YMP8O8Z15LJM type=write size=1690681 2023-12-03T11:28:30.034 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.033+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=GW492T6JEV3I type=del 2023-12-03T11:28:30.036 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.035+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~JCMSOBU61I1M.0 size=1048576 2023-12-03T11:28:30.037 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.036+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~JCMSOBU61I1M.1 size=1048576 2023-12-03T11:28:30.038 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.037+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~JCMSOBU61I1M.2 size=216826 2023-12-03T11:28:30.038 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.037+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=JCMSOBU61I1M tag=XM8EI050Q23B type=write size=3362554 2023-12-03T11:28:30.040 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.039+0000 7fe67fa49780 1 < completed write operation key=IIW1Y6QYEODQ tag=8HMC704SQCD1 type=write size=914358 2023-12-03T11:28:30.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.041+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=D8FAMUG9N20W type=write size=19089 2023-12-03T11:28:30.043 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.042+0000 7fe67fa49780 -1 < failed to complete operation key=0GQZY07Y2PVI tag=K6YYHO4I73S3 type=del size=3868156: (22) Invalid argument 2023-12-03T11:28:30.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.043+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=8Q2U7GXDJRLG type=write size=333089 2023-12-03T11:28:30.046 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.045+0000 7fe67fa49780 1 < suggested update operation key=Y0VRZR6S8FP6 tag=1387JQ1G75R1 type=del size=2180000 2023-12-03T11:28:30.047 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.047+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=EZ8AB1CIDJOI type=write size=195494 2023-12-03T11:28:30.049 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.048+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=GSCNVFYKLUNP type=del 2023-12-03T11:28:30.050 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.049+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=BW26ROHSU623 type=del size=3903454 2023-12-03T11:28:30.051 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.050+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=THVAWCWJVNYT type=del 2023-12-03T11:28:30.053 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.052+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~0W1PT9PVVNMZ.0 size=1048576 2023-12-03T11:28:30.054 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.053+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~0W1PT9PVVNMZ.1 size=54250 2023-12-03T11:28:30.054 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.053+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=0W1PT9PVVNMZ tag=TWN7DPJR4STV type=write size=2151402 2023-12-03T11:28:30.055 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.054+0000 7fe67fa49780 1 < canceled operation key=IIW1Y6QYEODQ tag=JXL7PQCUC5AH type=del size=4026164 2023-12-03T11:28:30.056 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.055+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=TVAD8KNN4SR0 type=del size=1774102 2023-12-03T11:28:30.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.057+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~A2CVF0G5BB4N.0 size=199698 2023-12-03T11:28:30.061 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.060+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=A2CVF0G5BB4N tag=RP4Z7BCQGTVM type=write size=1248274 2023-12-03T11:28:30.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.061+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=STTLNLV4LSL4 type=del size=3162595 2023-12-03T11:28:30.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.062+0000 7fe67fa49780 1 < canceled part key=_multipart_KMC5YD2M3I45.2~U5WTUXX70FH4.0 size=1048576 2023-12-03T11:28:30.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.063+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~U5WTUXX70FH4.1 size=914752 2023-12-03T11:28:30.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.065+0000 7fe67fa49780 1 < canceled multipart upload key=KMC5YD2M3I45 upload=U5WTUXX70FH4 tag=0WI1IJF6UZHG type=write size=3011904 2023-12-03T11:28:30.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.066+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=ALH6MUCWQULY type=del size=1406108 2023-12-03T11:28:30.068 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.067+0000 7fe67fa49780 1 < completed write operation key=0GQZY07Y2PVI tag=CWWJDO0COLUB type=write size=404197 2023-12-03T11:28:30.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.069+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~UNT67UAJUV82.0 size=643726 2023-12-03T11:28:30.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.069+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=UNT67UAJUV82 tag=YR8BI6DL3GM3 type=write size=1692302 2023-12-03T11:28:30.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.070+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~H9UH13D83F6U.0 size=58222 2023-12-03T11:28:30.073 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.072+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=H9UH13D83F6U tag=NOQ5TZTEMNKQ type=write size=1106798 2023-12-03T11:28:30.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.074+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=V6O9MCBE3V5H type=del size=1442261 2023-12-03T11:28:30.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.075+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~7Z5XO2YWMYHW.0 size=799862 2023-12-03T11:28:30.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.077+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=7Z5XO2YWMYHW tag=CUZW8SVNRFOK type=write size=1848438 2023-12-03T11:28:30.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.079+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~BXQS1C8J2KRK.0 size=1048576 2023-12-03T11:28:30.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.080+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~BXQS1C8J2KRK.1 size=1048576 2023-12-03T11:28:30.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.081+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~BXQS1C8J2KRK.2 size=676159 2023-12-03T11:28:30.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.081+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=BXQS1C8J2KRK tag=T2IION2T192H type=write size=3821887 2023-12-03T11:28:30.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.082+0000 7fe67fa49780 1 < completed write operation key=H8MBLWXG7BCZ tag=BAH0RV8V9QQR type=write size=888172 2023-12-03T11:28:30.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.084+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~DULO43HU1R8P.0 size=1048576 2023-12-03T11:28:30.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.085+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~DULO43HU1R8P.1 size=1048576 2023-12-03T11:28:30.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.086+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~DULO43HU1R8P.2 size=853394 2023-12-03T11:28:30.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.086+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=DULO43HU1R8P tag=LPEI5F6V3V7O type=write size=3999122 2023-12-03T11:28:30.088 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.087+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~MYKUTCJ2DNOK.0 size=264662 2023-12-03T11:28:30.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.089+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=MYKUTCJ2DNOK tag=AKIG8RIQW0PK type=write size=1313238 2023-12-03T11:28:30.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.090+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=CXDW3Y9CFAVH type=del size=433031 2023-12-03T11:28:30.093 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.092+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=1W6KJC9NK2RX type=del 2023-12-03T11:28:30.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.094+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~UMCW8GK4GL89.0 size=935253 2023-12-03T11:28:30.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.094+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=UMCW8GK4GL89 tag=B0O2IXDMZ1OT type=write size=1983829 2023-12-03T11:28:30.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.095+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~T47EVDN3XNG3.0 size=642105 2023-12-03T11:28:30.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.097+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=T47EVDN3XNG3 tag=YMP8O8Z15LJM type=write size=1690681 2023-12-03T11:28:30.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.098+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=NW18CBLK1RNH type=del size=765294 2023-12-03T11:28:30.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.099+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~JCMSOBU61I1M.0 size=1048576 2023-12-03T11:28:30.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.100+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~JCMSOBU61I1M.1 size=1048576 2023-12-03T11:28:30.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.101+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~JCMSOBU61I1M.2 size=216826 2023-12-03T11:28:30.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.103+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=JCMSOBU61I1M tag=XM8EI050Q23B type=write size=3362554 2023-12-03T11:28:30.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.104+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=XA58JZXNCKL8 type=del size=3292913 2023-12-03T11:28:30.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.106+0000 7fe67fa49780 1 < suggested remove operation key=SXVBDBJ5B09V tag=D8FAMUG9N20W type=write 2023-12-03T11:28:30.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.108+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=GUUMB3BXLX7V type=del size=891908 2023-12-03T11:28:30.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.109+0000 7fe67fa49780 1 < completed write operation key=KMC5YD2M3I45 tag=8Q2U7GXDJRLG type=write size=333089 2023-12-03T11:28:30.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.111+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~GLLXR6KK223Z.0 size=1048576 2023-12-03T11:28:30.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.112+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~GLLXR6KK223Z.1 size=647930 2023-12-03T11:28:30.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.112+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=GLLXR6KK223Z tag=TRZA1ZFB4Y0J type=write size=2745082 2023-12-03T11:28:30.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.113+0000 7fe67fa49780 1 < completed write operation key=P05UIP1IU4Z7 tag=EZ8AB1CIDJOI type=write size=195494 2023-12-03T11:28:30.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.114+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=1K9BJKOCOEMX type=del size=3842323 2023-12-03T11:28:30.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.116+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=BW26ROHSU623 type=del 2023-12-03T11:28:30.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.117+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=ZHARYYE1WA7X type=del size=1327542 2023-12-03T11:28:30.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.118+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~0W1PT9PVVNMZ.0 size=1048576 2023-12-03T11:28:30.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.119+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~0W1PT9PVVNMZ.1 size=54250 2023-12-03T11:28:30.122 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.121+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=0W1PT9PVVNMZ tag=TWN7DPJR4STV type=write size=2151402 2023-12-03T11:28:30.123 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.122+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=JNIQ8OM8XX78 type=del size=2726610 2023-12-03T11:28:30.124 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.123+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=TVAD8KNN4SR0 type=del 2023-12-03T11:28:30.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.125+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=04VVKPOV7YFF type=del size=611871 2023-12-03T11:28:30.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.126+0000 7fe67fa49780 1 < canceled operation key=TXVHRE03Z3DA tag=STTLNLV4LSL4 type=del size=3162595 2023-12-03T11:28:30.128 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.127+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=Y5GDY3J6J3CT type=del size=1626669 2023-12-03T11:28:30.129 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.128+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=ALH6MUCWQULY type=del 2023-12-03T11:28:30.130 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.129+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=J5XY8DKS208W type=del size=1392655 2023-12-03T11:28:30.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.131+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~UNT67UAJUV82.0 size=643726 2023-12-03T11:28:30.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.133+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=UNT67UAJUV82 tag=YR8BI6DL3GM3 type=write size=1692302 2023-12-03T11:28:30.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.137+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~54M0CQ3B1I4O.0 size=1048576 2023-12-03T11:28:30.139 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.138+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~54M0CQ3B1I4O.1 size=253631 2023-12-03T11:28:30.139 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.138+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=54M0CQ3B1I4O tag=YXGLS63SF9DQ type=write size=2350783 2023-12-03T11:28:30.140 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.139+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=V6O9MCBE3V5H type=del 2023-12-03T11:28:30.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.140+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=6CI868EGSB0I type=del size=1714411 2023-12-03T11:28:30.142 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.141+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~BXQS1C8J2KRK.0 size=1048576 2023-12-03T11:28:30.143 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.142+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~BXQS1C8J2KRK.1 size=1048576 2023-12-03T11:28:30.144 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.143+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~BXQS1C8J2KRK.2 size=676159 2023-12-03T11:28:30.146 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.145+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=BXQS1C8J2KRK tag=T2IION2T192H type=write size=3821887 2023-12-03T11:28:30.147 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.146+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=59NDU8Z7KU1Y type=del size=1081783 2023-12-03T11:28:30.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.147+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~DULO43HU1R8P.0 size=1048576 2023-12-03T11:28:30.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.148+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~DULO43HU1R8P.1 size=1048576 2023-12-03T11:28:30.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.149+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~DULO43HU1R8P.2 size=853394 2023-12-03T11:28:30.153 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.152+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=DULO43HU1R8P tag=LPEI5F6V3V7O type=write size=3999122 2023-12-03T11:28:30.156 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.155+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~BZ02GFNFU73X.0 size=1048576 2023-12-03T11:28:30.157 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.156+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~BZ02GFNFU73X.1 size=991270 2023-12-03T11:28:30.157 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.156+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=BZ02GFNFU73X tag=HR1V7W7GAETD type=write size=3088422 2023-12-03T11:28:30.158 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.157+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=CXDW3Y9CFAVH type=del 2023-12-03T11:28:30.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.159+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~6YK89WJKPQB2.0 size=184179 2023-12-03T11:28:30.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.159+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=6YK89WJKPQB2 tag=H00W26WC3YIF type=write size=1232755 2023-12-03T11:28:30.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.160+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~UMCW8GK4GL89.0 size=935253 2023-12-03T11:28:30.163 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.162+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=UMCW8GK4GL89 tag=B0O2IXDMZ1OT type=write size=1983829 2023-12-03T11:28:30.164 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.163+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=X874NULFESEA type=del size=3087577 2023-12-03T11:28:30.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.164+0000 7fe67fa49780 1 < canceled operation key=PFBGR7OF7JQG tag=NW18CBLK1RNH type=del size=765294 2023-12-03T11:28:30.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.166+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=Y48TZ61RUVGR type=write size=381626 2023-12-03T11:28:30.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.168+0000 7fe67fa49780 1 < suggested remove operation key=URVD2U16EW75 tag=XA58JZXNCKL8 type=del 2023-12-03T11:28:30.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.169+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=NRSOZX6HGRSK type=del size=1308786 2023-12-03T11:28:30.173 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.172+0000 7fe67fa49780 1 < suggested update operation key=TXVHRE03Z3DA tag=GUUMB3BXLX7V type=del size=891908 2023-12-03T11:28:30.174 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.173+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=YHB72FMMGIUK type=del size=2201269 2023-12-03T11:28:30.175 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.174+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~GLLXR6KK223Z.0 size=1048576 2023-12-03T11:28:30.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.175+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~GLLXR6KK223Z.1 size=647930 2023-12-03T11:28:30.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.177+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=GLLXR6KK223Z tag=TRZA1ZFB4Y0J type=write size=2745082 2023-12-03T11:28:30.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.178+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=E60DLPP4VZAW type=write size=316857 2023-12-03T11:28:30.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.180+0000 7fe67fa49780 1 < suggested update operation key=V9ZVWHO8IF8L tag=1K9BJKOCOEMX type=del size=3842323 2023-12-03T11:28:30.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.182+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=W2YZAGX9WM0Z type=del size=1516875 2023-12-03T11:28:30.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.183+0000 7fe67fa49780 -1 < failed to complete operation key=V9ZVWHO8IF8L tag=ZHARYYE1WA7X type=del size=1327542: (22) Invalid argument 2023-12-03T11:28:30.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.185+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~04CCT1DP23DB.0 size=1048576 2023-12-03T11:28:30.187 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.186+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~04CCT1DP23DB.1 size=727853 2023-12-03T11:28:30.187 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.186+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=04CCT1DP23DB tag=2AQG2WDGREJL type=write size=2825005 2023-12-03T11:28:30.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.187+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=JNIQ8OM8XX78 type=del 2023-12-03T11:28:30.189 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.189+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=RD6ALETAQPEO type=del size=1373067 2023-12-03T11:28:30.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.191+0000 7fe67fa49780 1 < suggested remove operation key=ASODFGLQ5VNY tag=04VVKPOV7YFF type=del 2023-12-03T11:28:30.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.193+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~80ZX98UVAQ6M.0 size=578147 2023-12-03T11:28:30.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.193+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=80ZX98UVAQ6M tag=U13SQNXUEPVW type=write size=1626723 2023-12-03T11:28:30.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.194+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=Y5GDY3J6J3CT type=del 2023-12-03T11:28:30.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.197+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~63OBYB48CELH.0 size=215475 2023-12-03T11:28:30.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.197+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=63OBYB48CELH tag=ABE2S4CX1IFT type=write size=1264051 2023-12-03T11:28:30.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.199+0000 7fe67fa49780 1 < suggested remove operation key=DDHGOWEI7WEI tag=J5XY8DKS208W type=del 2023-12-03T11:28:30.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.201+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~DZI6ZK07K658.0 size=1048576 2023-12-03T11:28:30.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.202+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~DZI6ZK07K658.1 size=269369 2023-12-03T11:28:30.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.202+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=DZI6ZK07K658 tag=N64V617KLXEP type=write size=2366521 2023-12-03T11:28:30.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.203+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~54M0CQ3B1I4O.0 size=1048576 2023-12-03T11:28:30.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.204+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~54M0CQ3B1I4O.1 size=253631 2023-12-03T11:28:30.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.206+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=54M0CQ3B1I4O tag=YXGLS63SF9DQ type=write size=2350783 2023-12-03T11:28:30.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.207+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=O8EXKR9HPJL1 type=del size=3132788 2023-12-03T11:28:30.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.208+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=6CI868EGSB0I type=del 2023-12-03T11:28:30.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.209+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=PMYWTYKK3MLP type=write size=943709 2023-12-03T11:28:30.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.212+0000 7fe67fa49780 1 < suggested update operation key=XZHCD4R4EVZR tag=59NDU8Z7KU1Y type=del size=1081783 2023-12-03T11:28:30.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.214+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~8CES2NISQK5O.0 size=1048576 2023-12-03T11:28:30.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.215+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~8CES2NISQK5O.1 size=242728 2023-12-03T11:28:30.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.215+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=8CES2NISQK5O tag=ED605QUUH79X type=write size=2339880 2023-12-03T11:28:30.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.216+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~BZ02GFNFU73X.0 size=1048576 2023-12-03T11:28:30.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.217+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~BZ02GFNFU73X.1 size=991270 2023-12-03T11:28:30.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.219+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=BZ02GFNFU73X tag=HR1V7W7GAETD type=write size=3088422 2023-12-03T11:28:30.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.221+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~XYW0V8C2WB57.0 size=1048576 2023-12-03T11:28:30.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.222+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~XYW0V8C2WB57.1 size=1048576 2023-12-03T11:28:30.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.223+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~XYW0V8C2WB57.2 size=246524 2023-12-03T11:28:30.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.223+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=XYW0V8C2WB57 tag=M4WBKEPIN1VF type=write size=3392252 2023-12-03T11:28:30.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.224+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~6YK89WJKPQB2.0 size=184179 2023-12-03T11:28:30.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.226+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=6YK89WJKPQB2 tag=H00W26WC3YIF type=write size=1232755 2023-12-03T11:28:30.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.227+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=TYQFTVZVIR3Q type=del size=2969206 2023-12-03T11:28:30.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.229+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=X874NULFESEA type=del 2023-12-03T11:28:30.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.230+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=EDRU4EKSEPLD type=write size=552694 2023-12-03T11:28:30.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.231+0000 7fe67fa49780 1 < completed write operation key=IIW1Y6QYEODQ tag=Y48TZ61RUVGR type=write size=381626 2023-12-03T11:28:30.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.232+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=J0M0DJ7S92FL type=del size=3392862 2023-12-03T11:28:30.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.233+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=NRSOZX6HGRSK type=del 2023-12-03T11:28:30.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.235+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~9BCL2MM42X95.0 size=1048576 2023-12-03T11:28:30.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.236+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~9BCL2MM42X95.1 size=104741 2023-12-03T11:28:30.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.236+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=9BCL2MM42X95 tag=YVP04R1QB6E6 type=write size=2201893 2023-12-03T11:28:30.238 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.237+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=YHB72FMMGIUK type=del 2023-12-03T11:28:30.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.239+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~QI9FYV5GUE0T.0 size=913593 2023-12-03T11:28:30.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.239+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=QI9FYV5GUE0T tag=A1UD3MTMSELB type=write size=1962169 2023-12-03T11:28:30.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.241+0000 7fe67fa49780 1 < suggested remove operation key=OH2XUEEYL9JO tag=E60DLPP4VZAW type=write 2023-12-03T11:28:30.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.242+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=SOAD04O0SFRC type=del size=641694 2023-12-03T11:28:30.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.243+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=W2YZAGX9WM0Z type=del 2023-12-03T11:28:30.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.245+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~UV0CA1Z3QJGU.0 size=1048576 2023-12-03T11:28:30.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.246+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~UV0CA1Z3QJGU.1 size=1048576 2023-12-03T11:28:30.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.247+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~UV0CA1Z3QJGU.2 size=828176 2023-12-03T11:28:30.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.247+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=UV0CA1Z3QJGU tag=NLGOZZ5ZT4GS type=write size=3973904 2023-12-03T11:28:30.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.248+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~04CCT1DP23DB.0 size=1048576 2023-12-03T11:28:30.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.249+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~04CCT1DP23DB.1 size=727853 2023-12-03T11:28:30.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.251+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=04CCT1DP23DB tag=2AQG2WDGREJL type=write size=2825005 2023-12-03T11:28:30.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.252+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=4CRIU9UH76H3 type=del size=3215239 2023-12-03T11:28:30.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.253+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=RD6ALETAQPEO type=del 2023-12-03T11:28:30.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.254+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=0S6TBDTCF2VY type=del size=1570096 2023-12-03T11:28:30.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.255+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~80ZX98UVAQ6M.0 size=578147 2023-12-03T11:28:30.258 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.257+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=80ZX98UVAQ6M tag=U13SQNXUEPVW type=write size=1626723 2023-12-03T11:28:30.259 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.258+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=2BYFCZ391VM6 type=del size=3878272 2023-12-03T11:28:30.260 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.260+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~63OBYB48CELH.0 size=215475 2023-12-03T11:28:30.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.262+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=63OBYB48CELH tag=ABE2S4CX1IFT type=write size=1264051 2023-12-03T11:28:30.264 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.263+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=2LHYNAQF0LH5 type=del size=1638925 2023-12-03T11:28:30.266 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.265+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~DZI6ZK07K658.0 size=1048576 2023-12-03T11:28:30.267 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.266+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~DZI6ZK07K658.1 size=269369 2023-12-03T11:28:30.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.268+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=DZI6ZK07K658 tag=N64V617KLXEP type=write size=2366521 2023-12-03T11:28:30.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.270+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=7XE431QGE5CL type=del size=2719161 2023-12-03T11:28:30.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.271+0000 7fe67fa49780 -1 < failed to complete operation key=OH2XUEEYL9JO tag=O8EXKR9HPJL1 type=del size=3132788: (22) Invalid argument 2023-12-03T11:28:30.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.272+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=8TJO1ML7PUJ1 type=del size=3622034 2023-12-03T11:28:30.274 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.273+0000 7fe67fa49780 1 < completed write operation key=A7GOX2W0WB83 tag=PMYWTYKK3MLP type=write size=943709 2023-12-03T11:28:30.276 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.275+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=FJXXL987IDVC type=del size=3932163 2023-12-03T11:28:30.277 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.276+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~8CES2NISQK5O.0 size=1048576 2023-12-03T11:28:30.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.277+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~8CES2NISQK5O.1 size=242728 2023-12-03T11:28:30.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.279+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=8CES2NISQK5O tag=ED605QUUH79X type=write size=2339880 2023-12-03T11:28:30.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.281+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~943H6CH8U6O5.0 size=1048576 2023-12-03T11:28:30.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.282+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~943H6CH8U6O5.1 size=1048576 2023-12-03T11:28:30.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.283+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~943H6CH8U6O5.2 size=904671 2023-12-03T11:28:30.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.283+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=943H6CH8U6O5 tag=SWXZ1F6ZEQ95 type=write size=4050399 2023-12-03T11:28:30.285 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.284+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~XYW0V8C2WB57.0 size=1048576 2023-12-03T11:28:30.286 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.285+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~XYW0V8C2WB57.1 size=1048576 2023-12-03T11:28:30.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.287+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~XYW0V8C2WB57.2 size=246524 2023-12-03T11:28:30.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.289+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=XYW0V8C2WB57 tag=M4WBKEPIN1VF type=write size=3392252 2023-12-03T11:28:30.292 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.291+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~EU4U15X03IZ6.0 size=1048576 2023-12-03T11:28:30.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.292+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~EU4U15X03IZ6.1 size=1048576 2023-12-03T11:28:30.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.293+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~EU4U15X03IZ6.2 size=857821 2023-12-03T11:28:30.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.293+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=EU4U15X03IZ6 tag=IW9Z1T5RZBPC type=write size=4003549 2023-12-03T11:28:30.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.295+0000 7fe67fa49780 1 < suggested remove operation key=N87KA638VE01 tag=TYQFTVZVIR3Q type=del 2023-12-03T11:28:30.297 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.296+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=FB73FLWA5KV0 type=write size=423105 2023-12-03T11:28:30.300 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.298+0000 7fe67fa49780 1 < suggested update operation key=TXVHRE03Z3DA tag=EDRU4EKSEPLD type=write size=552694 2023-12-03T11:28:30.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.300+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~XKBEE16UL87A.0 size=1048576 2023-12-03T11:28:30.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.301+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~XKBEE16UL87A.1 size=699515 2023-12-03T11:28:30.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.301+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=XKBEE16UL87A tag=83XGSYI1AHBB type=write size=2796667 2023-12-03T11:28:30.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.302+0000 7fe67fa49780 -1 < failed to complete operation key=N87KA638VE01 tag=J0M0DJ7S92FL type=del size=3392862: (22) Invalid argument 2023-12-03T11:28:30.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.303+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=JFGMOA47NY1D type=write size=228310 2023-12-03T11:28:30.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.303+0000 7fe67fa49780 1 < canceled part key=_multipart_6LQ18VAE3ZN6.2~9BCL2MM42X95.0 size=1048576 2023-12-03T11:28:30.305 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.304+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~9BCL2MM42X95.1 size=104741 2023-12-03T11:28:30.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.306+0000 7fe67fa49780 1 < canceled multipart upload key=6LQ18VAE3ZN6 upload=9BCL2MM42X95 tag=YVP04R1QB6E6 type=write size=2201893 2023-12-03T11:28:30.308 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.307+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=ZE0DJ0MCV5X5 type=del size=1195888 2023-12-03T11:28:30.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.308+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~QI9FYV5GUE0T.0 size=913593 2023-12-03T11:28:30.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.310+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=QI9FYV5GUE0T tag=A1UD3MTMSELB type=write size=1962169 2023-12-03T11:28:30.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.312+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~KMOIQWDP3CTX.0 size=1048576 2023-12-03T11:28:30.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.313+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~KMOIQWDP3CTX.1 size=1048576 2023-12-03T11:28:30.315 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.314+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~KMOIQWDP3CTX.2 size=693953 2023-12-03T11:28:30.315 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.314+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=KMOIQWDP3CTX tag=9T4EZK9YICLN type=write size=3839681 2023-12-03T11:28:30.316 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.315+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=SOAD04O0SFRC type=del 2023-12-03T11:28:30.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.317+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~QTCBQEM0LAJI.0 size=1048576 2023-12-03T11:28:30.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.318+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~QTCBQEM0LAJI.1 size=832917 2023-12-03T11:28:30.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.318+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=QTCBQEM0LAJI tag=6GA3N87B3XJS type=write size=2930069 2023-12-03T11:28:30.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.319+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~UV0CA1Z3QJGU.0 size=1048576 2023-12-03T11:28:30.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.319+0000 7fe67fa49780 1 < canceled part key=_multipart_ASODFGLQ5VNY.2~UV0CA1Z3QJGU.1 size=1048576 2023-12-03T11:28:30.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.320+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~UV0CA1Z3QJGU.2 size=828176 2023-12-03T11:28:30.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.322+0000 7fe67fa49780 1 < canceled multipart upload key=ASODFGLQ5VNY upload=UV0CA1Z3QJGU tag=NLGOZZ5ZT4GS type=write size=3973904 2023-12-03T11:28:30.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.323+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=OB2J0KPI9OHP type=del size=2390534 2023-12-03T11:28:30.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.324+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=4CRIU9UH76H3 type=del 2023-12-03T11:28:30.326 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.325+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=CISR3RH1CURU type=del size=2229746 2023-12-03T11:28:30.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.326+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=0S6TBDTCF2VY type=del 2023-12-03T11:28:30.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.328+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=NUIH0QBM56IV type=del size=1473649 2023-12-03T11:28:30.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.329+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=2BYFCZ391VM6 type=del 2023-12-03T11:28:30.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.330+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=EY87USOXVV0B type=del size=1199876 2023-12-03T11:28:30.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.331+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=2LHYNAQF0LH5 type=del 2023-12-03T11:28:30.334 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.333+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~BNKBXE3D8UVJ.0 size=1048576 2023-12-03T11:28:30.335 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.334+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~BNKBXE3D8UVJ.1 size=1739 2023-12-03T11:28:30.335 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.334+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=BNKBXE3D8UVJ tag=H3HYC5ON3VSY type=write size=2098891 2023-12-03T11:28:30.336 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.335+0000 7fe67fa49780 1 < canceled operation key=006X4CSXV0KA tag=7XE431QGE5CL type=del size=2719161 2023-12-03T11:28:30.338 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.337+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~XTJA5J1FFEBR.0 size=1048576 2023-12-03T11:28:30.339 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.338+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~XTJA5J1FFEBR.1 size=1048576 2023-12-03T11:28:30.339 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.339+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~XTJA5J1FFEBR.2 size=846054 2023-12-03T11:28:30.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.339+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=XTJA5J1FFEBR tag=TDOIY5TM090E type=write size=3991782 2023-12-03T11:28:30.344 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.343+0000 7fe67fa49780 1 < suggested remove operation key=0G8KNJBJ9K1Z tag=8TJO1ML7PUJ1 type=del 2023-12-03T11:28:30.346 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.345+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~N5JRZXHYHLAA.0 size=1048576 2023-12-03T11:28:30.347 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.346+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~N5JRZXHYHLAA.1 size=717195 2023-12-03T11:28:30.347 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.346+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=N5JRZXHYHLAA tag=LX2U7MQT7HQP type=write size=2814347 2023-12-03T11:28:30.348 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.347+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=FJXXL987IDVC type=del 2023-12-03T11:28:30.349 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.348+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=J7CSBZ3F7DRF type=del size=1047067 2023-12-03T11:28:30.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.349+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~943H6CH8U6O5.0 size=1048576 2023-12-03T11:28:30.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.350+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~943H6CH8U6O5.1 size=1048576 2023-12-03T11:28:30.352 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.351+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~943H6CH8U6O5.2 size=904671 2023-12-03T11:28:30.353 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.353+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=943H6CH8U6O5 tag=SWXZ1F6ZEQ95 type=write size=4050399 2023-12-03T11:28:30.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.354+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~ZFH12IG96MT3.0 size=1048576 2023-12-03T11:28:30.356 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.355+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~ZFH12IG96MT3.1 size=1048576 2023-12-03T11:28:30.357 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.356+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~ZFH12IG96MT3.2 size=789324 2023-12-03T11:28:30.357 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.356+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=ZFH12IG96MT3 tag=PDI02NQ4GQK4 type=write size=3935052 2023-12-03T11:28:30.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.357+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~EU4U15X03IZ6.0 size=1048576 2023-12-03T11:28:30.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.358+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~EU4U15X03IZ6.1 size=1048576 2023-12-03T11:28:30.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.359+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~EU4U15X03IZ6.2 size=857821 2023-12-03T11:28:30.362 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.361+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=EU4U15X03IZ6 tag=IW9Z1T5RZBPC type=write size=4003549 2023-12-03T11:28:30.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.362+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=UWKUKEKT73U2 type=del size=1388474 2023-12-03T11:28:30.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.363+0000 7fe67fa49780 1 < completed write operation key=N87KA638VE01 tag=FB73FLWA5KV0 type=write size=423105 2023-12-03T11:28:30.366 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.364+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=TDT14O8D7ET5 type=write size=358612 2023-12-03T11:28:30.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.366+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~XKBEE16UL87A.0 size=1048576 2023-12-03T11:28:30.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.367+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~XKBEE16UL87A.1 size=699515 2023-12-03T11:28:30.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.370+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=XKBEE16UL87A tag=83XGSYI1AHBB type=write size=2796667 2023-12-03T11:28:30.375 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.374+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~B7MVU40Y43EA.0 size=1048576 2023-12-03T11:28:30.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.375+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~B7MVU40Y43EA.1 size=1048576 2023-12-03T11:28:30.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.377+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~B7MVU40Y43EA.2 size=857103 2023-12-03T11:28:30.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.377+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=B7MVU40Y43EA tag=X7Z9GNPJ3V5E type=write size=4002831 2023-12-03T11:28:30.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.380+0000 7fe67fa49780 1 < completed write operation key=V9ZVWHO8IF8L tag=JFGMOA47NY1D type=write size=228310 2023-12-03T11:28:30.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.382+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~TZLY18BQPHDV.0 size=277136 2023-12-03T11:28:30.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.382+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=TZLY18BQPHDV tag=8MTVDE61QL2W type=write size=1325712 2023-12-03T11:28:30.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.384+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=ZE0DJ0MCV5X5 type=del 2023-12-03T11:28:30.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.385+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=WSKBJ5GOIR0M type=write size=78191 2023-12-03T11:28:30.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.386+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~KMOIQWDP3CTX.0 size=1048576 2023-12-03T11:28:30.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.387+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~KMOIQWDP3CTX.1 size=1048576 2023-12-03T11:28:30.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.388+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~KMOIQWDP3CTX.2 size=693953 2023-12-03T11:28:30.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.390+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=KMOIQWDP3CTX tag=9T4EZK9YICLN type=write size=3839681 2023-12-03T11:28:30.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.391+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=R7P5WFTDW37O type=del size=1128696 2023-12-03T11:28:30.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.392+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~QTCBQEM0LAJI.0 size=1048576 2023-12-03T11:28:30.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.393+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~QTCBQEM0LAJI.1 size=832917 2023-12-03T11:28:30.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.395+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=QTCBQEM0LAJI tag=6GA3N87B3XJS type=write size=2930069 2023-12-03T11:28:30.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.396+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=0ESB3M1NJJPQ type=del size=2443039 2023-12-03T11:28:30.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.398+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=OB2J0KPI9OHP type=del 2023-12-03T11:28:30.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.399+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=YL9LVPBW0WXW type=del size=753895 2023-12-03T11:28:30.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.400+0000 7fe67fa49780 1 < canceled operation key=SXVBDBJ5B09V tag=CISR3RH1CURU type=del size=2229746 2023-12-03T11:28:30.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.401+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=HZ93GXIL9DB6 type=del size=1559732 2023-12-03T11:28:30.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.402+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=NUIH0QBM56IV type=del 2023-12-03T11:28:30.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.403+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=XJZF0WGQ4TSN type=write size=589359 2023-12-03T11:28:30.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.405+0000 7fe67fa49780 1 < canceled operation key=2GX6IWVZH25N tag=EY87USOXVV0B type=del size=1199876 2023-12-03T11:28:30.407 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.406+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=CN9MYO0YO21T type=write size=512856 2023-12-03T11:28:30.407 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.406+0000 7fe67fa49780 1 < canceled part key=_multipart_SIES92K9QVJV.2~BNKBXE3D8UVJ.0 size=1048576 2023-12-03T11:28:30.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.407+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~BNKBXE3D8UVJ.1 size=1739 2023-12-03T11:28:30.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.409+0000 7fe67fa49780 1 < canceled multipart upload key=SIES92K9QVJV upload=BNKBXE3D8UVJ tag=H3HYC5ON3VSY type=write size=2098891 2023-12-03T11:28:30.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.410+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=Z2U29FTOELWE type=del size=665479 2023-12-03T11:28:30.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.411+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~XTJA5J1FFEBR.0 size=1048576 2023-12-03T11:28:30.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.412+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~XTJA5J1FFEBR.1 size=1048576 2023-12-03T11:28:30.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.413+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~XTJA5J1FFEBR.2 size=846054 2023-12-03T11:28:30.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.415+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=XTJA5J1FFEBR tag=TDOIY5TM090E type=write size=3991782 2023-12-03T11:28:30.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.416+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=KM6M9LTSUPTE type=del size=1851744 2023-12-03T11:28:30.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.418+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~N5JRZXHYHLAA.0 size=1048576 2023-12-03T11:28:30.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.419+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~N5JRZXHYHLAA.1 size=717195 2023-12-03T11:28:30.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.421+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=N5JRZXHYHLAA tag=LX2U7MQT7HQP type=write size=2814347 2023-12-03T11:28:30.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.422+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=Y2RAR81U4HU1 type=del size=320009 2023-12-03T11:28:30.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.423+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=J7CSBZ3F7DRF type=del 2023-12-03T11:28:30.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.425+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=AF42ZHYJPLH5 type=del size=1424588 2023-12-03T11:28:30.427 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.426+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~ZFH12IG96MT3.0 size=1048576 2023-12-03T11:28:30.428 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.427+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~ZFH12IG96MT3.1 size=1048576 2023-12-03T11:28:30.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.428+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~ZFH12IG96MT3.2 size=789324 2023-12-03T11:28:30.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.430+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=ZFH12IG96MT3 tag=PDI02NQ4GQK4 type=write size=3935052 2023-12-03T11:28:30.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.431+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=BU08HP4XR1O5 type=write size=22554 2023-12-03T11:28:30.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.434+0000 7fe67fa49780 1 < suggested update operation key=006X4CSXV0KA tag=UWKUKEKT73U2 type=del size=1388474 2023-12-03T11:28:30.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.435+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=N7HR6ETH9B1N type=del size=3613260 2023-12-03T11:28:30.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.436+0000 7fe67fa49780 1 < completed write operation key=H8MBLWXG7BCZ tag=TDT14O8D7ET5 type=write size=358612 2023-12-03T11:28:30.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.437+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=9TXKNJX0Q3G8 type=del size=920000 2023-12-03T11:28:30.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.439+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~B7MVU40Y43EA.0 size=1048576 2023-12-03T11:28:30.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.440+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~B7MVU40Y43EA.1 size=1048576 2023-12-03T11:28:30.442 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.441+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~B7MVU40Y43EA.2 size=857103 2023-12-03T11:28:30.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.443+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=B7MVU40Y43EA tag=X7Z9GNPJ3V5E type=write size=4002831 2023-12-03T11:28:30.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.444+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=NVKJ755DUY3R type=del size=580931 2023-12-03T11:28:30.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.445+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~TZLY18BQPHDV.0 size=277136 2023-12-03T11:28:30.448 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.447+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=TZLY18BQPHDV tag=8MTVDE61QL2W type=write size=1325712 2023-12-03T11:28:30.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.448+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=X2TJCO9M10SQ type=del size=3016253 2023-12-03T11:28:30.450 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.449+0000 7fe67fa49780 1 < completed write operation key=DDHGOWEI7WEI tag=WSKBJ5GOIR0M type=write size=78191 2023-12-03T11:28:30.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.451+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=LBBDZZ0V503A type=del size=3939489 2023-12-03T11:28:30.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.452+0000 7fe67fa49780 1 < canceled operation key=SIES92K9QVJV tag=R7P5WFTDW37O type=del size=1128696 2023-12-03T11:28:30.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.453+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=U1ZR1NMKJ53A type=del size=2483933 2023-12-03T11:28:30.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.454+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=0ESB3M1NJJPQ type=del 2023-12-03T11:28:30.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.456+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~GTEBWOUMQWF0.0 size=1048576 2023-12-03T11:28:30.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.457+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~GTEBWOUMQWF0.1 size=48101 2023-12-03T11:28:30.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.457+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=GTEBWOUMQWF0 tag=A7WUBVWV343T type=write size=2145253 2023-12-03T11:28:30.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.458+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=YL9LVPBW0WXW type=del 2023-12-03T11:28:30.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.459+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=QZFPXJ3HEY8Q type=del size=3946745 2023-12-03T11:28:30.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.462+0000 7fe67fa49780 1 < suggested update operation key=IIW1Y6QYEODQ tag=HZ93GXIL9DB6 type=del size=1559732 2023-12-03T11:28:30.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.464+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~QJNM0ETBQ6U3.0 size=155157 2023-12-03T11:28:30.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.464+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=QJNM0ETBQ6U3 tag=0HJJT88SLD12 type=write size=1203733 2023-12-03T11:28:30.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.465+0000 7fe67fa49780 -1 < failed to complete operation key=006X4CSXV0KA tag=XJZF0WGQ4TSN type=write size=589359: (22) Invalid argument 2023-12-03T11:28:30.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.466+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=I53RW4CVP17U type=del size=1287431 2023-12-03T11:28:30.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.467+0000 7fe67fa49780 1 < completed write operation key=9AUO0SRFTAUJ tag=CN9MYO0YO21T type=write size=512856 2023-12-03T11:28:30.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.468+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=XKYJRSKRRE5U type=del size=275802 2023-12-03T11:28:30.470 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.469+0000 7fe67fa49780 -1 < failed to complete operation key=IIW1Y6QYEODQ tag=Z2U29FTOELWE type=del size=665479: (22) Invalid argument 2023-12-03T11:28:30.471 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.470+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=5HSPOMH9NVQU type=del size=4058559 2023-12-03T11:28:30.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.473+0000 7fe67fa49780 1 < suggested remove operation key=OH2XUEEYL9JO tag=KM6M9LTSUPTE type=del 2023-12-03T11:28:30.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.475+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~VVFHA0TN7RTM.0 size=32427 2023-12-03T11:28:30.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.475+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=VVFHA0TN7RTM tag=D1383PV46EQ0 type=write size=1081003 2023-12-03T11:28:30.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.475+0000 7fe67fa49780 -1 < no bi entry to suggest for operation key=OH2XUEEYL9JO tag=Y2RAR81U4HU1 type=del size=320009: (2) No such file or directory 2023-12-03T11:28:30.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.477+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~G1HLUB2KH58I.0 size=1048576 2023-12-03T11:28:30.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.478+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~G1HLUB2KH58I.1 size=736994 2023-12-03T11:28:30.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.478+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=G1HLUB2KH58I tag=LEB9DD1C4DBK type=write size=2834146 2023-12-03T11:28:30.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.479+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=AF42ZHYJPLH5 type=del 2023-12-03T11:28:30.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.482+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~6R0RGIOMSVQ8.0 size=37098 2023-12-03T11:28:30.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.482+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=6R0RGIOMSVQ8 tag=YKWGW7I9U0IV type=write size=1085674 2023-12-03T11:28:30.484 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.483+0000 7fe67fa49780 1 < completed write operation key=0G8KNJBJ9K1Z tag=BU08HP4XR1O5 type=write size=22554 2023-12-03T11:28:30.485 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.484+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=02KNUNDPUUL4 type=del size=3211209 2023-12-03T11:28:30.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.485+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=N7HR6ETH9B1N type=del 2023-12-03T11:28:30.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.488+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=WU6442UZ05BA type=del size=407848 2023-12-03T11:28:30.490 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.489+0000 7fe67fa49780 1 < canceled operation key=Q6GBIBMIJRKV tag=9TXKNJX0Q3G8 type=del size=920000 2023-12-03T11:28:30.491 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.490+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=UE7G4MZLVZMA type=write size=199150 2023-12-03T11:28:30.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.492+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=NVKJ755DUY3R type=del 2023-12-03T11:28:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.494+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~MVWV6GB3M4X1.0 size=1048576 2023-12-03T11:28:30.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.497+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~MVWV6GB3M4X1.1 size=810141 2023-12-03T11:28:30.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.497+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=MVWV6GB3M4X1 tag=3ODL4NK2RKDH type=write size=2907293 2023-12-03T11:28:30.499 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.498+0000 7fe67fa49780 1 < canceled operation key=Z1NFEIZNYYO2 tag=X2TJCO9M10SQ type=del size=3016253 2023-12-03T11:28:30.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.501+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~40LZTHJREGM8.0 size=483799 2023-12-03T11:28:30.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.501+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=40LZTHJREGM8 tag=QNQDNIKAYB9F type=write size=1532375 2023-12-03T11:28:30.503 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.502+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=LBBDZZ0V503A type=del 2023-12-03T11:28:30.505 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.504+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~9JX3U7XLDBAY.0 size=139112 2023-12-03T11:28:30.505 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.504+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=9JX3U7XLDBAY tag=K3ZZ8UB70CRV type=write size=1187688 2023-12-03T11:28:30.507 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.506+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=U1ZR1NMKJ53A type=del 2023-12-03T11:28:30.509 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.508+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~IXE084324E8O.0 size=1048576 2023-12-03T11:28:30.510 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.509+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~IXE084324E8O.1 size=1048576 2023-12-03T11:28:30.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.510+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~IXE084324E8O.2 size=849766 2023-12-03T11:28:30.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.510+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=IXE084324E8O tag=TSELFBOZZB6W type=write size=3995494 2023-12-03T11:28:30.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.510+0000 7fe67fa49780 1 < canceled part key=_multipart_Z1NFEIZNYYO2.2~GTEBWOUMQWF0.0 size=1048576 2023-12-03T11:28:30.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.511+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~GTEBWOUMQWF0.1 size=48101 2023-12-03T11:28:30.514 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.513+0000 7fe67fa49780 1 < canceled multipart upload key=Z1NFEIZNYYO2 upload=GTEBWOUMQWF0 tag=A7WUBVWV343T type=write size=2145253 2023-12-03T11:28:30.516 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.515+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~OXTCUFYN8Y0P.0 size=1048576 2023-12-03T11:28:30.517 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.516+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~OXTCUFYN8Y0P.1 size=1048576 2023-12-03T11:28:30.518 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.517+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~OXTCUFYN8Y0P.2 size=245403 2023-12-03T11:28:30.518 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.517+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=OXTCUFYN8Y0P tag=XV9MSS4SFVP1 type=write size=3391131 2023-12-03T11:28:30.519 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.518+0000 7fe67fa49780 1 < canceled operation key=N87KA638VE01 tag=QZFPXJ3HEY8Q type=del size=3946745 2023-12-03T11:28:30.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.519+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=G609095VJ79Q type=del size=3568795 2023-12-03T11:28:30.521 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.520+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~QJNM0ETBQ6U3.0 size=155157 2023-12-03T11:28:30.524 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.523+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=QJNM0ETBQ6U3 tag=0HJJT88SLD12 type=write size=1203733 2023-12-03T11:28:30.525 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.524+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=9N65E1WV0CRR type=del size=2108202 2023-12-03T11:28:30.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.526+0000 7fe67fa49780 1 < suggested remove operation key=CIB1NZHJGO46 tag=I53RW4CVP17U type=del 2023-12-03T11:28:30.528 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.528+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=QWVBZRPA1Y96 type=write size=910779 2023-12-03T11:28:30.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.529+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=XKYJRSKRRE5U type=del 2023-12-03T11:28:30.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.530+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=RPKTT65DYK21 type=del size=2733801 2023-12-03T11:28:30.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.533+0000 7fe67fa49780 1 < suggested remove operation key=Y0VRZR6S8FP6 tag=5HSPOMH9NVQU type=del 2023-12-03T11:28:30.536 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.535+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~C03UE0T8LJA7.0 size=1048576 2023-12-03T11:28:30.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.536+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~C03UE0T8LJA7.1 size=506340 2023-12-03T11:28:30.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.536+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=C03UE0T8LJA7 tag=R1WJBP2XA8R7 type=write size=2603492 2023-12-03T11:28:30.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.536+0000 7fe67fa49780 1 < canceled part key=_multipart_DDHGOWEI7WEI.2~VVFHA0TN7RTM.0 size=32427 2023-12-03T11:28:30.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.538+0000 7fe67fa49780 1 < canceled multipart upload key=DDHGOWEI7WEI upload=VVFHA0TN7RTM tag=D1383PV46EQ0 type=write size=1081003 2023-12-03T11:28:30.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.540+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~76M74V5UMZBV.0 size=1048576 2023-12-03T11:28:30.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.541+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~76M74V5UMZBV.1 size=1048576 2023-12-03T11:28:30.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.541+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~76M74V5UMZBV.2 size=1008868 2023-12-03T11:28:30.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.541+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=76M74V5UMZBV tag=5WRLCU0IGX42 type=write size=4154596 2023-12-03T11:28:30.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.543+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~G1HLUB2KH58I.0 size=1048576 2023-12-03T11:28:30.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.544+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~G1HLUB2KH58I.1 size=736994 2023-12-03T11:28:30.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.546+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=G1HLUB2KH58I tag=LEB9DD1C4DBK type=write size=2834146 2023-12-03T11:28:30.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.547+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=M2C4P4216QBP type=del size=3244262 2023-12-03T11:28:30.549 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.548+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~6R0RGIOMSVQ8.0 size=37098 2023-12-03T11:28:30.551 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.550+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=6R0RGIOMSVQ8 tag=YKWGW7I9U0IV type=write size=1085674 2023-12-03T11:28:30.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.551+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=19HA4AJG9PBC type=del size=2045924 2023-12-03T11:28:30.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.552+0000 7fe67fa49780 -1 < no bi entry to suggest for operation key=Y0VRZR6S8FP6 tag=02KNUNDPUUL4 type=del size=3211209: (2) No such file or directory 2023-12-03T11:28:30.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.553+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=BGN77YY2CIQF type=del size=1065164 2023-12-03T11:28:30.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.554+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=WU6442UZ05BA type=del 2023-12-03T11:28:30.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.556+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~QF400MT5O6IJ.0 size=1048576 2023-12-03T11:28:30.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.557+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~QF400MT5O6IJ.1 size=1048576 2023-12-03T11:28:30.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.558+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~QF400MT5O6IJ.2 size=659078 2023-12-03T11:28:30.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.558+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=QF400MT5O6IJ tag=T1Y3VVNBF2G4 type=write size=3804806 2023-12-03T11:28:30.560 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.559+0000 7fe67fa49780 1 < completed write operation key=IIW1Y6QYEODQ tag=UE7G4MZLVZMA type=write size=199150 2023-12-03T11:28:30.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.560+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=FY1DP3498YD8 type=del size=650805 2023-12-03T11:28:30.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.562+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~MVWV6GB3M4X1.0 size=1048576 2023-12-03T11:28:30.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.563+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~MVWV6GB3M4X1.1 size=810141 2023-12-03T11:28:30.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.565+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=MVWV6GB3M4X1 tag=3ODL4NK2RKDH type=write size=2907293 2023-12-03T11:28:30.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.566+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=R1QZ5QZAV5NW type=del size=1334094 2023-12-03T11:28:30.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.567+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~40LZTHJREGM8.0 size=483799 2023-12-03T11:28:30.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.569+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=40LZTHJREGM8 tag=QNQDNIKAYB9F type=write size=1532375 2023-12-03T11:28:30.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.571+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~F476ON51A7N3.0 size=281161 2023-12-03T11:28:30.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.571+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=F476ON51A7N3 tag=7IEI4O5EC4JZ type=write size=1329737 2023-12-03T11:28:30.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.573+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~9JX3U7XLDBAY.0 size=139112 2023-12-03T11:28:30.576 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.575+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=9JX3U7XLDBAY tag=K3ZZ8UB70CRV type=write size=1187688 2023-12-03T11:28:30.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.576+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=IKBLM5GHXZI4 type=del size=1210966 2023-12-03T11:28:30.578 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.577+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~IXE084324E8O.0 size=1048576 2023-12-03T11:28:30.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.578+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~IXE084324E8O.1 size=1048576 2023-12-03T11:28:30.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.579+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~IXE084324E8O.2 size=849766 2023-12-03T11:28:30.582 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.581+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=IXE084324E8O tag=TSELFBOZZB6W type=write size=3995494 2023-12-03T11:28:30.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.583+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~96DE9PBX30M0.0 size=924864 2023-12-03T11:28:30.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.583+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=96DE9PBX30M0 tag=A30KZ3M1ISPF type=write size=1973440 2023-12-03T11:28:30.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.584+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~OXTCUFYN8Y0P.0 size=1048576 2023-12-03T11:28:30.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.585+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~OXTCUFYN8Y0P.1 size=1048576 2023-12-03T11:28:30.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.586+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~OXTCUFYN8Y0P.2 size=245403 2023-12-03T11:28:30.589 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.588+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=OXTCUFYN8Y0P tag=XV9MSS4SFVP1 type=write size=3391131 2023-12-03T11:28:30.590 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.589+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=AH9BK1Y1BYNS type=del size=176049 2023-12-03T11:28:30.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.590+0000 7fe67fa49780 1 < canceled operation key=TXVHRE03Z3DA tag=G609095VJ79Q type=del size=3568795 2023-12-03T11:28:30.592 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.592+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=LQAS57E2DHQ0 type=del size=4008382 2023-12-03T11:28:30.594 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.593+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=9N65E1WV0CRR type=del 2023-12-03T11:28:30.596 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.595+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~O2KUX59W9MQ6.0 size=1048576 2023-12-03T11:28:30.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.596+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~O2KUX59W9MQ6.1 size=402486 2023-12-03T11:28:30.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.596+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=O2KUX59W9MQ6 tag=2QECM48TBTQN type=write size=2499638 2023-12-03T11:28:30.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.597+0000 7fe67fa49780 1 < completed write operation key=8UZJU9PNWIB6 tag=QWVBZRPA1Y96 type=write size=910779 2023-12-03T11:28:30.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.599+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~FO9X4XSM5FS3.0 size=502331 2023-12-03T11:28:30.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.599+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=FO9X4XSM5FS3 tag=U4H2LBQWWP86 type=write size=1550907 2023-12-03T11:28:30.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.601+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=RPKTT65DYK21 type=del 2023-12-03T11:28:30.606 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.605+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~UB2WT6BHMEC2.0 size=985066 2023-12-03T11:28:30.606 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.605+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=UB2WT6BHMEC2 tag=5RM7I5ZJ1CTK type=write size=2033642 2023-12-03T11:28:30.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.605+0000 7fe67fa49780 1 < canceled part key=_multipart_P05UIP1IU4Z7.2~C03UE0T8LJA7.0 size=1048576 2023-12-03T11:28:30.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.606+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~C03UE0T8LJA7.1 size=506340 2023-12-03T11:28:30.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.608+0000 7fe67fa49780 1 < canceled multipart upload key=P05UIP1IU4Z7 upload=C03UE0T8LJA7 tag=R1WJBP2XA8R7 type=write size=2603492 2023-12-03T11:28:30.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.609+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=RMHDGLFYEM4E type=del size=448386 2023-12-03T11:28:30.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.610+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~76M74V5UMZBV.0 size=1048576 2023-12-03T11:28:30.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.611+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~76M74V5UMZBV.1 size=1048576 2023-12-03T11:28:30.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.612+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~76M74V5UMZBV.2 size=1008868 2023-12-03T11:28:30.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.614+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=76M74V5UMZBV tag=5WRLCU0IGX42 type=write size=4154596 2023-12-03T11:28:30.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.616+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=0B7RWI74DUWF type=write size=33341 2023-12-03T11:28:30.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.617+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=M2C4P4216QBP type=del 2023-12-03T11:28:30.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.619+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~043DWLFT42WD.0 size=1048576 2023-12-03T11:28:30.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.620+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~043DWLFT42WD.1 size=419738 2023-12-03T11:28:30.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.620+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=043DWLFT42WD tag=C2LYN1B53EXO type=write size=2516890 2023-12-03T11:28:30.622 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.621+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=19HA4AJG9PBC type=del 2023-12-03T11:28:30.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.622+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=H1ESRYX0GAZB type=del size=661348 2023-12-03T11:28:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.623+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=BGN77YY2CIQF type=del 2023-12-03T11:28:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.625+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~U5CXOOFYAVGO.0 size=1048576 2023-12-03T11:28:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.626+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~U5CXOOFYAVGO.1 size=1048576 2023-12-03T11:28:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.627+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~U5CXOOFYAVGO.2 size=537245 2023-12-03T11:28:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.627+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=U5CXOOFYAVGO tag=TTKSQGGJZZ1X type=write size=3682973 2023-12-03T11:28:30.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.628+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~QF400MT5O6IJ.0 size=1048576 2023-12-03T11:28:30.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.629+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~QF400MT5O6IJ.1 size=1048576 2023-12-03T11:28:30.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.630+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~QF400MT5O6IJ.2 size=659078 2023-12-03T11:28:30.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.632+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=QF400MT5O6IJ tag=T1Y3VVNBF2G4 type=write size=3804806 2023-12-03T11:28:30.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.633+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=Y6EPQP075GZ3 type=del size=1032076 2023-12-03T11:28:30.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.634+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=FY1DP3498YD8 type=del 2023-12-03T11:28:30.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.636+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~5QNU28POGZ5N.0 size=1048576 2023-12-03T11:28:30.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.637+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~5QNU28POGZ5N.1 size=1048576 2023-12-03T11:28:30.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.638+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~5QNU28POGZ5N.2 size=878872 2023-12-03T11:28:30.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.638+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=5QNU28POGZ5N tag=O0NLSPN83YS4 type=write size=4024600 2023-12-03T11:28:30.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.639+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=R1QZ5QZAV5NW type=del 2023-12-03T11:28:30.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.641+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~0D4S84IXGGSG.0 size=1048576 2023-12-03T11:28:30.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.642+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~0D4S84IXGGSG.1 size=1048576 2023-12-03T11:28:30.644 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.643+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~0D4S84IXGGSG.2 size=830679 2023-12-03T11:28:30.644 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.643+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=0D4S84IXGGSG tag=T4YZJD183DM6 type=write size=3976407 2023-12-03T11:28:30.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.644+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~F476ON51A7N3.0 size=281161 2023-12-03T11:28:30.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.646+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=F476ON51A7N3 tag=7IEI4O5EC4JZ type=write size=1329737 2023-12-03T11:28:30.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.648+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~SPHNURYWF0OE.0 size=1048576 2023-12-03T11:28:30.650 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.649+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~SPHNURYWF0OE.1 size=1048576 2023-12-03T11:28:30.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.650+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~SPHNURYWF0OE.2 size=7960 2023-12-03T11:28:30.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.650+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=SPHNURYWF0OE tag=AT24P4W1233I type=write size=3153688 2023-12-03T11:28:30.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.651+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=IKBLM5GHXZI4 type=del 2023-12-03T11:28:30.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.653+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~EOY70K2VX959.0 size=1048576 2023-12-03T11:28:30.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.654+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~EOY70K2VX959.1 size=463391 2023-12-03T11:28:30.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.654+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=EOY70K2VX959 tag=4PX1F5HB6VIS type=write size=2560543 2023-12-03T11:28:30.656 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.655+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~96DE9PBX30M0.0 size=924864 2023-12-03T11:28:30.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.657+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=96DE9PBX30M0 tag=A30KZ3M1ISPF type=write size=1973440 2023-12-03T11:28:30.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.658+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=1ZKU8LV15I8Q type=del size=4150624 2023-12-03T11:28:30.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.659+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=AH9BK1Y1BYNS type=del 2023-12-03T11:28:30.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.660+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=SQCB4EOXSU0U type=del size=1678385 2023-12-03T11:28:30.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.661+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=LQAS57E2DHQ0 type=del 2023-12-03T11:28:30.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.663+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=FRTOR5K13Z71 type=del size=684629 2023-12-03T11:28:30.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.663+0000 7fe67fa49780 1 < canceled part key=_multipart_0G8KNJBJ9K1Z.2~O2KUX59W9MQ6.0 size=1048576 2023-12-03T11:28:30.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.664+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~O2KUX59W9MQ6.1 size=402486 2023-12-03T11:28:30.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.666+0000 7fe67fa49780 1 < canceled multipart upload key=0G8KNJBJ9K1Z upload=O2KUX59W9MQ6 tag=2QECM48TBTQN type=write size=2499638 2023-12-03T11:28:30.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.667+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=JJMNK0N4C3WL type=del size=2953654 2023-12-03T11:28:30.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.668+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~FO9X4XSM5FS3.0 size=502331 2023-12-03T11:28:30.671 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.670+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=FO9X4XSM5FS3 tag=U4H2LBQWWP86 type=write size=1550907 2023-12-03T11:28:30.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.672+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~KMP9HIE8FWD2.0 size=1048576 2023-12-03T11:28:30.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.673+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~KMP9HIE8FWD2.1 size=648633 2023-12-03T11:28:30.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.673+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=KMP9HIE8FWD2 tag=73R060USJN74 type=write size=2745785 2023-12-03T11:28:30.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.674+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~UB2WT6BHMEC2.0 size=985066 2023-12-03T11:28:30.677 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.676+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=UB2WT6BHMEC2 tag=5RM7I5ZJ1CTK type=write size=2033642 2023-12-03T11:28:30.678 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.677+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=Y3ZG6K30R4HJ type=del size=3023364 2023-12-03T11:28:30.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.679+0000 7fe67fa49780 1 < suggested remove operation key=PFBGR7OF7JQG tag=RMHDGLFYEM4E type=del 2023-12-03T11:28:30.682 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.681+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~DS7NAG1CAG35.0 size=1048576 2023-12-03T11:28:30.683 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.682+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~DS7NAG1CAG35.1 size=1048576 2023-12-03T11:28:30.684 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.683+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~DS7NAG1CAG35.2 size=316626 2023-12-03T11:28:30.684 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.683+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=DS7NAG1CAG35 tag=8SXTXXHDUR8J type=write size=3462354 2023-12-03T11:28:30.685 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.684+0000 7fe67fa49780 1 < completed write operation key=P05UIP1IU4Z7 tag=0B7RWI74DUWF type=write size=33341 2023-12-03T11:28:30.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.685+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=ENY1S455V3AK type=del size=357072 2023-12-03T11:28:30.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.685+0000 7fe67fa49780 1 < canceled part key=_multipart_KMC5YD2M3I45.2~043DWLFT42WD.0 size=1048576 2023-12-03T11:28:30.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.685+0000 7fe67fa49780 1 < canceled part key=_multipart_KMC5YD2M3I45.2~043DWLFT42WD.1 size=419738 2023-12-03T11:28:30.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.687+0000 7fe67fa49780 1 < canceled multipart upload key=KMC5YD2M3I45 upload=043DWLFT42WD tag=C2LYN1B53EXO type=write size=2516890 2023-12-03T11:28:30.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.689+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=E1KUEIGZ1VUL type=del size=28885 2023-12-03T11:28:30.691 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.690+0000 7fe67fa49780 -1 < failed to complete operation key=PFBGR7OF7JQG tag=H1ESRYX0GAZB type=del size=661348: (22) Invalid argument 2023-12-03T11:28:30.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.692+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~EQHT3U5A6CHL.0 size=1048576 2023-12-03T11:28:30.694 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.693+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~EQHT3U5A6CHL.1 size=1048576 2023-12-03T11:28:30.694 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.693+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~EQHT3U5A6CHL.2 size=47830 2023-12-03T11:28:30.695 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.693+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=EQHT3U5A6CHL tag=C5AHNDR9597A type=write size=3193558 2023-12-03T11:28:30.696 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.695+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~U5CXOOFYAVGO.0 size=1048576 2023-12-03T11:28:30.696 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.696+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~U5CXOOFYAVGO.1 size=1048576 2023-12-03T11:28:30.697 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.696+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~U5CXOOFYAVGO.2 size=537245 2023-12-03T11:28:30.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.699+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=U5CXOOFYAVGO tag=TTKSQGGJZZ1X type=write size=3682973 2023-12-03T11:28:30.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.700+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=Q34SIPVH5PGO type=write size=896312 2023-12-03T11:28:30.702 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.701+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=Y6EPQP075GZ3 type=del 2023-12-03T11:28:30.703 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.702+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=I2BY01X0XMD3 type=write size=826480 2023-12-03T11:28:30.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.703+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~5QNU28POGZ5N.0 size=1048576 2023-12-03T11:28:30.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.704+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~5QNU28POGZ5N.1 size=1048576 2023-12-03T11:28:30.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.705+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~5QNU28POGZ5N.2 size=878872 2023-12-03T11:28:30.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.710+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=5QNU28POGZ5N tag=O0NLSPN83YS4 type=write size=4024600 2023-12-03T11:28:30.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.711+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=H5NU8MSQ9621 type=del size=2775915 2023-12-03T11:28:30.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.712+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~0D4S84IXGGSG.0 size=1048576 2023-12-03T11:28:30.714 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.713+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~0D4S84IXGGSG.1 size=1048576 2023-12-03T11:28:30.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.714+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~0D4S84IXGGSG.2 size=830679 2023-12-03T11:28:30.717 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.716+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=0D4S84IXGGSG tag=T4YZJD183DM6 type=write size=3976407 2023-12-03T11:28:30.718 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.717+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=KS7K1632FYDA type=del size=374318 2023-12-03T11:28:30.719 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.718+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~SPHNURYWF0OE.0 size=1048576 2023-12-03T11:28:30.720 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.719+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~SPHNURYWF0OE.1 size=1048576 2023-12-03T11:28:30.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.720+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~SPHNURYWF0OE.2 size=7960 2023-12-03T11:28:30.723 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.722+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=SPHNURYWF0OE tag=AT24P4W1233I type=write size=3153688 2023-12-03T11:28:30.724 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.723+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=IDBWLJC2VAJA type=del size=4122536 2023-12-03T11:28:30.725 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.724+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~EOY70K2VX959.0 size=1048576 2023-12-03T11:28:30.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.725+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~EOY70K2VX959.1 size=463391 2023-12-03T11:28:30.728 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.727+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=EOY70K2VX959 tag=4PX1F5HB6VIS type=write size=2560543 2023-12-03T11:28:30.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.729+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~VXBB7V6C76GY.0 size=1048576 2023-12-03T11:28:30.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.730+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~VXBB7V6C76GY.1 size=106884 2023-12-03T11:28:30.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.730+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=VXBB7V6C76GY tag=R136GBJG8L19 type=write size=2204036 2023-12-03T11:28:30.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.731+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=1ZKU8LV15I8Q type=del 2023-12-03T11:28:30.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.733+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~P17MKS8P416V.0 size=1048576 2023-12-03T11:28:30.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.734+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~P17MKS8P416V.1 size=1048576 2023-12-03T11:28:30.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.735+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~P17MKS8P416V.2 size=490124 2023-12-03T11:28:30.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.735+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=P17MKS8P416V tag=OF25MRINT19F type=write size=3635852 2023-12-03T11:28:30.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.736+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=SQCB4EOXSU0U type=del 2023-12-03T11:28:30.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.737+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=FKPDQXXFOR4Y type=write size=689382 2023-12-03T11:28:30.739 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.738+0000 7fe67fa49780 1 < canceled operation key=OH2XUEEYL9JO tag=FRTOR5K13Z71 type=del size=684629 2023-12-03T11:28:30.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.739+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=70YIDDJWHQH3 type=write size=445521 2023-12-03T11:28:30.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.740+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=JJMNK0N4C3WL type=del 2023-12-03T11:28:30.743 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.742+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~P8IGRKKHYOD0.0 size=1048576 2023-12-03T11:28:30.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.743+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~P8IGRKKHYOD0.1 size=930496 2023-12-03T11:28:30.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.743+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=P8IGRKKHYOD0 tag=AP52EDZ9FHGQ type=write size=3027648 2023-12-03T11:28:30.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.744+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~KMP9HIE8FWD2.0 size=1048576 2023-12-03T11:28:30.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.745+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~KMP9HIE8FWD2.1 size=648633 2023-12-03T11:28:30.748 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.747+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=KMP9HIE8FWD2 tag=73R060USJN74 type=write size=2745785 2023-12-03T11:28:30.749 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.748+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=KRNR1PISK1Q3 type=del size=2208302 2023-12-03T11:28:30.750 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.749+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=Y3ZG6K30R4HJ type=del 2023-12-03T11:28:30.751 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.750+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=7VMFTDDK46NT type=del size=3454279 2023-12-03T11:28:30.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.752+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~DS7NAG1CAG35.0 size=1048576 2023-12-03T11:28:30.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.753+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~DS7NAG1CAG35.1 size=1048576 2023-12-03T11:28:30.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.753+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~DS7NAG1CAG35.2 size=316626 2023-12-03T11:28:30.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.755+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=DS7NAG1CAG35 tag=8SXTXXHDUR8J type=write size=3462354 2023-12-03T11:28:30.757 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.756+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=M6GUMRXF3WAB type=del size=2074123 2023-12-03T11:28:30.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.758+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=ENY1S455V3AK type=del 2023-12-03T11:28:30.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.759+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=D40LRGQ6BQ16 type=del size=693185 2023-12-03T11:28:30.762 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.761+0000 7fe67fa49780 1 < suggested remove operation key=URVD2U16EW75 tag=E1KUEIGZ1VUL type=del 2023-12-03T11:28:30.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.763+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~R4HEANLU38VL.0 size=365789 2023-12-03T11:28:30.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.763+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=R4HEANLU38VL tag=YC0J42CQHF0H type=write size=1414365 2023-12-03T11:28:30.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.764+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~EQHT3U5A6CHL.0 size=1048576 2023-12-03T11:28:30.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.765+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~EQHT3U5A6CHL.1 size=1048576 2023-12-03T11:28:30.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.766+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~EQHT3U5A6CHL.2 size=47830 2023-12-03T11:28:30.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.768+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=EQHT3U5A6CHL tag=C5AHNDR9597A type=write size=3193558 2023-12-03T11:28:30.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.770+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~D0VR9KNWMKD1.0 size=1048576 2023-12-03T11:28:30.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.771+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~D0VR9KNWMKD1.1 size=1048576 2023-12-03T11:28:30.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.771+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~D0VR9KNWMKD1.2 size=74210 2023-12-03T11:28:30.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.771+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=D0VR9KNWMKD1 tag=9CTZGFYCVE7Z type=write size=3219938 2023-12-03T11:28:30.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.773+0000 7fe67fa49780 1 < completed write operation key=UL24DVOA31Y7 tag=Q34SIPVH5PGO type=write size=896312 2023-12-03T11:28:30.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.774+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=RXQYPPBGDJ49 type=del size=2091531 2023-12-03T11:28:30.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.775+0000 7fe67fa49780 1 < completed write operation key=Z1NFEIZNYYO2 tag=I2BY01X0XMD3 type=write size=826480 2023-12-03T11:28:30.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.777+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~E03E4GKIK6NY.0 size=1048576 2023-12-03T11:28:30.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.778+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~E03E4GKIK6NY.1 size=1048576 2023-12-03T11:28:30.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.779+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~E03E4GKIK6NY.2 size=261785 2023-12-03T11:28:30.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.779+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=E03E4GKIK6NY tag=M7FQAIG4VNXT type=write size=3407513 2023-12-03T11:28:30.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.780+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=H5NU8MSQ9621 type=del 2023-12-03T11:28:30.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.781+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=MP6KZDFGTZEM type=del size=1988991 2023-12-03T11:28:30.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.782+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=KS7K1632FYDA type=del 2023-12-03T11:28:30.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.783+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=C1TTXASKAX5W type=del size=2762817 2023-12-03T11:28:30.786 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.785+0000 7fe67fa49780 1 < suggested remove operation key=DDHGOWEI7WEI tag=IDBWLJC2VAJA type=del 2023-12-03T11:28:30.787 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.787+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=U1YRLJCSDYV3 type=write size=28123 2023-12-03T11:28:30.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.788+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~VXBB7V6C76GY.0 size=1048576 2023-12-03T11:28:30.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.789+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~VXBB7V6C76GY.1 size=106884 2023-12-03T11:28:30.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.791+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=VXBB7V6C76GY tag=R136GBJG8L19 type=write size=2204036 2023-12-03T11:28:30.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.793+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~E7BMXLHNLRP9.0 size=661474 2023-12-03T11:28:30.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.793+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=E7BMXLHNLRP9 tag=36QTDRU1BX3C type=write size=1710050 2023-12-03T11:28:30.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.794+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~P17MKS8P416V.0 size=1048576 2023-12-03T11:28:30.796 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.795+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~P17MKS8P416V.1 size=1048576 2023-12-03T11:28:30.797 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.796+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~P17MKS8P416V.2 size=490124 2023-12-03T11:28:30.799 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.798+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=P17MKS8P416V tag=OF25MRINT19F type=write size=3635852 2023-12-03T11:28:30.800 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.799+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=O0AS73D015P8 type=del size=1713459 2023-12-03T11:28:30.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.800+0000 7fe67fa49780 1 < completed write operation key=KMC5YD2M3I45 tag=FKPDQXXFOR4Y type=write size=689382 2023-12-03T11:28:30.803 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.802+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~DRN8NS5M2JSK.0 size=72749 2023-12-03T11:28:30.803 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.802+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=DRN8NS5M2JSK tag=PXMRFMUYV422 type=write size=1121325 2023-12-03T11:28:30.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.803+0000 7fe67fa49780 1 < completed write operation key=IIW1Y6QYEODQ tag=70YIDDJWHQH3 type=write size=445521 2023-12-03T11:28:30.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.806+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~UMX8EPCVXKI0.0 size=569825 2023-12-03T11:28:30.807 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.806+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=UMX8EPCVXKI0 tag=H0LBBNG3SBK1 type=write size=1618401 2023-12-03T11:28:30.808 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.807+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~P8IGRKKHYOD0.0 size=1048576 2023-12-03T11:28:30.809 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.808+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~P8IGRKKHYOD0.1 size=930496 2023-12-03T11:28:30.811 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.810+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=P8IGRKKHYOD0 tag=AP52EDZ9FHGQ type=write size=3027648 2023-12-03T11:28:30.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.813+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~0QDQI30S5IK0.0 size=1048576 2023-12-03T11:28:30.815 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.814+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~0QDQI30S5IK0.1 size=991619 2023-12-03T11:28:30.815 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.814+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=0QDQI30S5IK0 tag=BMF9A4W9LD50 type=write size=3088771 2023-12-03T11:28:30.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.815+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=KRNR1PISK1Q3 type=del 2023-12-03T11:28:30.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.817+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~4DDTI3Q552OC.0 size=767703 2023-12-03T11:28:30.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.817+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=4DDTI3Q552OC tag=TKJJHLYMY72U type=write size=1816279 2023-12-03T11:28:30.820 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.819+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=7VMFTDDK46NT type=del 2023-12-03T11:28:30.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.820+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=CHLYAMK2VRXD type=write size=91122 2023-12-03T11:28:30.822 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.821+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=M6GUMRXF3WAB type=del 2023-12-03T11:28:30.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.822+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=U6B2Z11SJUYW type=del size=1430465 2023-12-03T11:28:30.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.824+0000 7fe67fa49780 -1 < failed to complete operation key=URVD2U16EW75 tag=D40LRGQ6BQ16 type=del size=693185: (22) Invalid argument 2023-12-03T11:28:30.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.825+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=MBIC6HT64DIS type=del size=1888374 2023-12-03T11:28:30.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.826+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~R4HEANLU38VL.0 size=365789 2023-12-03T11:28:30.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.828+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=R4HEANLU38VL tag=YC0J42CQHF0H type=write size=1414365 2023-12-03T11:28:30.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.829+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=K0XCWKXHN6YS type=del size=1402482 2023-12-03T11:28:30.831 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.830+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~D0VR9KNWMKD1.0 size=1048576 2023-12-03T11:28:30.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.831+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~D0VR9KNWMKD1.1 size=1048576 2023-12-03T11:28:30.833 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.832+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~D0VR9KNWMKD1.2 size=74210 2023-12-03T11:28:30.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.834+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=D0VR9KNWMKD1 tag=9CTZGFYCVE7Z type=write size=3219938 2023-12-03T11:28:30.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.836+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~DA9HN0YKQ4GH.0 size=1048576 2023-12-03T11:28:30.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.837+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~DA9HN0YKQ4GH.1 size=317199 2023-12-03T11:28:30.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.837+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=DA9HN0YKQ4GH tag=AG57O3HBL8M4 type=write size=2414351 2023-12-03T11:28:30.839 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.838+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=RXQYPPBGDJ49 type=del 2023-12-03T11:28:30.841 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.841+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~JS5Q2RTN0G0J.0 size=398075 2023-12-03T11:28:30.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.841+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=JS5Q2RTN0G0J tag=8M5S92AZHT2B type=write size=1446651 2023-12-03T11:28:30.843 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.842+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~E03E4GKIK6NY.0 size=1048576 2023-12-03T11:28:30.844 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.843+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~E03E4GKIK6NY.1 size=1048576 2023-12-03T11:28:30.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.844+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~E03E4GKIK6NY.2 size=261785 2023-12-03T11:28:30.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.846+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=E03E4GKIK6NY tag=M7FQAIG4VNXT type=write size=3407513 2023-12-03T11:28:30.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.848+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~YYH1DM73YKCM.0 size=1048576 2023-12-03T11:28:30.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.849+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~YYH1DM73YKCM.1 size=1041225 2023-12-03T11:28:30.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.849+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=YYH1DM73YKCM tag=74X9H2FQ2Y1C type=write size=3138377 2023-12-03T11:28:30.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.851+0000 7fe67fa49780 1 < suggested remove operation key=V9ZVWHO8IF8L tag=MP6KZDFGTZEM type=del 2023-12-03T11:28:30.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.853+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~AYBEU0M83288.0 size=533027 2023-12-03T11:28:30.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.853+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=AYBEU0M83288 tag=Q1L6K0CNLHWP type=write size=1581603 2023-12-03T11:28:30.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.855+0000 7fe67fa49780 1 < suggested remove operation key=TXVHRE03Z3DA tag=C1TTXASKAX5W type=del 2023-12-03T11:28:30.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.857+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~0OY3PJ9O5I16.0 size=1048576 2023-12-03T11:28:30.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.858+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~0OY3PJ9O5I16.1 size=620766 2023-12-03T11:28:30.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.858+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=0OY3PJ9O5I16 tag=WPWXDWFEEJP1 type=write size=2717918 2023-12-03T11:28:30.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.859+0000 7fe67fa49780 1 < completed write operation key=6LQ18VAE3ZN6 tag=U1YRLJCSDYV3 type=write size=28123 2023-12-03T11:28:30.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.861+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~LMTXS0IR97S5.0 size=1048576 2023-12-03T11:28:30.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.862+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~LMTXS0IR97S5.1 size=1024988 2023-12-03T11:28:30.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.862+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=LMTXS0IR97S5 tag=14TUJDMPY5VR type=write size=3122140 2023-12-03T11:28:30.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.863+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~E7BMXLHNLRP9.0 size=661474 2023-12-03T11:28:30.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.865+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=E7BMXLHNLRP9 tag=36QTDRU1BX3C type=write size=1710050 2023-12-03T11:28:30.867 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.867+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=PE61QGCWXTMK type=del size=117231 2023-12-03T11:28:30.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.868+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=O0AS73D015P8 type=del 2023-12-03T11:28:30.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.869+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=ULMCZCQYZQ3F type=del size=225110 2023-12-03T11:28:30.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.870+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~DRN8NS5M2JSK.0 size=72749 2023-12-03T11:28:30.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.872+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=DRN8NS5M2JSK tag=PXMRFMUYV422 type=write size=1121325 2023-12-03T11:28:30.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.873+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=EJ8JLDKZ02LS type=del size=3232563 2023-12-03T11:28:30.875 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.874+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~UMX8EPCVXKI0.0 size=569825 2023-12-03T11:28:30.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.876+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=UMX8EPCVXKI0 tag=H0LBBNG3SBK1 type=write size=1618401 2023-12-03T11:28:30.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.878+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~XTMTXHGAJPXF.0 size=1048576 2023-12-03T11:28:30.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.879+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~XTMTXHGAJPXF.1 size=543897 2023-12-03T11:28:30.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.879+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=XTMTXHGAJPXF tag=K99XA1T4V3YP type=write size=2641049 2023-12-03T11:28:30.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.880+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~0QDQI30S5IK0.0 size=1048576 2023-12-03T11:28:30.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.881+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~0QDQI30S5IK0.1 size=991619 2023-12-03T11:28:30.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.883+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=0QDQI30S5IK0 tag=BMF9A4W9LD50 type=write size=3088771 2023-12-03T11:28:30.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.884+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=14KBVBBPYQE3 type=write size=805501 2023-12-03T11:28:30.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.885+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~4DDTI3Q552OC.0 size=767703 2023-12-03T11:28:30.888 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.887+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=4DDTI3Q552OC tag=TKJJHLYMY72U type=write size=1816279 2023-12-03T11:28:30.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.889+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~V1T3UTU37FOG.0 size=1048576 2023-12-03T11:28:30.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.890+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~V1T3UTU37FOG.1 size=82424 2023-12-03T11:28:30.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.890+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=V1T3UTU37FOG tag=YLA8T6SRLAXX type=write size=2179576 2023-12-03T11:28:30.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.891+0000 7fe67fa49780 -1 < failed to complete operation key=TXVHRE03Z3DA tag=CHLYAMK2VRXD type=write size=91122: (22) Invalid argument 2023-12-03T11:28:30.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.892+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=PYUZJTO56FRB type=write size=133009 2023-12-03T11:28:30.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.894+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=U6B2Z11SJUYW type=del 2023-12-03T11:28:30.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.896+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~LZO44MGK3NRB.0 size=432576 2023-12-03T11:28:30.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.896+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=LZO44MGK3NRB tag=OFM4B1XLNDRK type=write size=1481152 2023-12-03T11:28:30.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.897+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=MBIC6HT64DIS type=del 2023-12-03T11:28:30.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.899+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~KPS31000XXGK.0 size=1048576 2023-12-03T11:28:30.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.900+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~KPS31000XXGK.1 size=1048576 2023-12-03T11:28:30.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.901+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~KPS31000XXGK.2 size=190520 2023-12-03T11:28:30.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.901+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=KPS31000XXGK tag=8J1ZLLIT8RO4 type=write size=3336248 2023-12-03T11:28:30.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.902+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=K0XCWKXHN6YS type=del 2023-12-03T11:28:30.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.904+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~91BJX0WCR37X.0 size=1048576 2023-12-03T11:28:30.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.905+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~91BJX0WCR37X.1 size=1048576 2023-12-03T11:28:30.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.906+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~91BJX0WCR37X.2 size=574087 2023-12-03T11:28:30.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.906+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=91BJX0WCR37X tag=SZEKD800Y4KS type=write size=3719815 2023-12-03T11:28:30.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.908+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~DA9HN0YKQ4GH.0 size=1048576 2023-12-03T11:28:30.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.908+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~DA9HN0YKQ4GH.1 size=317199 2023-12-03T11:28:30.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.910+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=DA9HN0YKQ4GH tag=AG57O3HBL8M4 type=write size=2414351 2023-12-03T11:28:30.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.912+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=XCUDH0RDHXIU type=del size=2776935 2023-12-03T11:28:30.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.913+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~JS5Q2RTN0G0J.0 size=398075 2023-12-03T11:28:30.916 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.915+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=JS5Q2RTN0G0J tag=8M5S92AZHT2B type=write size=1446651 2023-12-03T11:28:30.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.917+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~LWTSOG5RA5B7.0 size=938462 2023-12-03T11:28:30.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.917+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=LWTSOG5RA5B7 tag=Z2HOQ8C92MOU type=write size=1987038 2023-12-03T11:28:30.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.918+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~YYH1DM73YKCM.0 size=1048576 2023-12-03T11:28:30.921 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.920+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~YYH1DM73YKCM.1 size=1041225 2023-12-03T11:28:30.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.922+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=YYH1DM73YKCM tag=74X9H2FQ2Y1C type=write size=3138377 2023-12-03T11:28:30.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.924+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~J4BLWNIAVUAC.0 size=1048576 2023-12-03T11:28:30.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.925+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~J4BLWNIAVUAC.1 size=333987 2023-12-03T11:28:30.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.925+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=J4BLWNIAVUAC tag=I8EBDOZOMQIB type=write size=2431139 2023-12-03T11:28:30.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.926+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~AYBEU0M83288.0 size=533027 2023-12-03T11:28:30.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.928+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=AYBEU0M83288 tag=Q1L6K0CNLHWP type=write size=1581603 2023-12-03T11:28:30.930 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.929+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=8WCR9VG4JED9 type=del size=2993980 2023-12-03T11:28:30.932 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.931+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~0OY3PJ9O5I16.0 size=1048576 2023-12-03T11:28:30.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.932+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~0OY3PJ9O5I16.1 size=620766 2023-12-03T11:28:30.935 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.934+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=0OY3PJ9O5I16 tag=WPWXDWFEEJP1 type=write size=2717918 2023-12-03T11:28:30.936 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.935+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=X99XBJVQ3WUS type=del size=380801 2023-12-03T11:28:30.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.936+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~LMTXS0IR97S5.0 size=1048576 2023-12-03T11:28:30.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.937+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~LMTXS0IR97S5.1 size=1024988 2023-12-03T11:28:30.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.939+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=LMTXS0IR97S5 tag=14TUJDMPY5VR type=write size=3122140 2023-12-03T11:28:30.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.941+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~S0UUFRQ963CK.0 size=1048576 2023-12-03T11:28:30.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.942+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~S0UUFRQ963CK.1 size=696229 2023-12-03T11:28:30.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.942+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=S0UUFRQ963CK tag=1TO7F4OD83MQ type=write size=2793381 2023-12-03T11:28:30.944 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.943+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=PE61QGCWXTMK type=del 2023-12-03T11:28:30.945 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.944+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=G190X4GXHOHQ type=del size=2684370 2023-12-03T11:28:30.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.945+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=ULMCZCQYZQ3F type=del 2023-12-03T11:28:30.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.947+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~J8NEEYU3VAI6.0 size=1048576 2023-12-03T11:28:30.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.948+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~J8NEEYU3VAI6.1 size=1048576 2023-12-03T11:28:30.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.949+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~J8NEEYU3VAI6.2 size=825046 2023-12-03T11:28:30.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.949+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=J8NEEYU3VAI6 tag=214V5BT2A29I type=write size=3970774 2023-12-03T11:28:30.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.951+0000 7fe67fa49780 1 < suggested remove operation key=KMC5YD2M3I45 tag=EJ8JLDKZ02LS type=del 2023-12-03T11:28:30.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.953+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~NPCUP6JAPTTA.0 size=623917 2023-12-03T11:28:30.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.953+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=NPCUP6JAPTTA tag=KMWMOOSVJZ9K type=write size=1672493 2023-12-03T11:28:30.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.954+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~XTMTXHGAJPXF.0 size=1048576 2023-12-03T11:28:30.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.954+0000 7fe67fa49780 1 < canceled part key=_multipart_006X4CSXV0KA.2~XTMTXHGAJPXF.1 size=543897 2023-12-03T11:28:30.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.956+0000 7fe67fa49780 1 < canceled multipart upload key=006X4CSXV0KA upload=XTMTXHGAJPXF tag=K99XA1T4V3YP type=write size=2641049 2023-12-03T11:28:30.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.957+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=EXR9Y0L17VZ5 type=del size=158425 2023-12-03T11:28:30.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.958+0000 7fe67fa49780 1 < completed write operation key=9OD4G28SDLB4 tag=14KBVBBPYQE3 type=write size=805501 2023-12-03T11:28:30.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.960+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~X41QW9QUBRG9.0 size=220632 2023-12-03T11:28:30.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.960+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=X41QW9QUBRG9 tag=4DVQ5F969D5J type=write size=1269208 2023-12-03T11:28:30.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.961+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~V1T3UTU37FOG.0 size=1048576 2023-12-03T11:28:30.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.962+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~V1T3UTU37FOG.1 size=82424 2023-12-03T11:28:30.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.964+0000 7fe67fa49780 1 < completed multipart upload key=URVD2U16EW75 upload=V1T3UTU37FOG tag=YLA8T6SRLAXX type=write size=2179576 2023-12-03T11:28:30.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.967+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~LKGNC2X6O03H.0 size=719990 2023-12-03T11:28:30.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.967+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=LKGNC2X6O03H tag=17425VCYK1WB type=write size=1768566 2023-12-03T11:28:30.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.968+0000 7fe67fa49780 1 < completed write operation key=YEMPVKMDANPG tag=PYUZJTO56FRB type=write size=133009 2023-12-03T11:28:30.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.969+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=RCE7B7M49GWA type=del size=486813 2023-12-03T11:28:30.971 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.970+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~LZO44MGK3NRB.0 size=432576 2023-12-03T11:28:30.973 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.972+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=LZO44MGK3NRB tag=OFM4B1XLNDRK type=write size=1481152 2023-12-03T11:28:30.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.975+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~OHH7R3T3YT3K.0 size=412338 2023-12-03T11:28:30.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.975+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=OHH7R3T3YT3K tag=DP1X9S2RJH7W type=write size=1460914 2023-12-03T11:28:30.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.976+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~KPS31000XXGK.0 size=1048576 2023-12-03T11:28:30.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.977+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~KPS31000XXGK.1 size=1048576 2023-12-03T11:28:30.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.978+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~KPS31000XXGK.2 size=190520 2023-12-03T11:28:30.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.980+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=KPS31000XXGK tag=8J1ZLLIT8RO4 type=write size=3336248 2023-12-03T11:28:30.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.981+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=QCR55W7E4Z9Y type=del size=3453141 2023-12-03T11:28:30.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.981+0000 7fe67fa49780 1 < canceled part key=_multipart_9AUO0SRFTAUJ.2~91BJX0WCR37X.0 size=1048576 2023-12-03T11:28:30.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.981+0000 7fe67fa49780 1 < canceled part key=_multipart_9AUO0SRFTAUJ.2~91BJX0WCR37X.1 size=1048576 2023-12-03T11:28:30.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.982+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~91BJX0WCR37X.2 size=574087 2023-12-03T11:28:30.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.984+0000 7fe67fa49780 1 < canceled multipart upload key=9AUO0SRFTAUJ upload=91BJX0WCR37X tag=SZEKD800Y4KS type=write size=3719815 2023-12-03T11:28:30.986 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.985+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=KBG1IF0YNVO5 type=del size=797961 2023-12-03T11:28:30.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.988+0000 7fe67fa49780 1 < suggested remove operation key=Z1NFEIZNYYO2 tag=XCUDH0RDHXIU type=del 2023-12-03T11:28:30.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.990+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~5GTXZWBWN7BN.0 size=1048576 2023-12-03T11:28:30.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.991+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~5GTXZWBWN7BN.1 size=1012732 2023-12-03T11:28:30.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.991+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=5GTXZWBWN7BN tag=SNERZK0K8LBV type=write size=3109884 2023-12-03T11:28:30.993 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.992+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~LWTSOG5RA5B7.0 size=938462 2023-12-03T11:28:30.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.994+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=LWTSOG5RA5B7 tag=Z2HOQ8C92MOU type=write size=1987038 2023-12-03T11:28:30.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.995+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=LI6D646Y8TPB type=del size=2393705 2023-12-03T11:28:30.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.995+0000 7fe67fa49780 1 < canceled part key=_multipart_Q6GBIBMIJRKV.2~J4BLWNIAVUAC.0 size=1048576 2023-12-03T11:28:30.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.996+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~J4BLWNIAVUAC.1 size=333987 2023-12-03T11:28:30.999 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:30.998+0000 7fe67fa49780 1 < canceled multipart upload key=Q6GBIBMIJRKV upload=J4BLWNIAVUAC tag=I8EBDOZOMQIB type=write size=2431139 2023-12-03T11:28:31.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.000+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=AWN81KLZMF0B type=del size=2427001 2023-12-03T11:28:31.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.002+0000 7fe67fa49780 1 < suggested remove operation key=UL24DVOA31Y7 tag=8WCR9VG4JED9 type=del 2023-12-03T11:28:31.005 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.004+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~H6LV151YL37C.0 size=1048576 2023-12-03T11:28:31.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.005+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~H6LV151YL37C.1 size=1048576 2023-12-03T11:28:31.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.006+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~H6LV151YL37C.2 size=717131 2023-12-03T11:28:31.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.006+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=H6LV151YL37C tag=OJRDTQAS3TBR type=write size=3862859 2023-12-03T11:28:31.008 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.007+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=X99XBJVQ3WUS type=del 2023-12-03T11:28:31.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.009+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~6SFYJD7FL1HF.0 size=1048576 2023-12-03T11:28:31.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.010+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~6SFYJD7FL1HF.1 size=1048576 2023-12-03T11:28:31.012 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.011+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~6SFYJD7FL1HF.2 size=403350 2023-12-03T11:28:31.012 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.011+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=6SFYJD7FL1HF tag=2HMJT2Y1G4NW type=write size=3549078 2023-12-03T11:28:31.013 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.012+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~S0UUFRQ963CK.0 size=1048576 2023-12-03T11:28:31.014 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.013+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~S0UUFRQ963CK.1 size=696229 2023-12-03T11:28:31.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.015+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=S0UUFRQ963CK tag=1TO7F4OD83MQ type=write size=2793381 2023-12-03T11:28:31.018 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.017+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~U8OB8Q2FKZVG.0 size=1048576 2023-12-03T11:28:31.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.018+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~U8OB8Q2FKZVG.1 size=1048576 2023-12-03T11:28:31.020 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.019+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~U8OB8Q2FKZVG.2 size=683058 2023-12-03T11:28:31.020 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.019+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=U8OB8Q2FKZVG tag=LLR0G5DMMPD4 type=write size=3828786 2023-12-03T11:28:31.021 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.021+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=G190X4GXHOHQ type=del 2023-12-03T11:28:31.023 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.022+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=HWI0IT9W3KBG type=del size=2485938 2023-12-03T11:28:31.024 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.023+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~J8NEEYU3VAI6.0 size=1048576 2023-12-03T11:28:31.025 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.024+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~J8NEEYU3VAI6.1 size=1048576 2023-12-03T11:28:31.026 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.025+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~J8NEEYU3VAI6.2 size=825046 2023-12-03T11:28:31.029 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.028+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=J8NEEYU3VAI6 tag=214V5BT2A29I type=write size=3970774 2023-12-03T11:28:31.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.029+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=1Q2Y6P2KVM5H type=write size=365614 2023-12-03T11:28:31.031 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.030+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~NPCUP6JAPTTA.0 size=623917 2023-12-03T11:28:31.033 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.032+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=NPCUP6JAPTTA tag=KMWMOOSVJZ9K type=write size=1672493 2023-12-03T11:28:31.035 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.034+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~7A1314HEPFTZ.0 size=1048576 2023-12-03T11:28:31.036 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.035+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~7A1314HEPFTZ.1 size=928985 2023-12-03T11:28:31.036 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.035+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=7A1314HEPFTZ tag=DOZP0RXSV71E type=write size=3026137 2023-12-03T11:28:31.037 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.036+0000 7fe67fa49780 -1 < failed to complete operation key=UL24DVOA31Y7 tag=EXR9Y0L17VZ5 type=del size=158425: (22) Invalid argument 2023-12-03T11:28:31.038 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.037+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=QBY0TZZMZYD1 type=del size=3325476 2023-12-03T11:28:31.039 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.038+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~X41QW9QUBRG9.0 size=220632 2023-12-03T11:28:31.041 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.040+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=X41QW9QUBRG9 tag=4DVQ5F969D5J type=write size=1269208 2023-12-03T11:28:31.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.042+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=GDHZRFOIS9CD type=del size=1894154 2023-12-03T11:28:31.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.043+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~LKGNC2X6O03H.0 size=719990 2023-12-03T11:28:31.046 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.045+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=LKGNC2X6O03H tag=17425VCYK1WB type=write size=1768566 2023-12-03T11:28:31.048 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.047+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~ZNQM207WQO37.0 size=1048576 2023-12-03T11:28:31.048 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.048+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~ZNQM207WQO37.1 size=1048576 2023-12-03T11:28:31.049 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.048+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~ZNQM207WQO37.2 size=440576 2023-12-03T11:28:31.049 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.048+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=ZNQM207WQO37 tag=UYGW5SQCJPVB type=write size=3586304 2023-12-03T11:28:31.050 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.050+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=RCE7B7M49GWA type=del 2023-12-03T11:28:31.052 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.051+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=NCTVS96RS23U type=del size=3066039 2023-12-03T11:28:31.053 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.052+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~OHH7R3T3YT3K.0 size=412338 2023-12-03T11:28:31.055 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.054+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=OHH7R3T3YT3K tag=DP1X9S2RJH7W type=write size=1460914 2023-12-03T11:28:31.056 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.055+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=C96U0VKNOZ1E type=del size=2349998 2023-12-03T11:28:31.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.057+0000 7fe67fa49780 1 < suggested remove operation key=0GQZY07Y2PVI tag=QCR55W7E4Z9Y type=del 2023-12-03T11:28:31.060 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.059+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~VC9BXTEDCRGN.0 size=1048576 2023-12-03T11:28:31.061 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.060+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~VC9BXTEDCRGN.1 size=1048576 2023-12-03T11:28:31.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.061+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~VC9BXTEDCRGN.2 size=827931 2023-12-03T11:28:31.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.061+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=VC9BXTEDCRGN tag=S9ZP7W4O2YYX type=write size=3973659 2023-12-03T11:28:31.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.062+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=KBG1IF0YNVO5 type=del 2023-12-03T11:28:31.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.064+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=U64XN8DSQISG type=write size=1022274 2023-12-03T11:28:31.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.065+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~5GTXZWBWN7BN.0 size=1048576 2023-12-03T11:28:31.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.066+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~5GTXZWBWN7BN.1 size=1012732 2023-12-03T11:28:31.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.068+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=5GTXZWBWN7BN tag=SNERZK0K8LBV type=write size=3109884 2023-12-03T11:28:31.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.070+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~3NYXRXR3ETA1.0 size=1048576 2023-12-03T11:28:31.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.071+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~3NYXRXR3ETA1.1 size=1048576 2023-12-03T11:28:31.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.072+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~3NYXRXR3ETA1.2 size=844163 2023-12-03T11:28:31.073 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.072+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=3NYXRXR3ETA1 tag=AIJXRQ2ZOGB3 type=write size=3989891 2023-12-03T11:28:31.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.073+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=LI6D646Y8TPB type=del 2023-12-03T11:28:31.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.075+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~EJNZ3TKPNFR7.0 size=665832 2023-12-03T11:28:31.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.075+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=EJNZ3TKPNFR7 tag=IAOLL6CNROKW type=write size=1714408 2023-12-03T11:28:31.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.076+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=AWN81KLZMF0B type=del 2023-12-03T11:28:31.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.077+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=F734KUK4GCJ2 type=del size=3044007 2023-12-03T11:28:31.079 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.078+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~H6LV151YL37C.0 size=1048576 2023-12-03T11:28:31.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.079+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~H6LV151YL37C.1 size=1048576 2023-12-03T11:28:31.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.080+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~H6LV151YL37C.2 size=717131 2023-12-03T11:28:31.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.082+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=H6LV151YL37C tag=OJRDTQAS3TBR type=write size=3862859 2023-12-03T11:28:31.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.084+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~UPB3OR2LAWJ9.0 size=423184 2023-12-03T11:28:31.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.084+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=UPB3OR2LAWJ9 tag=UVZV11QO5V3Y type=write size=1471760 2023-12-03T11:28:31.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.085+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~6SFYJD7FL1HF.0 size=1048576 2023-12-03T11:28:31.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.085+0000 7fe67fa49780 1 < canceled part key=_multipart_V9ZVWHO8IF8L.2~6SFYJD7FL1HF.1 size=1048576 2023-12-03T11:28:31.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.086+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~6SFYJD7FL1HF.2 size=403350 2023-12-03T11:28:31.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.088+0000 7fe67fa49780 1 < canceled multipart upload key=V9ZVWHO8IF8L upload=6SFYJD7FL1HF tag=2HMJT2Y1G4NW type=write size=3549078 2023-12-03T11:28:31.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.091+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~5JLGTY7CVA6M.0 size=1048576 2023-12-03T11:28:31.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.092+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~5JLGTY7CVA6M.1 size=711708 2023-12-03T11:28:31.093 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.092+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=5JLGTY7CVA6M tag=D7X4WJEXKK8V type=write size=2808860 2023-12-03T11:28:31.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.093+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~U8OB8Q2FKZVG.0 size=1048576 2023-12-03T11:28:31.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.094+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~U8OB8Q2FKZVG.1 size=1048576 2023-12-03T11:28:31.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.095+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~U8OB8Q2FKZVG.2 size=683058 2023-12-03T11:28:31.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.097+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=U8OB8Q2FKZVG tag=LLR0G5DMMPD4 type=write size=3828786 2023-12-03T11:28:31.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.099+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~72HARYG4Q6IP.0 size=1048576 2023-12-03T11:28:31.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.100+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~72HARYG4Q6IP.1 size=720440 2023-12-03T11:28:31.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.100+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=72HARYG4Q6IP tag=BSMU43DBO0KF type=write size=2817592 2023-12-03T11:28:31.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.101+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=HWI0IT9W3KBG type=del 2023-12-03T11:28:31.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.104+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~1DSTQFWOGLQN.0 size=609626 2023-12-03T11:28:31.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.104+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=1DSTQFWOGLQN tag=LCL9MGP78HE9 type=write size=1658202 2023-12-03T11:28:31.106 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.105+0000 7fe67fa49780 1 < completed write operation key=V9ZVWHO8IF8L tag=1Q2Y6P2KVM5H type=write size=365614 2023-12-03T11:28:31.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.107+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~QDPDK4J9X6CX.0 size=1048576 2023-12-03T11:28:31.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.108+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~QDPDK4J9X6CX.1 size=1048576 2023-12-03T11:28:31.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.109+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~QDPDK4J9X6CX.2 size=162861 2023-12-03T11:28:31.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.109+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=QDPDK4J9X6CX tag=WSRLIR86EC1P type=write size=3308589 2023-12-03T11:28:31.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.110+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~7A1314HEPFTZ.0 size=1048576 2023-12-03T11:28:31.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.111+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~7A1314HEPFTZ.1 size=928985 2023-12-03T11:28:31.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.113+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=7A1314HEPFTZ tag=DOZP0RXSV71E type=write size=3026137 2023-12-03T11:28:31.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.116+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~K6A0EJ65UF6U.0 size=1048576 2023-12-03T11:28:31.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.117+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~K6A0EJ65UF6U.1 size=1048576 2023-12-03T11:28:31.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.117+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~K6A0EJ65UF6U.2 size=832155 2023-12-03T11:28:31.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.117+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=K6A0EJ65UF6U tag=MUJK0L41KKPC type=write size=3977883 2023-12-03T11:28:31.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.119+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=QBY0TZZMZYD1 type=del 2023-12-03T11:28:31.121 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.120+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=2EWP5ZCINWP4 type=write size=15083 2023-12-03T11:28:31.122 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.121+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=GDHZRFOIS9CD type=del 2023-12-03T11:28:31.123 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.122+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=GOL1QIB6Y5FY type=del size=3967538 2023-12-03T11:28:31.124 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.123+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~ZNQM207WQO37.0 size=1048576 2023-12-03T11:28:31.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.124+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~ZNQM207WQO37.1 size=1048576 2023-12-03T11:28:31.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.125+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~ZNQM207WQO37.2 size=440576 2023-12-03T11:28:31.128 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.127+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=ZNQM207WQO37 tag=UYGW5SQCJPVB type=write size=3586304 2023-12-03T11:28:31.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.129+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~X5VDT6KLJZW4.0 size=1048576 2023-12-03T11:28:31.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.130+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~X5VDT6KLJZW4.1 size=1048576 2023-12-03T11:28:31.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.131+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~X5VDT6KLJZW4.2 size=617875 2023-12-03T11:28:31.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.131+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=X5VDT6KLJZW4 tag=CC04WMY5GYW0 type=write size=3763603 2023-12-03T11:28:31.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.134+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=NCTVS96RS23U type=del 2023-12-03T11:28:31.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.135+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=O8GURPH7HK4O type=del size=646446 2023-12-03T11:28:31.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.136+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=C96U0VKNOZ1E type=del 2023-12-03T11:28:31.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.138+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=5XJXCFJPZEHS type=write size=66401 2023-12-03T11:28:31.140 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.139+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~VC9BXTEDCRGN.0 size=1048576 2023-12-03T11:28:31.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.140+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~VC9BXTEDCRGN.1 size=1048576 2023-12-03T11:28:31.142 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.141+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~VC9BXTEDCRGN.2 size=827931 2023-12-03T11:28:31.144 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.143+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=VC9BXTEDCRGN tag=S9ZP7W4O2YYX type=write size=3973659 2023-12-03T11:28:31.145 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.144+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=Q5GC05FUWRUB type=del size=421673 2023-12-03T11:28:31.146 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.145+0000 7fe67fa49780 1 < completed write operation key=ASODFGLQ5VNY tag=U64XN8DSQISG type=write size=1022274 2023-12-03T11:28:31.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.148+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~CHJ9HY7BGCPD.0 size=287235 2023-12-03T11:28:31.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.148+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=CHJ9HY7BGCPD tag=VEMP5USA4SXI type=write size=1335811 2023-12-03T11:28:31.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.149+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~3NYXRXR3ETA1.0 size=1048576 2023-12-03T11:28:31.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.150+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~3NYXRXR3ETA1.1 size=1048576 2023-12-03T11:28:31.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.151+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~3NYXRXR3ETA1.2 size=844163 2023-12-03T11:28:31.153 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.153+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=3NYXRXR3ETA1 tag=AIJXRQ2ZOGB3 type=write size=3989891 2023-12-03T11:28:31.155 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.154+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=0QCWYF6SHHC0 type=del size=369315 2023-12-03T11:28:31.156 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.155+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~EJNZ3TKPNFR7.0 size=665832 2023-12-03T11:28:31.158 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.157+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=EJNZ3TKPNFR7 tag=IAOLL6CNROKW type=write size=1714408 2023-12-03T11:28:31.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.158+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=S550L49MJYOY type=del size=2909160 2023-12-03T11:28:31.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.159+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=F734KUK4GCJ2 type=del 2023-12-03T11:28:31.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.160+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=3CL06Y7H8ONC type=write size=172586 2023-12-03T11:28:31.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.161+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~UPB3OR2LAWJ9.0 size=423184 2023-12-03T11:28:31.164 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.163+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=UPB3OR2LAWJ9 tag=UVZV11QO5V3Y type=write size=1471760 2023-12-03T11:28:31.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.164+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=9Z1UZSYOWTEI type=del size=1343166 2023-12-03T11:28:31.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.165+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~5JLGTY7CVA6M.0 size=1048576 2023-12-03T11:28:31.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.166+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~5JLGTY7CVA6M.1 size=711708 2023-12-03T11:28:31.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.168+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=5JLGTY7CVA6M tag=D7X4WJEXKK8V type=write size=2808860 2023-12-03T11:28:31.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.170+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~RWJYPQFVEYO6.0 size=565157 2023-12-03T11:28:31.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.170+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=RWJYPQFVEYO6 tag=PT196NYLI8W9 type=write size=1613733 2023-12-03T11:28:31.172 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.171+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~72HARYG4Q6IP.0 size=1048576 2023-12-03T11:28:31.173 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.172+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~72HARYG4Q6IP.1 size=720440 2023-12-03T11:28:31.175 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.174+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=72HARYG4Q6IP tag=BSMU43DBO0KF type=write size=2817592 2023-12-03T11:28:31.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.175+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=F1XI06C234H7 type=del size=3906222 2023-12-03T11:28:31.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.175+0000 7fe67fa49780 1 < canceled part key=_multipart_CC1X1OP7L6BJ.2~1DSTQFWOGLQN.0 size=609626 2023-12-03T11:28:31.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.178+0000 7fe67fa49780 1 < canceled multipart upload key=CC1X1OP7L6BJ upload=1DSTQFWOGLQN tag=LCL9MGP78HE9 type=write size=1658202 2023-12-03T11:28:31.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.180+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~J5O6XUDNI2QW.0 size=1048576 2023-12-03T11:28:31.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.181+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~J5O6XUDNI2QW.1 size=505334 2023-12-03T11:28:31.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.181+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=J5O6XUDNI2QW tag=HV6L9C0XRH01 type=write size=2602486 2023-12-03T11:28:31.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.181+0000 7fe67fa49780 1 < canceled part key=_multipart_A7GOX2W0WB83.2~QDPDK4J9X6CX.0 size=1048576 2023-12-03T11:28:31.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.182+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~QDPDK4J9X6CX.1 size=1048576 2023-12-03T11:28:31.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.183+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~QDPDK4J9X6CX.2 size=162861 2023-12-03T11:28:31.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.185+0000 7fe67fa49780 1 < canceled multipart upload key=A7GOX2W0WB83 upload=QDPDK4J9X6CX tag=WSRLIR86EC1P type=write size=3308589 2023-12-03T11:28:31.189 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.187+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~YK019N5B9341.0 size=1048576 2023-12-03T11:28:31.189 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.188+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~YK019N5B9341.1 size=1048576 2023-12-03T11:28:31.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.189+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~YK019N5B9341.2 size=593627 2023-12-03T11:28:31.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.189+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=YK019N5B9341 tag=Q4AD6II75O0P type=write size=3739355 2023-12-03T11:28:31.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.191+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~K6A0EJ65UF6U.0 size=1048576 2023-12-03T11:28:31.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.192+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~K6A0EJ65UF6U.1 size=1048576 2023-12-03T11:28:31.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.192+0000 7fe67fa49780 1 < canceled part key=_multipart_V9ZVWHO8IF8L.2~K6A0EJ65UF6U.2 size=832155 2023-12-03T11:28:31.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.194+0000 7fe67fa49780 1 < canceled multipart upload key=V9ZVWHO8IF8L upload=K6A0EJ65UF6U tag=MUJK0L41KKPC type=write size=3977883 2023-12-03T11:28:31.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.195+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=VAJHCOFIOD8J type=del size=4034187 2023-12-03T11:28:31.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.196+0000 7fe67fa49780 1 < completed write operation key=OH2XUEEYL9JO tag=2EWP5ZCINWP4 type=write size=15083 2023-12-03T11:28:31.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.199+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~NU8S20E8SHHS.0 size=1048576 2023-12-03T11:28:31.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.200+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~NU8S20E8SHHS.1 size=761061 2023-12-03T11:28:31.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.200+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=NU8S20E8SHHS tag=CJRV7U106FET type=write size=2858213 2023-12-03T11:28:31.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.201+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=GOL1QIB6Y5FY type=del 2023-12-03T11:28:31.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.203+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=CAMUZB99E9RO type=del size=269228 2023-12-03T11:28:31.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.204+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~X5VDT6KLJZW4.0 size=1048576 2023-12-03T11:28:31.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.205+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~X5VDT6KLJZW4.1 size=1048576 2023-12-03T11:28:31.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.206+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~X5VDT6KLJZW4.2 size=617875 2023-12-03T11:28:31.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.208+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=X5VDT6KLJZW4 tag=CC04WMY5GYW0 type=write size=3763603 2023-12-03T11:28:31.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.210+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=HHBDPTL8ETXF type=del size=832725 2023-12-03T11:28:31.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.212+0000 7fe67fa49780 1 < suggested remove operation key=Y0VRZR6S8FP6 tag=O8GURPH7HK4O type=del 2023-12-03T11:28:31.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.213+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=KSXULUF3E612 type=del size=1078614 2023-12-03T11:28:31.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.215+0000 7fe67fa49780 1 < completed write operation key=TXVHRE03Z3DA tag=5XJXCFJPZEHS type=write size=66401 2023-12-03T11:28:31.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.216+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=BAA6DER5JIM3 type=del size=3190581 2023-12-03T11:28:31.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.217+0000 7fe67fa49780 1 < canceled operation key=OH2XUEEYL9JO tag=Q5GC05FUWRUB type=del size=421673 2023-12-03T11:28:31.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.219+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~PASRI6P1JQH9.0 size=1048576 2023-12-03T11:28:31.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.220+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~PASRI6P1JQH9.1 size=1048576 2023-12-03T11:28:31.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.221+0000 7fe67fa49780 1 > prepared part key=_multipart_URVD2U16EW75.2~PASRI6P1JQH9.2 size=155492 2023-12-03T11:28:31.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.221+0000 7fe67fa49780 1 > prepared multipart upload key=URVD2U16EW75 upload=PASRI6P1JQH9 tag=OZR5M4FTVOQ3 type=write size=3301220 2023-12-03T11:28:31.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.222+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~CHJ9HY7BGCPD.0 size=287235 2023-12-03T11:28:31.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.224+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=CHJ9HY7BGCPD tag=VEMP5USA4SXI type=write size=1335811 2023-12-03T11:28:31.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.226+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=JCBLA8OJT1J5 type=del size=1100252 2023-12-03T11:28:31.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.228+0000 7fe67fa49780 1 < suggested remove operation key=YEMPVKMDANPG tag=0QCWYF6SHHC0 type=del 2023-12-03T11:28:31.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.229+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=V4XPIYZP3RJC type=del size=1816956 2023-12-03T11:28:31.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.231+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=S550L49MJYOY type=del 2023-12-03T11:28:31.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.232+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=P6KV0AWKC5BI type=del size=2800866 2023-12-03T11:28:31.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.233+0000 7fe67fa49780 1 < completed write operation key=DDHGOWEI7WEI tag=3CL06Y7H8ONC type=write size=172586 2023-12-03T11:28:31.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.234+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=63SJS9KKN2PN type=del size=3552564 2023-12-03T11:28:31.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.236+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=9Z1UZSYOWTEI type=del 2023-12-03T11:28:31.238 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.237+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=IYVR8H9J8FQ0 type=del size=1895353 2023-12-03T11:28:31.238 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.237+0000 7fe67fa49780 1 < canceled part key=_multipart_TXVHRE03Z3DA.2~RWJYPQFVEYO6.0 size=565157 2023-12-03T11:28:31.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.239+0000 7fe67fa49780 1 < canceled multipart upload key=TXVHRE03Z3DA upload=RWJYPQFVEYO6 tag=PT196NYLI8W9 type=write size=1613733 2023-12-03T11:28:31.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.240+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=MMQESQX09XLE type=write size=1005715 2023-12-03T11:28:31.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.243+0000 7fe67fa49780 1 < suggested update operation key=IIW1Y6QYEODQ tag=F1XI06C234H7 type=del size=3906222 2023-12-03T11:28:31.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.245+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~4LIO53AIZ0UW.0 size=1048576 2023-12-03T11:28:31.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.247+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~4LIO53AIZ0UW.1 size=1048576 2023-12-03T11:28:31.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.248+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~4LIO53AIZ0UW.2 size=845376 2023-12-03T11:28:31.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.248+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=4LIO53AIZ0UW tag=093L0AVFZER2 type=write size=3991104 2023-12-03T11:28:31.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.249+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~J5O6XUDNI2QW.0 size=1048576 2023-12-03T11:28:31.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.249+0000 7fe67fa49780 1 < canceled part key=_multipart_A7GOX2W0WB83.2~J5O6XUDNI2QW.1 size=505334 2023-12-03T11:28:31.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.251+0000 7fe67fa49780 1 < canceled multipart upload key=A7GOX2W0WB83 upload=J5O6XUDNI2QW tag=HV6L9C0XRH01 type=write size=2602486 2023-12-03T11:28:31.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.253+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=RAFPX085J54B type=del size=2535815 2023-12-03T11:28:31.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.254+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~YK019N5B9341.0 size=1048576 2023-12-03T11:28:31.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.255+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~YK019N5B9341.1 size=1048576 2023-12-03T11:28:31.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.256+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~YK019N5B9341.2 size=593627 2023-12-03T11:28:31.259 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.258+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=YK019N5B9341 tag=Q4AD6II75O0P type=write size=3739355 2023-12-03T11:28:31.260 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.259+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=P4D1KKDBF3CQ type=write size=139817 2023-12-03T11:28:31.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.261+0000 7fe67fa49780 1 < suggested update operation key=6LQ18VAE3ZN6 tag=VAJHCOFIOD8J type=del size=4034187 2023-12-03T11:28:31.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.262+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=OGVSKC7HNJ9J type=del size=1181690 2023-12-03T11:28:31.264 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.263+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~NU8S20E8SHHS.0 size=1048576 2023-12-03T11:28:31.265 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.264+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~NU8S20E8SHHS.1 size=761061 2023-12-03T11:28:31.267 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.266+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=NU8S20E8SHHS tag=CJRV7U106FET type=write size=2858213 2023-12-03T11:28:31.268 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.267+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=3E6G21YS5L5H type=del size=974925 2023-12-03T11:28:31.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.268+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=CAMUZB99E9RO type=del 2023-12-03T11:28:31.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.269+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=NAQU0NMKWA1R type=del size=60968 2023-12-03T11:28:31.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.270+0000 7fe67fa49780 -1 < failed to complete operation key=6LQ18VAE3ZN6 tag=HHBDPTL8ETXF type=del size=832725: (22) Invalid argument 2023-12-03T11:28:31.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.271+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=33A84VCNZIAQ type=write size=159173 2023-12-03T11:28:31.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.272+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=KSXULUF3E612 type=del 2023-12-03T11:28:31.274 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.273+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=WFG7YLTQLGP3 type=del size=1639131 2023-12-03T11:28:31.275 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.274+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=BAA6DER5JIM3 type=del 2023-12-03T11:28:31.277 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.276+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~NE6A5E47X8Z1.0 size=766206 2023-12-03T11:28:31.277 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.276+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=NE6A5E47X8Z1 tag=BKRZ8U3IS418 type=write size=1814782 2023-12-03T11:28:31.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.278+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~PASRI6P1JQH9.0 size=1048576 2023-12-03T11:28:31.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.278+0000 7fe67fa49780 1 < canceled part key=_multipart_URVD2U16EW75.2~PASRI6P1JQH9.1 size=1048576 2023-12-03T11:28:31.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.279+0000 7fe67fa49780 1 < completed part key=_multipart_URVD2U16EW75.2~PASRI6P1JQH9.2 size=155492 2023-12-03T11:28:31.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.280+0000 7fe67fa49780 1 < canceled multipart upload key=URVD2U16EW75 upload=PASRI6P1JQH9 tag=OZR5M4FTVOQ3 type=write size=3301220 2023-12-03T11:28:31.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.281+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=EXRQJDKZT6R4 type=write size=785769 2023-12-03T11:28:31.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.283+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=JCBLA8OJT1J5 type=del 2023-12-03T11:28:31.285 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.284+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=CBIAW55CJLIT type=del size=113326 2023-12-03T11:28:31.287 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.286+0000 7fe67fa49780 1 < suggested remove operation key=0GQZY07Y2PVI tag=V4XPIYZP3RJC type=del 2023-12-03T11:28:31.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.288+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~K9WG611B8FUM.0 size=1048576 2023-12-03T11:28:31.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.289+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~K9WG611B8FUM.1 size=1048576 2023-12-03T11:28:31.291 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.290+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~K9WG611B8FUM.2 size=54060 2023-12-03T11:28:31.291 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.290+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=K9WG611B8FUM tag=UXMFGPNFRB8U type=write size=3199788 2023-12-03T11:28:31.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.292+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=P6KV0AWKC5BI type=del 2023-12-03T11:28:31.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.295+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~F5JB3J8VY9X8.0 size=95405 2023-12-03T11:28:31.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.295+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=F5JB3J8VY9X8 tag=MV0UUU8PEDHU type=write size=1143981 2023-12-03T11:28:31.297 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.296+0000 7fe67fa49780 1 < canceled operation key=H8MBLWXG7BCZ tag=63SJS9KKN2PN type=del size=3552564 2023-12-03T11:28:31.298 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.297+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=OLWJI2S06P3O type=write size=572882 2023-12-03T11:28:31.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.300+0000 7fe67fa49780 1 < suggested update operation key=Y0VRZR6S8FP6 tag=IYVR8H9J8FQ0 type=del size=1895353 2023-12-03T11:28:31.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.301+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=4VAT96Q4NYCQ type=del size=1497398 2023-12-03T11:28:31.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.302+0000 7fe67fa49780 1 < completed write operation key=TXVHRE03Z3DA tag=MMQESQX09XLE type=write size=1005715 2023-12-03T11:28:31.305 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.304+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~433P7LVCHFSM.0 size=313397 2023-12-03T11:28:31.305 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.304+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=433P7LVCHFSM tag=V30EGDTVG06W type=write size=1361973 2023-12-03T11:28:31.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.306+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~4LIO53AIZ0UW.0 size=1048576 2023-12-03T11:28:31.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.306+0000 7fe67fa49780 1 < canceled part key=_multipart_9AUO0SRFTAUJ.2~4LIO53AIZ0UW.1 size=1048576 2023-12-03T11:28:31.307 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.306+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~4LIO53AIZ0UW.2 size=845376 2023-12-03T11:28:31.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.309+0000 7fe67fa49780 1 < canceled multipart upload key=9AUO0SRFTAUJ upload=4LIO53AIZ0UW tag=093L0AVFZER2 type=write size=3991104 2023-12-03T11:28:31.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.311+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~OK1SZ2CM4LLU.0 size=1048576 2023-12-03T11:28:31.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.312+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~OK1SZ2CM4LLU.1 size=94844 2023-12-03T11:28:31.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.312+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=OK1SZ2CM4LLU tag=PKLB8ALGDYPQ type=write size=2191996 2023-12-03T11:28:31.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.313+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=RAFPX085J54B type=del 2023-12-03T11:28:31.315 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.314+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=3WYJOMGIA1MB type=del size=3904008 2023-12-03T11:28:31.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.317+0000 7fe67fa49780 1 < suggested update operation key=DDHGOWEI7WEI tag=P4D1KKDBF3CQ type=write size=139817 2023-12-03T11:28:31.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.318+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=LH64B0Y82MDM type=del size=1187274 2023-12-03T11:28:31.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.321+0000 7fe67fa49780 1 < suggested remove operation key=XZHCD4R4EVZR tag=OGVSKC7HNJ9J type=del 2023-12-03T11:28:31.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.322+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=QN1JEFQ4HVMG type=del size=4031227 2023-12-03T11:28:31.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.323+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=3E6G21YS5L5H type=del 2023-12-03T11:28:31.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.324+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=XUYW8K2TZ23B type=del size=3072326 2023-12-03T11:28:31.327 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.326+0000 7fe67fa49780 1 < canceled operation key=8UZJU9PNWIB6 tag=NAQU0NMKWA1R type=del size=60968 2023-12-03T11:28:31.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.328+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~QRESENLRE8UW.0 size=1048576 2023-12-03T11:28:31.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.329+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~QRESENLRE8UW.1 size=1048576 2023-12-03T11:28:31.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.330+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~QRESENLRE8UW.2 size=751628 2023-12-03T11:28:31.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.330+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=QRESENLRE8UW tag=EZ6MIQ6Y9L86 type=write size=3897356 2023-12-03T11:28:31.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.332+0000 7fe67fa49780 1 < completed write operation key=KMC5YD2M3I45 tag=33A84VCNZIAQ type=write size=159173 2023-12-03T11:28:31.335 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.334+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~PC6J88DOZCCX.0 size=1048576 2023-12-03T11:28:31.336 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.335+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~PC6J88DOZCCX.1 size=1048576 2023-12-03T11:28:31.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.336+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~PC6J88DOZCCX.2 size=966160 2023-12-03T11:28:31.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.336+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=PC6J88DOZCCX tag=I68ZX0VPG8BA type=write size=4111888 2023-12-03T11:28:31.338 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.337+0000 7fe67fa49780 -1 < failed to complete operation key=XZHCD4R4EVZR tag=WFG7YLTQLGP3 type=del size=1639131: (22) Invalid argument 2023-12-03T11:28:31.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.339+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=CE9DOVL7XIIN type=del size=2034860 2023-12-03T11:28:31.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.340+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~NE6A5E47X8Z1.0 size=766206 2023-12-03T11:28:31.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.342+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=NE6A5E47X8Z1 tag=BKRZ8U3IS418 type=write size=1814782 2023-12-03T11:28:31.344 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.343+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=SIAXDKEG1FDT type=del size=3865905 2023-12-03T11:28:31.346 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.345+0000 7fe67fa49780 1 < completed write operation key=PFBGR7OF7JQG tag=EXRQJDKZT6R4 type=write size=785769 2023-12-03T11:28:31.349 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.347+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~KV29SAMOLQTC.0 size=1048576 2023-12-03T11:28:31.349 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.348+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~KV29SAMOLQTC.1 size=1048576 2023-12-03T11:28:31.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.349+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~KV29SAMOLQTC.2 size=272325 2023-12-03T11:28:31.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.349+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=KV29SAMOLQTC tag=FROTV0W0CP6I type=write size=3418053 2023-12-03T11:28:31.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.350+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=CBIAW55CJLIT type=del 2023-12-03T11:28:31.352 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.352+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=11IVK1T73UNO type=del size=3576056 2023-12-03T11:28:31.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.353+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~K9WG611B8FUM.0 size=1048576 2023-12-03T11:28:31.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.354+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~K9WG611B8FUM.1 size=1048576 2023-12-03T11:28:31.356 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.355+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~K9WG611B8FUM.2 size=54060 2023-12-03T11:28:31.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.357+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=K9WG611B8FUM tag=UXMFGPNFRB8U type=write size=3199788 2023-12-03T11:28:31.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.358+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=K4ZR16EJPAZB type=write size=777382 2023-12-03T11:28:31.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.359+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~F5JB3J8VY9X8.0 size=95405 2023-12-03T11:28:31.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.363+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=F5JB3J8VY9X8 tag=MV0UUU8PEDHU type=write size=1143981 2023-12-03T11:28:31.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.364+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=MGH9YNM5OXL2 type=del size=1988249 2023-12-03T11:28:31.366 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.365+0000 7fe67fa49780 1 < completed write operation key=8UZJU9PNWIB6 tag=OLWJI2S06P3O type=write size=572882 2023-12-03T11:28:31.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.367+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~IOKHE9YY96QO.0 size=1048576 2023-12-03T11:28:31.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.368+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~IOKHE9YY96QO.1 size=1048576 2023-12-03T11:28:31.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.369+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~IOKHE9YY96QO.2 size=241106 2023-12-03T11:28:31.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.369+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=IOKHE9YY96QO tag=83NMGP3QKGA7 type=write size=3386834 2023-12-03T11:28:31.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.370+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=4VAT96Q4NYCQ type=del 2023-12-03T11:28:31.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.371+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=USVX0Y7GNSV1 type=del size=2537813 2023-12-03T11:28:31.374 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.373+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~433P7LVCHFSM.0 size=313397 2023-12-03T11:28:31.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.375+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=433P7LVCHFSM tag=V30EGDTVG06W type=write size=1361973 2023-12-03T11:28:31.377 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.376+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=BJ5NOW3L9GI3 type=del size=1070728 2023-12-03T11:28:31.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.378+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~OK1SZ2CM4LLU.0 size=1048576 2023-12-03T11:28:31.379 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.379+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~OK1SZ2CM4LLU.1 size=94844 2023-12-03T11:28:31.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.381+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=OK1SZ2CM4LLU tag=PKLB8ALGDYPQ type=write size=2191996 2023-12-03T11:28:31.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.382+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=9FX5GGK9XK0R type=del size=2250216 2023-12-03T11:28:31.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.384+0000 7fe67fa49780 1 < suggested remove operation key=0GQZY07Y2PVI tag=3WYJOMGIA1MB type=del 2023-12-03T11:28:31.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.385+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=8NJT7PAYXJY9 type=write size=641367 2023-12-03T11:28:31.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.386+0000 7fe67fa49780 1 < canceled operation key=TXVHRE03Z3DA tag=LH64B0Y82MDM type=del size=1187274 2023-12-03T11:28:31.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.387+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=JDRAFBEV9Y9S type=del size=1286294 2023-12-03T11:28:31.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.390+0000 7fe67fa49780 1 < suggested remove operation key=6LQ18VAE3ZN6 tag=QN1JEFQ4HVMG type=del 2023-12-03T11:28:31.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.391+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=OFTIWGCYU3QB type=write size=789451 2023-12-03T11:28:31.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.393+0000 7fe67fa49780 1 < suggested remove operation key=OH2XUEEYL9JO tag=XUYW8K2TZ23B type=del 2023-12-03T11:28:31.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.394+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=6L6N20ZR5C20 type=del size=1211147 2023-12-03T11:28:31.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.395+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~QRESENLRE8UW.0 size=1048576 2023-12-03T11:28:31.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.396+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~QRESENLRE8UW.1 size=1048576 2023-12-03T11:28:31.398 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.397+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~QRESENLRE8UW.2 size=751628 2023-12-03T11:28:31.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.399+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=QRESENLRE8UW tag=EZ6MIQ6Y9L86 type=write size=3897356 2023-12-03T11:28:31.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.400+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=D7YFRMX99SC9 type=del size=262168 2023-12-03T11:28:31.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.401+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~PC6J88DOZCCX.0 size=1048576 2023-12-03T11:28:31.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.402+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~PC6J88DOZCCX.1 size=1048576 2023-12-03T11:28:31.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.403+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~PC6J88DOZCCX.2 size=966160 2023-12-03T11:28:31.406 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.405+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=PC6J88DOZCCX tag=I68ZX0VPG8BA type=write size=4111888 2023-12-03T11:28:31.407 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.406+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=LIY3ZH6BFJIY type=del size=2580772 2023-12-03T11:28:31.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.407+0000 7fe67fa49780 -1 < no bi entry to suggest for operation key=OH2XUEEYL9JO tag=CE9DOVL7XIIN type=del size=2034860: (2) No such file or directory 2023-12-03T11:28:31.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.408+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=1JZEH7COVEQA type=write size=198652 2023-12-03T11:28:31.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.409+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=SIAXDKEG1FDT type=del 2023-12-03T11:28:31.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.410+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=RM6NPJOK7JII type=write size=1014046 2023-12-03T11:28:31.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.411+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~KV29SAMOLQTC.0 size=1048576 2023-12-03T11:28:31.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.412+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~KV29SAMOLQTC.1 size=1048576 2023-12-03T11:28:31.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.413+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~KV29SAMOLQTC.2 size=272325 2023-12-03T11:28:31.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.415+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=KV29SAMOLQTC tag=FROTV0W0CP6I type=write size=3418053 2023-12-03T11:28:31.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.417+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~XEUUSF26JV3J.0 size=1048576 2023-12-03T11:28:31.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.418+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~XEUUSF26JV3J.1 size=1048576 2023-12-03T11:28:31.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.419+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~XEUUSF26JV3J.2 size=81426 2023-12-03T11:28:31.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.419+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=XEUUSF26JV3J tag=51RWK8VM7JL7 type=write size=3227154 2023-12-03T11:28:31.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.421+0000 7fe67fa49780 1 < suggested remove operation key=IIW1Y6QYEODQ tag=11IVK1T73UNO type=del 2023-12-03T11:28:31.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.423+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=HQY2K4Y603S4 type=del size=450731 2023-12-03T11:28:31.425 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.424+0000 7fe67fa49780 1 < completed write operation key=983BDZLASC3S tag=K4ZR16EJPAZB type=write size=777382 2023-12-03T11:28:31.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.425+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=GE4JKGX8LI57 type=del size=1601541 2023-12-03T11:28:31.427 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.426+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=MGH9YNM5OXL2 type=del 2023-12-03T11:28:31.428 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.427+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=OEMI7MI7W6NO type=write size=961486 2023-12-03T11:28:31.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.429+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~IOKHE9YY96QO.0 size=1048576 2023-12-03T11:28:31.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.430+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~IOKHE9YY96QO.1 size=1048576 2023-12-03T11:28:31.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.430+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~IOKHE9YY96QO.2 size=241106 2023-12-03T11:28:31.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.433+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=IOKHE9YY96QO tag=83NMGP3QKGA7 type=write size=3386834 2023-12-03T11:28:31.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.434+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=507XIZTF1SIZ type=del size=3317846 2023-12-03T11:28:31.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.435+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=USVX0Y7GNSV1 type=del 2023-12-03T11:28:31.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.437+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~370GZMGZC42L.0 size=948070 2023-12-03T11:28:31.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.437+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=370GZMGZC42L tag=VRVG0YC3TKZ2 type=write size=1996646 2023-12-03T11:28:31.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.439+0000 7fe67fa49780 1 < suggested update operation key=Y0VRZR6S8FP6 tag=BJ5NOW3L9GI3 type=del size=1070728 2023-12-03T11:28:31.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.440+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=E7V3N4D56TN8 type=del size=2794872 2023-12-03T11:28:31.442 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.441+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=9FX5GGK9XK0R type=del 2023-12-03T11:28:31.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.444+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~Y7UBMWWU9RML.0 size=1048576 2023-12-03T11:28:31.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.444+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~Y7UBMWWU9RML.1 size=1048576 2023-12-03T11:28:31.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.445+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~Y7UBMWWU9RML.2 size=213134 2023-12-03T11:28:31.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.445+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=Y7UBMWWU9RML tag=WAOWF4SQGY4X type=write size=3358862 2023-12-03T11:28:31.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.447+0000 7fe67fa49780 1 < canceled operation key=YEMPVKMDANPG tag=8NJT7PAYXJY9 type=write size=641367 2023-12-03T11:28:31.450 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.449+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~R5LH6B2A7YDG.0 size=1048576 2023-12-03T11:28:31.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.450+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~R5LH6B2A7YDG.1 size=63190 2023-12-03T11:28:31.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.450+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=R5LH6B2A7YDG tag=EYIUTYE1VZAZ type=write size=2160342 2023-12-03T11:28:31.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.451+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=JDRAFBEV9Y9S type=del 2023-12-03T11:28:31.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.452+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=M5GFJGZK55GB type=del size=1421958 2023-12-03T11:28:31.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.453+0000 7fe67fa49780 1 < completed write operation key=ASODFGLQ5VNY tag=OFTIWGCYU3QB type=write size=789451 2023-12-03T11:28:31.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.455+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~O4P68352JAET.0 size=1048576 2023-12-03T11:28:31.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.456+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~O4P68352JAET.1 size=1048576 2023-12-03T11:28:31.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.457+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~O4P68352JAET.2 size=558761 2023-12-03T11:28:31.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.457+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=O4P68352JAET tag=IZR21Z9XWN3L type=write size=3704489 2023-12-03T11:28:31.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.459+0000 7fe67fa49780 1 < suggested remove operation key=UL24DVOA31Y7 tag=6L6N20ZR5C20 type=del 2023-12-03T11:28:31.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.460+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=HBXZ86T3RO02 type=del size=3101979 2023-12-03T11:28:31.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.462+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=D7YFRMX99SC9 type=del 2023-12-03T11:28:31.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.464+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~0MO6G2T2WXG7.0 size=1048576 2023-12-03T11:28:31.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.465+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~0MO6G2T2WXG7.1 size=1048576 2023-12-03T11:28:31.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.466+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~0MO6G2T2WXG7.2 size=16131 2023-12-03T11:28:31.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.466+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=0MO6G2T2WXG7 tag=UI290DGOXILK type=write size=3161859 2023-12-03T11:28:31.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.468+0000 7fe67fa49780 1 < suggested update operation key=Y0VRZR6S8FP6 tag=LIY3ZH6BFJIY type=del size=2580772 2023-12-03T11:28:31.470 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.469+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=L93ZB3T7C7KX type=write size=293065 2023-12-03T11:28:31.472 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.471+0000 7fe67fa49780 1 < canceled operation key=V9ZVWHO8IF8L tag=1JZEH7COVEQA type=write size=198652 2023-12-03T11:28:31.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.472+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=C1AWBZXKS2SV type=del size=1380087 2023-12-03T11:28:31.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.473+0000 7fe67fa49780 1 < completed write operation key=CC1X1OP7L6BJ tag=RM6NPJOK7JII type=write size=1014046 2023-12-03T11:28:31.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.475+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=W0DDST93UF0G type=del size=2263522 2023-12-03T11:28:31.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.476+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~XEUUSF26JV3J.0 size=1048576 2023-12-03T11:28:31.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.477+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~XEUUSF26JV3J.1 size=1048576 2023-12-03T11:28:31.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.477+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~XEUUSF26JV3J.2 size=81426 2023-12-03T11:28:31.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.479+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=XEUUSF26JV3J tag=51RWK8VM7JL7 type=write size=3227154 2023-12-03T11:28:31.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.480+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=UT1ELC6SRMJX type=del size=2014732 2023-12-03T11:28:31.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.482+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=HQY2K4Y603S4 type=del 2023-12-03T11:28:31.485 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.484+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~N1NZKY2509P9.0 size=1048576 2023-12-03T11:28:31.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.485+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~N1NZKY2509P9.1 size=762586 2023-12-03T11:28:31.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.485+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=N1NZKY2509P9 tag=UC8RLXOWT0X5 type=write size=2859738 2023-12-03T11:28:31.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.486+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=GE4JKGX8LI57 type=del 2023-12-03T11:28:31.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.487+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=DRCIK83YCPKS type=del size=1538839 2023-12-03T11:28:31.491 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.490+0000 7fe67fa49780 1 < suggested remove operation key=TXVHRE03Z3DA tag=OEMI7MI7W6NO type=write 2023-12-03T11:28:31.492 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.491+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=1T70BJFGMRKC type=del size=1646188 2023-12-03T11:28:31.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.492+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=507XIZTF1SIZ type=del 2023-12-03T11:28:31.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.494+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=WA1B33VF764Q type=write size=709217 2023-12-03T11:28:31.496 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.495+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~370GZMGZC42L.0 size=948070 2023-12-03T11:28:31.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.497+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=370GZMGZC42L tag=VRVG0YC3TKZ2 type=write size=1996646 2023-12-03T11:28:31.499 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.498+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=NZ1YCX22TNVH type=del size=161938 2023-12-03T11:28:31.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.500+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=E7V3N4D56TN8 type=del 2023-12-03T11:28:31.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.501+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=5TWX8SNE3H0S type=del size=2761729 2023-12-03T11:28:31.503 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.502+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~Y7UBMWWU9RML.0 size=1048576 2023-12-03T11:28:31.503 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.502+0000 7fe67fa49780 1 < canceled part key=_multipart_IIW1Y6QYEODQ.2~Y7UBMWWU9RML.1 size=1048576 2023-12-03T11:28:31.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.503+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~Y7UBMWWU9RML.2 size=213134 2023-12-03T11:28:31.506 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.505+0000 7fe67fa49780 1 < canceled multipart upload key=IIW1Y6QYEODQ upload=Y7UBMWWU9RML tag=WAOWF4SQGY4X type=write size=3358862 2023-12-03T11:28:31.507 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.506+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=N1JQ29XOANGX type=write size=413177 2023-12-03T11:28:31.509 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.508+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~R5LH6B2A7YDG.0 size=1048576 2023-12-03T11:28:31.510 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.509+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~R5LH6B2A7YDG.1 size=63190 2023-12-03T11:28:31.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.511+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=R5LH6B2A7YDG tag=EYIUTYE1VZAZ type=write size=2160342 2023-12-03T11:28:31.514 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.513+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~TZLPI9KFJ2DE.0 size=1048576 2023-12-03T11:28:31.515 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.514+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~TZLPI9KFJ2DE.1 size=828156 2023-12-03T11:28:31.515 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.514+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=TZLPI9KFJ2DE tag=B1TNL3XZ69SJ type=write size=2925308 2023-12-03T11:28:31.517 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.516+0000 7fe67fa49780 1 < suggested update operation key=8UZJU9PNWIB6 tag=M5GFJGZK55GB type=del size=1421958 2023-12-03T11:28:31.519 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.518+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=MJSREOM10UYD type=del size=2510993 2023-12-03T11:28:31.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.519+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~O4P68352JAET.0 size=1048576 2023-12-03T11:28:31.521 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.520+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~O4P68352JAET.1 size=1048576 2023-12-03T11:28:31.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.521+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~O4P68352JAET.2 size=558761 2023-12-03T11:28:31.524 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.523+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=O4P68352JAET tag=IZR21Z9XWN3L type=write size=3704489 2023-12-03T11:28:31.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.526+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~H4MNM2CNQGTD.0 size=1048576 2023-12-03T11:28:31.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.526+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~H4MNM2CNQGTD.1 size=1048576 2023-12-03T11:28:31.528 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.527+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~H4MNM2CNQGTD.2 size=235520 2023-12-03T11:28:31.529 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.527+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=H4MNM2CNQGTD tag=CJFY5EZ824WR type=write size=3381248 2023-12-03T11:28:31.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.529+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=HBXZ86T3RO02 type=del 2023-12-03T11:28:31.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.530+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=PQK7ZG5T41Q5 type=del size=1258392 2023-12-03T11:28:31.532 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.531+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~0MO6G2T2WXG7.0 size=1048576 2023-12-03T11:28:31.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.532+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~0MO6G2T2WXG7.1 size=1048576 2023-12-03T11:28:31.534 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.533+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~0MO6G2T2WXG7.2 size=16131 2023-12-03T11:28:31.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.536+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=0MO6G2T2WXG7 tag=UI290DGOXILK type=write size=3161859 2023-12-03T11:28:31.539 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.538+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~13VMBIODBBZF.0 size=1048576 2023-12-03T11:28:31.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.539+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~13VMBIODBBZF.1 size=1048576 2023-12-03T11:28:31.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.540+0000 7fe67fa49780 1 > prepared part key=_multipart_XZHCD4R4EVZR.2~13VMBIODBBZF.2 size=497774 2023-12-03T11:28:31.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.540+0000 7fe67fa49780 1 > prepared multipart upload key=XZHCD4R4EVZR upload=13VMBIODBBZF tag=5ITOTJA4GU35 type=write size=3643502 2023-12-03T11:28:31.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.541+0000 7fe67fa49780 1 < completed write operation key=CIB1NZHJGO46 tag=L93ZB3T7C7KX type=write size=293065 2023-12-03T11:28:31.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.543+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~5UVH6D127OBV.0 size=1048576 2023-12-03T11:28:31.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.544+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~5UVH6D127OBV.1 size=1048576 2023-12-03T11:28:31.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.545+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~5UVH6D127OBV.2 size=728236 2023-12-03T11:28:31.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.545+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=5UVH6D127OBV tag=IKPZXCDM3XCC type=write size=3873964 2023-12-03T11:28:31.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.546+0000 7fe67fa49780 1 < canceled operation key=UL24DVOA31Y7 tag=C1AWBZXKS2SV type=del size=1380087 2023-12-03T11:28:31.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.547+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=BFHILDBJ2KMH type=del size=2035556 2023-12-03T11:28:31.549 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.548+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=W0DDST93UF0G type=del 2023-12-03T11:28:31.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.549+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=JATCP44F4JIY type=del size=4092580 2023-12-03T11:28:31.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.551+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=UT1ELC6SRMJX type=del 2023-12-03T11:28:31.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.552+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=VDHL5SB8MAHZ type=del size=3674722 2023-12-03T11:28:31.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.553+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~N1NZKY2509P9.0 size=1048576 2023-12-03T11:28:31.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.554+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~N1NZKY2509P9.1 size=762586 2023-12-03T11:28:31.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.556+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=N1NZKY2509P9 tag=UC8RLXOWT0X5 type=write size=2859738 2023-12-03T11:28:31.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.558+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~H12OUTW4KJF1.0 size=1048576 2023-12-03T11:28:31.560 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.559+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~H12OUTW4KJF1.1 size=1048576 2023-12-03T11:28:31.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.560+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~H12OUTW4KJF1.2 size=380874 2023-12-03T11:28:31.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.560+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=H12OUTW4KJF1 tag=7R7VSSJDDVWS type=write size=3526602 2023-12-03T11:28:31.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.561+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=DRCIK83YCPKS type=del 2023-12-03T11:28:31.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.563+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~HEVRN4KMO4BH.0 size=160206 2023-12-03T11:28:31.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.563+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=HEVRN4KMO4BH tag=GNDZ4I9LD712 type=write size=1208782 2023-12-03T11:28:31.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.565+0000 7fe67fa49780 1 < suggested remove operation key=0G8KNJBJ9K1Z tag=1T70BJFGMRKC type=del 2023-12-03T11:28:31.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.566+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=MKTEU0NO5L0E type=del size=1303529 2023-12-03T11:28:31.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.568+0000 7fe67fa49780 1 < suggested update operation key=H8MBLWXG7BCZ tag=WA1B33VF764Q type=write size=709217 2023-12-03T11:28:31.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.570+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=8JRJETR29K0Z type=del size=1384064 2023-12-03T11:28:31.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.572+0000 7fe67fa49780 1 < suggested remove operation key=PFBGR7OF7JQG tag=NZ1YCX22TNVH type=del 2023-12-03T11:28:31.574 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.573+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=1MNUJ28AY2CT type=write size=943587 2023-12-03T11:28:31.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.574+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=5TWX8SNE3H0S type=del 2023-12-03T11:28:31.576 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.575+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=83A9X11SRZIL type=del size=341800 2023-12-03T11:28:31.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.576+0000 7fe67fa49780 1 < completed write operation key=URVD2U16EW75 tag=N1JQ29XOANGX type=write size=413177 2023-12-03T11:28:31.578 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.577+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=KFBJC4HSXND5 type=write size=579046 2023-12-03T11:28:31.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.578+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~TZLPI9KFJ2DE.0 size=1048576 2023-12-03T11:28:31.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.578+0000 7fe67fa49780 1 < canceled part key=_multipart_9OD4G28SDLB4.2~TZLPI9KFJ2DE.1 size=828156 2023-12-03T11:28:31.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.580+0000 7fe67fa49780 1 < canceled multipart upload key=9OD4G28SDLB4 upload=TZLPI9KFJ2DE tag=B1TNL3XZ69SJ type=write size=2925308 2023-12-03T11:28:31.583 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.582+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=XHFU3NB5XQZ3 type=del size=442817 2023-12-03T11:28:31.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.584+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=MJSREOM10UYD type=del 2023-12-03T11:28:31.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.586+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~DGHJ71RE1Q30.0 size=1048576 2023-12-03T11:28:31.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.586+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~DGHJ71RE1Q30.1 size=15987 2023-12-03T11:28:31.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.586+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=DGHJ71RE1Q30 tag=3I3URZ14W7AB type=write size=2113139 2023-12-03T11:28:31.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.587+0000 7fe67fa49780 1 < canceled part key=_multipart_IIW1Y6QYEODQ.2~H4MNM2CNQGTD.0 size=1048576 2023-12-03T11:28:31.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.588+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~H4MNM2CNQGTD.1 size=1048576 2023-12-03T11:28:31.589 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.588+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~H4MNM2CNQGTD.2 size=235520 2023-12-03T11:28:31.591 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.590+0000 7fe67fa49780 1 < canceled multipart upload key=IIW1Y6QYEODQ upload=H4MNM2CNQGTD tag=CJFY5EZ824WR type=write size=3381248 2023-12-03T11:28:31.592 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.591+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=IEAL1T8795N5 type=write size=928099 2023-12-03T11:28:31.593 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.593+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=PQK7ZG5T41Q5 type=del 2023-12-03T11:28:31.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.594+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=AP1L7RT0TT0B type=write size=835146 2023-12-03T11:28:31.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.595+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~13VMBIODBBZF.0 size=1048576 2023-12-03T11:28:31.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.596+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~13VMBIODBBZF.1 size=1048576 2023-12-03T11:28:31.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.597+0000 7fe67fa49780 1 < completed part key=_multipart_XZHCD4R4EVZR.2~13VMBIODBBZF.2 size=497774 2023-12-03T11:28:31.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.599+0000 7fe67fa49780 1 < completed multipart upload key=XZHCD4R4EVZR upload=13VMBIODBBZF tag=5ITOTJA4GU35 type=write size=3643502 2023-12-03T11:28:31.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.601+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~XMI3LMKZYPKA.0 size=1018661 2023-12-03T11:28:31.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.601+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=XMI3LMKZYPKA tag=GNUQUG7OFNKI type=write size=2067237 2023-12-03T11:28:31.603 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.602+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~5UVH6D127OBV.0 size=1048576 2023-12-03T11:28:31.604 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.603+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~5UVH6D127OBV.1 size=1048576 2023-12-03T11:28:31.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.604+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~5UVH6D127OBV.2 size=728236 2023-12-03T11:28:31.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.606+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=5UVH6D127OBV tag=IKPZXCDM3XCC type=write size=3873964 2023-12-03T11:28:31.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.607+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=A7PPDS4BVTZ9 type=del size=949276 2023-12-03T11:28:31.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.608+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=BFHILDBJ2KMH type=del 2023-12-03T11:28:31.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.610+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=Z4V22V0EH5CY type=del size=475755 2023-12-03T11:28:31.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.611+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=JATCP44F4JIY type=del 2023-12-03T11:28:31.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.613+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~HJTW6ZX9AXQM.0 size=575721 2023-12-03T11:28:31.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.613+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=HJTW6ZX9AXQM tag=YG0XJN4D5KWH type=write size=1624297 2023-12-03T11:28:31.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.614+0000 7fe67fa49780 1 < canceled operation key=ASODFGLQ5VNY tag=VDHL5SB8MAHZ type=del size=3674722 2023-12-03T11:28:31.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.616+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=ZVV2F4F5JG49 type=del size=3736455 2023-12-03T11:28:31.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.617+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~H12OUTW4KJF1.0 size=1048576 2023-12-03T11:28:31.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.618+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~H12OUTW4KJF1.1 size=1048576 2023-12-03T11:28:31.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.618+0000 7fe67fa49780 1 < canceled part key=_multipart_Y0VRZR6S8FP6.2~H12OUTW4KJF1.2 size=380874 2023-12-03T11:28:31.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.620+0000 7fe67fa49780 1 < canceled multipart upload key=Y0VRZR6S8FP6 upload=H12OUTW4KJF1 tag=7R7VSSJDDVWS type=write size=3526602 2023-12-03T11:28:31.622 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.621+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=5T4ULHYZD6M2 type=del size=117552 2023-12-03T11:28:31.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.623+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~HEVRN4KMO4BH.0 size=160206 2023-12-03T11:28:31.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.625+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=HEVRN4KMO4BH tag=GNDZ4I9LD712 type=write size=1208782 2023-12-03T11:28:31.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.626+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=KZ6K79GYXKQ2 type=del size=2813448 2023-12-03T11:28:31.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.627+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=MKTEU0NO5L0E type=del 2023-12-03T11:28:31.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.630+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~TPJQJ4X6P7GW.0 size=825914 2023-12-03T11:28:31.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.630+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=TPJQJ4X6P7GW tag=NLLTLDTLGUBN type=write size=1874490 2023-12-03T11:28:31.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.631+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=8JRJETR29K0Z type=del 2023-12-03T11:28:31.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.633+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~Q9OAGLGUCMB0.0 size=1048576 2023-12-03T11:28:31.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.634+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~Q9OAGLGUCMB0.1 size=1048576 2023-12-03T11:28:31.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.635+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~Q9OAGLGUCMB0.2 size=119546 2023-12-03T11:28:31.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.635+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=Q9OAGLGUCMB0 tag=C4O3DIRK2JAS type=write size=3265274 2023-12-03T11:28:31.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.637+0000 7fe67fa49780 1 < completed write operation key=6LQ18VAE3ZN6 tag=1MNUJ28AY2CT type=write size=943587 2023-12-03T11:28:31.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.639+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~VDE3F4XB7NVL.0 size=147300 2023-12-03T11:28:31.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.639+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=VDE3F4XB7NVL tag=TZ25109Y895Z type=write size=1195876 2023-12-03T11:28:31.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.640+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=83A9X11SRZIL type=del 2023-12-03T11:28:31.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.642+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=55YA1RXZRZEQ type=del size=2423015 2023-12-03T11:28:31.644 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.643+0000 7fe67fa49780 1 < completed write operation key=PFBGR7OF7JQG tag=KFBJC4HSXND5 type=write size=579046 2023-12-03T11:28:31.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.645+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~T32SCWXAUDSC.0 size=713558 2023-12-03T11:28:31.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.645+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=T32SCWXAUDSC tag=HZVB8BFIUNT7 type=write size=1762134 2023-12-03T11:28:31.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.648+0000 7fe67fa49780 1 < suggested remove operation key=Y0VRZR6S8FP6 tag=XHFU3NB5XQZ3 type=del 2023-12-03T11:28:31.650 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.649+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=0JES6R1W7SXR type=del size=1442406 2023-12-03T11:28:31.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.650+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~DGHJ71RE1Q30.0 size=1048576 2023-12-03T11:28:31.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.651+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~DGHJ71RE1Q30.1 size=15987 2023-12-03T11:28:31.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.654+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=DGHJ71RE1Q30 tag=3I3URZ14W7AB type=write size=2113139 2023-12-03T11:28:31.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.656+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~KI2SRT1LLW40.0 size=678454 2023-12-03T11:28:31.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.656+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=KI2SRT1LLW40 tag=8AZKE1RZA49W type=write size=1727030 2023-12-03T11:28:31.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.657+0000 7fe67fa49780 1 < completed write operation key=8UZJU9PNWIB6 tag=IEAL1T8795N5 type=write size=928099 2023-12-03T11:28:31.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.659+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~ZRJTBS7CAQVA.0 size=1048576 2023-12-03T11:28:31.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.660+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~ZRJTBS7CAQVA.1 size=1048576 2023-12-03T11:28:31.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.661+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~ZRJTBS7CAQVA.2 size=1017561 2023-12-03T11:28:31.662 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.661+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=ZRJTBS7CAQVA tag=CJ6LAV1BQRZK type=write size=4163289 2023-12-03T11:28:31.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.664+0000 7fe67fa49780 1 < suggested update operation key=OH2XUEEYL9JO tag=AP1L7RT0TT0B type=write size=835146 2023-12-03T11:28:31.666 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.665+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=0J1S98TIGQOT type=del size=1607803 2023-12-03T11:28:31.666 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.665+0000 7fe67fa49780 1 < canceled part key=_multipart_SXVBDBJ5B09V.2~XMI3LMKZYPKA.0 size=1018661 2023-12-03T11:28:31.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.667+0000 7fe67fa49780 1 < canceled multipart upload key=SXVBDBJ5B09V upload=XMI3LMKZYPKA tag=GNUQUG7OFNKI type=write size=2067237 2023-12-03T11:28:31.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.669+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~48Y7MLUC4DF7.0 size=264883 2023-12-03T11:28:31.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.669+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=48Y7MLUC4DF7 tag=1ZBV5AR8WRM6 type=write size=1313459 2023-12-03T11:28:31.671 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.670+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=A7PPDS4BVTZ9 type=del 2023-12-03T11:28:31.672 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.672+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=304HT1TZI1QF type=write size=732438 2023-12-03T11:28:31.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.672+0000 7fe67fa49780 -1 < no bi entry to suggest for operation key=Y0VRZR6S8FP6 tag=Z4V22V0EH5CY type=del size=475755: (2) No such file or directory 2023-12-03T11:28:31.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.674+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~UYVRIIVHAAKS.0 size=785584 2023-12-03T11:28:31.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.674+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=UYVRIIVHAAKS tag=UDD0K16RQ7BH type=write size=1834160 2023-12-03T11:28:31.676 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.675+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~HJTW6ZX9AXQM.0 size=575721 2023-12-03T11:28:31.678 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.677+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=HJTW6ZX9AXQM tag=YG0XJN4D5KWH type=write size=1624297 2023-12-03T11:28:31.679 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.678+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=13NIXMP0IO5A type=del size=1390010 2023-12-03T11:28:31.681 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.680+0000 7fe67fa49780 1 < canceled operation key=UL24DVOA31Y7 tag=ZVV2F4F5JG49 type=del size=3736455 2023-12-03T11:28:31.683 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.682+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~U4FEFS6IVPSK.0 size=1048576 2023-12-03T11:28:31.684 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.683+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~U4FEFS6IVPSK.1 size=410441 2023-12-03T11:28:31.684 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.683+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=U4FEFS6IVPSK tag=JERFO7D7QOGF type=write size=2507593 2023-12-03T11:28:31.685 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.684+0000 7fe67fa49780 -1 < failed to complete operation key=OH2XUEEYL9JO tag=5T4ULHYZD6M2 type=del size=117552: (22) Invalid argument 2023-12-03T11:28:31.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.685+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=X4F65O64VSZ8 type=del size=778544 2023-12-03T11:28:31.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.686+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=KZ6K79GYXKQ2 type=del 2023-12-03T11:28:31.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.687+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=YO7E5VI1O3VM type=del size=1849047 2023-12-03T11:28:31.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.689+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~TPJQJ4X6P7GW.0 size=825914 2023-12-03T11:28:31.691 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.690+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=TPJQJ4X6P7GW tag=NLLTLDTLGUBN type=write size=1874490 2023-12-03T11:28:31.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.692+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=PYFZ26MV7OR1 type=del size=494463 2023-12-03T11:28:31.694 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.693+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~Q9OAGLGUCMB0.0 size=1048576 2023-12-03T11:28:31.695 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.694+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~Q9OAGLGUCMB0.1 size=1048576 2023-12-03T11:28:31.697 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.696+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~Q9OAGLGUCMB0.2 size=119546 2023-12-03T11:28:31.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.699+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=Q9OAGLGUCMB0 tag=C4O3DIRK2JAS type=write size=3265274 2023-12-03T11:28:31.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.701+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=8IYNHY0B1YYA type=del size=801006 2023-12-03T11:28:31.703 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.702+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~VDE3F4XB7NVL.0 size=147300 2023-12-03T11:28:31.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.704+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=VDE3F4XB7NVL tag=TZ25109Y895Z type=write size=1195876 2023-12-03T11:28:31.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.705+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=JGAVWJOKT323 type=del size=3981687 2023-12-03T11:28:31.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.706+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=55YA1RXZRZEQ type=del 2023-12-03T11:28:31.709 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.708+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~6H0OQYGI47TD.0 size=1048576 2023-12-03T11:28:31.710 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.709+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~6H0OQYGI47TD.1 size=979915 2023-12-03T11:28:31.710 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.709+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=6H0OQYGI47TD tag=0MGRQXKWJHYO type=write size=3077067 2023-12-03T11:28:31.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.709+0000 7fe67fa49780 1 < canceled part key=_multipart_TXVHRE03Z3DA.2~T32SCWXAUDSC.0 size=713558 2023-12-03T11:28:31.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.711+0000 7fe67fa49780 1 < canceled multipart upload key=TXVHRE03Z3DA upload=T32SCWXAUDSC tag=HZVB8BFIUNT7 type=write size=1762134 2023-12-03T11:28:31.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.714+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~M7UWUYEWLFX6.0 size=1048576 2023-12-03T11:28:31.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.714+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~M7UWUYEWLFX6.1 size=1048576 2023-12-03T11:28:31.716 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.715+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~M7UWUYEWLFX6.2 size=400758 2023-12-03T11:28:31.716 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.715+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=M7UWUYEWLFX6 tag=PQ6JAD426BOT type=write size=3546486 2023-12-03T11:28:31.718 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.717+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=0JES6R1W7SXR type=del 2023-12-03T11:28:31.719 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.718+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=6JPOLKDFJK1I type=write size=122180 2023-12-03T11:28:31.720 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.719+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~KI2SRT1LLW40.0 size=678454 2023-12-03T11:28:31.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.721+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=KI2SRT1LLW40 tag=8AZKE1RZA49W type=write size=1727030 2023-12-03T11:28:31.723 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.722+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=PYQV2NMC4GJJ type=del size=812981 2023-12-03T11:28:31.724 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.723+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~ZRJTBS7CAQVA.0 size=1048576 2023-12-03T11:28:31.725 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.724+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~ZRJTBS7CAQVA.1 size=1048576 2023-12-03T11:28:31.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.725+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~ZRJTBS7CAQVA.2 size=1017561 2023-12-03T11:28:31.728 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.727+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=ZRJTBS7CAQVA tag=CJ6LAV1BQRZK type=write size=4163289 2023-12-03T11:28:31.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.729+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~R64NMDSHV1W3.0 size=1048576 2023-12-03T11:28:31.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.730+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~R64NMDSHV1W3.1 size=1048576 2023-12-03T11:28:31.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.731+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~R64NMDSHV1W3.2 size=1004987 2023-12-03T11:28:31.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.731+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=R64NMDSHV1W3 tag=VTGOCVOR400W type=write size=4150715 2023-12-03T11:28:31.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.732+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=0J1S98TIGQOT type=del 2023-12-03T11:28:31.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.734+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=EF4IPW4QOJYJ type=write size=748305 2023-12-03T11:28:31.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.735+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~48Y7MLUC4DF7.0 size=264883 2023-12-03T11:28:31.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.737+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=48Y7MLUC4DF7 tag=1ZBV5AR8WRM6 type=write size=1313459 2023-12-03T11:28:31.739 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.738+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=ZP3PEG6GXQSF type=write size=500562 2023-12-03T11:28:31.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.739+0000 7fe67fa49780 1 < completed write operation key=983BDZLASC3S tag=304HT1TZI1QF type=write size=732438 2023-12-03T11:28:31.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.740+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=O47UWS3DBZPN type=del size=1586325 2023-12-03T11:28:31.742 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.741+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~UYVRIIVHAAKS.0 size=785584 2023-12-03T11:28:31.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.743+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=UYVRIIVHAAKS tag=UDD0K16RQ7BH type=write size=1834160 2023-12-03T11:28:31.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.745+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~4WD3MLLKAEGI.0 size=64563 2023-12-03T11:28:31.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.745+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=4WD3MLLKAEGI tag=3WPG513WHB86 type=write size=1113139 2023-12-03T11:28:31.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.747+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=13NIXMP0IO5A type=del 2023-12-03T11:28:31.750 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.749+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~5PU8NN6205YB.0 size=1048576 2023-12-03T11:28:31.751 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.750+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~5PU8NN6205YB.1 size=448271 2023-12-03T11:28:31.751 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.750+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=5PU8NN6205YB tag=NRK7SBXFQW7U type=write size=2545423 2023-12-03T11:28:31.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.751+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~U4FEFS6IVPSK.0 size=1048576 2023-12-03T11:28:31.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.752+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~U4FEFS6IVPSK.1 size=410441 2023-12-03T11:28:31.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.754+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=U4FEFS6IVPSK tag=JERFO7D7QOGF type=write size=2507593 2023-12-03T11:28:31.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.755+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=R2BRYKWSUE5V type=del size=1788316 2023-12-03T11:28:31.757 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.756+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=X4F65O64VSZ8 type=del 2023-12-03T11:28:31.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.758+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~4UTCF4EOEIXL.0 size=1048576 2023-12-03T11:28:31.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.759+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~4UTCF4EOEIXL.1 size=589522 2023-12-03T11:28:31.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.759+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=4UTCF4EOEIXL tag=HRAMQTVKR4T1 type=write size=2686674 2023-12-03T11:28:31.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.760+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=YO7E5VI1O3VM type=del 2023-12-03T11:28:31.762 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.761+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=IHRLW5TGNBMN type=del size=1136272 2023-12-03T11:28:31.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.764+0000 7fe67fa49780 1 < suggested remove operation key=DDHGOWEI7WEI tag=PYFZ26MV7OR1 type=del 2023-12-03T11:28:31.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.766+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~5NBNZ0C408R4.0 size=1048576 2023-12-03T11:28:31.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.767+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~5NBNZ0C408R4.1 size=1048576 2023-12-03T11:28:31.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.768+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~5NBNZ0C408R4.2 size=1001134 2023-12-03T11:28:31.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.768+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=5NBNZ0C408R4 tag=03K6FTBOVLU9 type=write size=4146862 2023-12-03T11:28:31.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.769+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=8IYNHY0B1YYA type=del 2023-12-03T11:28:31.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.770+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=7N0JWOQAQOO3 type=del size=1141904 2023-12-03T11:28:31.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.771+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=JGAVWJOKT323 type=del 2023-12-03T11:28:31.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.773+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=A26HLEVB9KXK type=del size=1008198 2023-12-03T11:28:31.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.773+0000 7fe67fa49780 1 < canceled part key=_multipart_983BDZLASC3S.2~6H0OQYGI47TD.0 size=1048576 2023-12-03T11:28:31.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.774+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~6H0OQYGI47TD.1 size=979915 2023-12-03T11:28:31.777 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.776+0000 7fe67fa49780 1 < canceled multipart upload key=983BDZLASC3S upload=6H0OQYGI47TD tag=0MGRQXKWJHYO type=write size=3077067 2023-12-03T11:28:31.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.777+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=D4EGEOXFCUWQ type=del size=3252491 2023-12-03T11:28:31.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.778+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~M7UWUYEWLFX6.0 size=1048576 2023-12-03T11:28:31.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.779+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~M7UWUYEWLFX6.1 size=1048576 2023-12-03T11:28:31.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.779+0000 7fe67fa49780 1 < canceled part key=_multipart_0GQZY07Y2PVI.2~M7UWUYEWLFX6.2 size=400758 2023-12-03T11:28:31.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.781+0000 7fe67fa49780 1 < canceled multipart upload key=0GQZY07Y2PVI upload=M7UWUYEWLFX6 tag=PQ6JAD426BOT type=write size=3546486 2023-12-03T11:28:31.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.782+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=OE12YEM94H5I type=write size=813396 2023-12-03T11:28:31.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.784+0000 7fe67fa49780 1 < completed write operation key=CIB1NZHJGO46 tag=6JPOLKDFJK1I type=write size=122180 2023-12-03T11:28:31.787 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.786+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~VY1E1APJE0I4.0 size=1048576 2023-12-03T11:28:31.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.787+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~VY1E1APJE0I4.1 size=248328 2023-12-03T11:28:31.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.787+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=VY1E1APJE0I4 tag=4BANIBDPA0MA type=write size=2345480 2023-12-03T11:28:31.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.789+0000 7fe67fa49780 1 < suggested remove operation key=6LQ18VAE3ZN6 tag=PYQV2NMC4GJJ type=del 2023-12-03T11:28:31.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.790+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=0W8AV1X3IYFB type=write size=357711 2023-12-03T11:28:31.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.791+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~R64NMDSHV1W3.0 size=1048576 2023-12-03T11:28:31.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.792+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~R64NMDSHV1W3.1 size=1048576 2023-12-03T11:28:31.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.793+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~R64NMDSHV1W3.2 size=1004987 2023-12-03T11:28:31.796 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.795+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=R64NMDSHV1W3 tag=VTGOCVOR400W type=write size=4150715 2023-12-03T11:28:31.798 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.797+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~7L4KFTE0HUC2.0 size=1048576 2023-12-03T11:28:31.799 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.798+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~7L4KFTE0HUC2.1 size=1048576 2023-12-03T11:28:31.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.799+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~7L4KFTE0HUC2.2 size=91894 2023-12-03T11:28:31.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.799+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=7L4KFTE0HUC2 tag=JFH649Y227SY type=write size=3237622 2023-12-03T11:28:31.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.801+0000 7fe67fa49780 1 < suggested update operation key=SIES92K9QVJV tag=EF4IPW4QOJYJ type=write size=748305 2023-12-03T11:28:31.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.803+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=8RA8A5GA78PG type=write size=137259 2023-12-03T11:28:31.805 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.804+0000 7fe67fa49780 1 < completed write operation key=983BDZLASC3S tag=ZP3PEG6GXQSF type=write size=500562 2023-12-03T11:28:31.808 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.807+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~VUAIJ8DXD9KN.0 size=474763 2023-12-03T11:28:31.808 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.807+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=VUAIJ8DXD9KN tag=FHNTPHJQSRXX type=write size=1523339 2023-12-03T11:28:31.811 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.810+0000 7fe67fa49780 1 < suggested remove operation key=9OD4G28SDLB4 tag=O47UWS3DBZPN type=del 2023-12-03T11:28:31.812 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.811+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=GF3RTR2HZVNG type=del size=3119813 2023-12-03T11:28:31.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.812+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~4WD3MLLKAEGI.0 size=64563 2023-12-03T11:28:31.815 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.814+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=4WD3MLLKAEGI tag=3WPG513WHB86 type=write size=1113139 2023-12-03T11:28:31.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.815+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=7ILDKBSJTXAT type=del size=2113719 2023-12-03T11:28:31.817 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.817+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~5PU8NN6205YB.0 size=1048576 2023-12-03T11:28:31.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.817+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~5PU8NN6205YB.1 size=448271 2023-12-03T11:28:31.820 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.819+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=5PU8NN6205YB tag=NRK7SBXFQW7U type=write size=2545423 2023-12-03T11:28:31.822 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.821+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=LC6XD5VIQJII type=del size=3295927 2023-12-03T11:28:31.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.822+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=R2BRYKWSUE5V type=del 2023-12-03T11:28:31.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.823+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=XHN5JT28CY52 type=del size=1206438 2023-12-03T11:28:31.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.824+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~4UTCF4EOEIXL.0 size=1048576 2023-12-03T11:28:31.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.825+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~4UTCF4EOEIXL.1 size=589522 2023-12-03T11:28:31.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.827+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=4UTCF4EOEIXL tag=HRAMQTVKR4T1 type=write size=2686674 2023-12-03T11:28:31.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.828+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=VS9ALDH1YB5E type=del size=1424567 2023-12-03T11:28:31.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.831+0000 7fe67fa49780 1 < suggested remove operation key=YEMPVKMDANPG tag=IHRLW5TGNBMN type=del 2023-12-03T11:28:31.833 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.832+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=TT7YVE3JYLWX type=write size=586117 2023-12-03T11:28:31.833 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.832+0000 7fe67fa49780 1 < canceled part key=_multipart_P05UIP1IU4Z7.2~5NBNZ0C408R4.0 size=1048576 2023-12-03T11:28:31.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.833+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~5NBNZ0C408R4.1 size=1048576 2023-12-03T11:28:31.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.834+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~5NBNZ0C408R4.2 size=1001134 2023-12-03T11:28:31.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.836+0000 7fe67fa49780 1 < canceled multipart upload key=P05UIP1IU4Z7 upload=5NBNZ0C408R4 tag=03K6FTBOVLU9 type=write size=4146862 2023-12-03T11:28:31.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.837+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=EXIFAQT0KQXQ type=write size=981552 2023-12-03T11:28:31.839 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.838+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=7N0JWOQAQOO3 type=del 2023-12-03T11:28:31.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.839+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=QL5BMBNOGN9Y type=del size=4144454 2023-12-03T11:28:31.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.841+0000 7fe67fa49780 -1 < failed to complete operation key=9OD4G28SDLB4 tag=A26HLEVB9KXK type=del size=1008198: (22) Invalid argument 2023-12-03T11:28:31.843 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.842+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=YAZR82BGXY3W type=del size=2145855 2023-12-03T11:28:31.844 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.843+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=D4EGEOXFCUWQ type=del 2023-12-03T11:28:31.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.845+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~YY3TVHE5D4UE.0 size=1048576 2023-12-03T11:28:31.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.846+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~YY3TVHE5D4UE.1 size=1048576 2023-12-03T11:28:31.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.847+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~YY3TVHE5D4UE.2 size=352292 2023-12-03T11:28:31.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.847+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=YY3TVHE5D4UE tag=BLZJNNEQ3ROX type=write size=3498020 2023-12-03T11:28:31.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.848+0000 7fe67fa49780 -1 < failed to complete operation key=9OD4G28SDLB4 tag=OE12YEM94H5I type=write size=813396: (22) Invalid argument 2023-12-03T11:28:31.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.850+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~6U2Z2JCL2EHM.0 size=1048576 2023-12-03T11:28:31.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.851+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~6U2Z2JCL2EHM.1 size=414338 2023-12-03T11:28:31.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.851+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=6U2Z2JCL2EHM tag=NW4B06NTKN0V type=write size=2511490 2023-12-03T11:28:31.853 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.853+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~VY1E1APJE0I4.0 size=1048576 2023-12-03T11:28:31.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.854+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~VY1E1APJE0I4.1 size=248328 2023-12-03T11:28:31.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.855+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=VY1E1APJE0I4 tag=4BANIBDPA0MA type=write size=2345480 2023-12-03T11:28:31.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.857+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=VXLS4UWMDT8D type=del size=1355799 2023-12-03T11:28:31.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.859+0000 7fe67fa49780 1 < suggested remove operation key=006X4CSXV0KA tag=0W8AV1X3IYFB type=write 2023-12-03T11:28:31.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.861+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~JYUPCQRKMOM0.0 size=560829 2023-12-03T11:28:31.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.861+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=JYUPCQRKMOM0 tag=E5G6AUX1OM7G type=write size=1609405 2023-12-03T11:28:31.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.862+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~7L4KFTE0HUC2.0 size=1048576 2023-12-03T11:28:31.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.863+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~7L4KFTE0HUC2.1 size=1048576 2023-12-03T11:28:31.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.863+0000 7fe67fa49780 1 < canceled part key=_multipart_ASODFGLQ5VNY.2~7L4KFTE0HUC2.2 size=91894 2023-12-03T11:28:31.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.865+0000 7fe67fa49780 1 < canceled multipart upload key=ASODFGLQ5VNY upload=7L4KFTE0HUC2 tag=JFH649Y227SY type=write size=3237622 2023-12-03T11:28:31.867 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.866+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=28ZDK9GIA6Q9 type=del size=2422499 2023-12-03T11:28:31.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.868+0000 7fe67fa49780 1 < suggested remove operation key=YEMPVKMDANPG tag=8RA8A5GA78PG type=write 2023-12-03T11:28:31.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.869+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=6NYY91KDEQEY type=del size=3961880 2023-12-03T11:28:31.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.871+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~VUAIJ8DXD9KN.0 size=474763 2023-12-03T11:28:31.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.873+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=VUAIJ8DXD9KN tag=FHNTPHJQSRXX type=write size=1523339 2023-12-03T11:28:31.875 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.874+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=H8X3DQALADV0 type=del size=1423671 2023-12-03T11:28:31.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.875+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=GF3RTR2HZVNG type=del 2023-12-03T11:28:31.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.877+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~F4C3CPVEL5RV.0 size=1048576 2023-12-03T11:28:31.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.878+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~F4C3CPVEL5RV.1 size=764070 2023-12-03T11:28:31.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.878+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=F4C3CPVEL5RV tag=8Y32D0RLPZ1E type=write size=2861222 2023-12-03T11:28:31.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.879+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=7ILDKBSJTXAT type=del 2023-12-03T11:28:31.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.881+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=ZVS4SC5YW01R type=del size=738140 2023-12-03T11:28:31.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.882+0000 7fe67fa49780 1 < canceled operation key=8UZJU9PNWIB6 tag=LC6XD5VIQJII type=del size=3295927 2023-12-03T11:28:31.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.883+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=UQD7G14P1U52 type=del size=1243456 2023-12-03T11:28:31.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.884+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=XHN5JT28CY52 type=del 2023-12-03T11:28:31.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.886+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~GMLE1FM749QV.0 size=1048576 2023-12-03T11:28:31.888 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.887+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~GMLE1FM749QV.1 size=316311 2023-12-03T11:28:31.888 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.887+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=GMLE1FM749QV tag=SI1XZDVC5D6N type=write size=2413463 2023-12-03T11:28:31.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.889+0000 7fe67fa49780 1 < suggested update operation key=Q6GBIBMIJRKV tag=VS9ALDH1YB5E type=del size=1424567 2023-12-03T11:28:31.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.891+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=KS9L4JIFEBR0 type=del size=1253984 2023-12-03T11:28:31.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.892+0000 7fe67fa49780 -1 < failed to complete operation key=YEMPVKMDANPG tag=TT7YVE3JYLWX type=write size=586117: (22) Invalid argument 2023-12-03T11:28:31.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.893+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=NQO2S5KE96N8 type=del size=998032 2023-12-03T11:28:31.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.894+0000 7fe67fa49780 1 < completed write operation key=URVD2U16EW75 tag=EXIFAQT0KQXQ type=write size=981552 2023-12-03T11:28:31.896 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.895+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=ETMG8GLBP9M5 type=write size=590902 2023-12-03T11:28:31.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.898+0000 7fe67fa49780 1 < suggested update operation key=6LQ18VAE3ZN6 tag=QL5BMBNOGN9Y type=del size=4144454 2023-12-03T11:28:31.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.899+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=XB749HZA412E type=del size=1506591 2023-12-03T11:28:31.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.901+0000 7fe67fa49780 1 < suggested remove operation key=DDHGOWEI7WEI tag=YAZR82BGXY3W type=del 2023-12-03T11:28:31.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.902+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=Y4E1MA5FXIJ4 type=write size=15426 2023-12-03T11:28:31.904 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.903+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~YY3TVHE5D4UE.0 size=1048576 2023-12-03T11:28:31.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.904+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~YY3TVHE5D4UE.1 size=1048576 2023-12-03T11:28:31.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.905+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~YY3TVHE5D4UE.2 size=352292 2023-12-03T11:28:31.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.907+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=YY3TVHE5D4UE tag=BLZJNNEQ3ROX type=write size=3498020 2023-12-03T11:28:31.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.909+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=X5QHLVJBRHZO type=del size=240515 2023-12-03T11:28:31.911 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.910+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~6U2Z2JCL2EHM.0 size=1048576 2023-12-03T11:28:31.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.911+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~6U2Z2JCL2EHM.1 size=414338 2023-12-03T11:28:31.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.913+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=6U2Z2JCL2EHM tag=NW4B06NTKN0V type=write size=2511490 2023-12-03T11:28:31.915 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.914+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=QZVLXG4A5WQO type=del size=1404531 2023-12-03T11:28:31.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.917+0000 7fe67fa49780 1 < suggested update operation key=SIES92K9QVJV tag=VXLS4UWMDT8D type=del size=1355799 2023-12-03T11:28:31.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.918+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=MA3DO8KIEVJ7 type=del size=3020003 2023-12-03T11:28:31.921 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.920+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~JYUPCQRKMOM0.0 size=560829 2023-12-03T11:28:31.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.923+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=JYUPCQRKMOM0 tag=E5G6AUX1OM7G type=write size=1609405 2023-12-03T11:28:31.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.924+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=JC16SVVXJ9EM type=del size=334977 2023-12-03T11:28:31.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.925+0000 7fe67fa49780 -1 < failed to complete operation key=YEMPVKMDANPG tag=28ZDK9GIA6Q9 type=del size=2422499: (22) Invalid argument 2023-12-03T11:28:31.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.927+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~5TT7XDNH02UV.0 size=1048576 2023-12-03T11:28:31.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.928+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~5TT7XDNH02UV.1 size=119520 2023-12-03T11:28:31.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.928+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=5TT7XDNH02UV tag=D3ECKRAJ6RYP type=write size=2216672 2023-12-03T11:28:31.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.930+0000 7fe67fa49780 -1 < failed to complete operation key=SIES92K9QVJV tag=6NYY91KDEQEY type=del size=3961880: (22) Invalid argument 2023-12-03T11:28:31.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.932+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~I1XZZX9N7U38.0 size=1048576 2023-12-03T11:28:31.934 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.933+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~I1XZZX9N7U38.1 size=1034211 2023-12-03T11:28:31.934 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.933+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=I1XZZX9N7U38 tag=TKG8PXAWEL41 type=write size=3131363 2023-12-03T11:28:31.936 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.935+0000 7fe67fa49780 1 < suggested update operation key=YEMPVKMDANPG tag=H8X3DQALADV0 type=del size=1423671 2023-12-03T11:28:31.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.937+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=8UL7PGGE01A9 type=del size=1431435 2023-12-03T11:28:31.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.938+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~F4C3CPVEL5RV.0 size=1048576 2023-12-03T11:28:31.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.939+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~F4C3CPVEL5RV.1 size=764070 2023-12-03T11:28:31.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.941+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=F4C3CPVEL5RV tag=8Y32D0RLPZ1E type=write size=2861222 2023-12-03T11:28:31.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.942+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=DBT60E37IYQD type=write size=857284 2023-12-03T11:28:31.944 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.944+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=ZVS4SC5YW01R type=del 2023-12-03T11:28:31.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.945+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=7FSSY60UR8SO type=del size=716108 2023-12-03T11:28:31.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.946+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=UQD7G14P1U52 type=del 2023-12-03T11:28:31.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.948+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~2AJZWM0VKT8J.0 size=862831 2023-12-03T11:28:31.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.948+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=2AJZWM0VKT8J tag=QC9CQQVDIPAN type=write size=1911407 2023-12-03T11:28:31.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.950+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~GMLE1FM749QV.0 size=1048576 2023-12-03T11:28:31.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.951+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~GMLE1FM749QV.1 size=316311 2023-12-03T11:28:31.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.953+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=GMLE1FM749QV tag=SI1XZDVC5D6N type=write size=2413463 2023-12-03T11:28:31.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.954+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=1Q8A0RF3LH9Q type=del size=3993355 2023-12-03T11:28:31.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.955+0000 7fe67fa49780 -1 < failed to complete operation key=DDHGOWEI7WEI tag=KS9L4JIFEBR0 type=del size=1253984: (22) Invalid argument 2023-12-03T11:28:31.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.957+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~8IAMQ61X0UCH.0 size=306845 2023-12-03T11:28:31.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.957+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=8IAMQ61X0UCH tag=SXIV4AI8X85E type=write size=1355421 2023-12-03T11:28:31.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.959+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=NQO2S5KE96N8 type=del 2023-12-03T11:28:31.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.960+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=VSEG9UJOVL4O type=del size=1816503 2023-12-03T11:28:31.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.961+0000 7fe67fa49780 1 < completed write operation key=983BDZLASC3S tag=ETMG8GLBP9M5 type=write size=590902 2023-12-03T11:28:31.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.963+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~BC4RQFLJ7SKM.0 size=1048576 2023-12-03T11:28:31.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.964+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~BC4RQFLJ7SKM.1 size=728360 2023-12-03T11:28:31.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.964+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=BC4RQFLJ7SKM tag=UFRJPA0AA0TR type=write size=2825512 2023-12-03T11:28:31.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.965+0000 7fe67fa49780 1 < completed delete operation key=CC1X1OP7L6BJ tag=XB749HZA412E type=del 2023-12-03T11:28:31.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.966+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=CEEXSFJBGZP1 type=del size=430832 2023-12-03T11:28:31.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.968+0000 7fe67fa49780 1 < canceled operation key=9OD4G28SDLB4 tag=Y4E1MA5FXIJ4 type=write size=15426 2023-12-03T11:28:31.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.969+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=DCLWSDK85F1T type=del size=1092066 2023-12-03T11:28:31.971 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.970+0000 7fe67fa49780 1 < completed delete operation key=Q6GBIBMIJRKV tag=X5QHLVJBRHZO type=del 2023-12-03T11:28:31.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.971+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=3Q3M4391E8GK type=del size=2999597 2023-12-03T11:28:31.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.973+0000 7fe67fa49780 1 < suggested remove operation key=UL24DVOA31Y7 tag=QZVLXG4A5WQO type=del 2023-12-03T11:28:31.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.975+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~K8L1VACMCLEE.0 size=540099 2023-12-03T11:28:31.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.975+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=K8L1VACMCLEE tag=VOW8V61WY2GS type=write size=1588675 2023-12-03T11:28:31.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.977+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=MA3DO8KIEVJ7 type=del 2023-12-03T11:28:31.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.978+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=ZBNCFG85TWYG type=del size=1286841 2023-12-03T11:28:31.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.979+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=JC16SVVXJ9EM type=del 2023-12-03T11:28:31.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.981+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~PJFW31XZHMQT.0 size=934820 2023-12-03T11:28:31.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.981+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=PJFW31XZHMQT tag=39KY0AFQM7JG type=write size=1983396 2023-12-03T11:28:31.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.983+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~5TT7XDNH02UV.0 size=1048576 2023-12-03T11:28:31.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.984+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~5TT7XDNH02UV.1 size=119520 2023-12-03T11:28:31.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.986+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=5TT7XDNH02UV tag=D3ECKRAJ6RYP type=write size=2216672 2023-12-03T11:28:31.988 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.987+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=WMLXZOM85W4H type=del size=3925513 2023-12-03T11:28:31.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.988+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~I1XZZX9N7U38.0 size=1048576 2023-12-03T11:28:31.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.989+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~I1XZZX9N7U38.1 size=1034211 2023-12-03T11:28:31.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.991+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=I1XZZX9N7U38 tag=TKG8PXAWEL41 type=write size=3131363 2023-12-03T11:28:31.993 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.992+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=7YMPGL57HXJV type=del size=3570947 2023-12-03T11:28:31.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.995+0000 7fe67fa49780 1 < suggested update operation key=P05UIP1IU4Z7 tag=8UL7PGGE01A9 type=del size=1431435 2023-12-03T11:28:31.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.996+0000 7fe67fa49780 1 > prepared operation key=Z1NFEIZNYYO2 tag=HQPO1O2Q0R10 type=write size=848580 2023-12-03T11:28:31.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.997+0000 7fe67fa49780 1 < completed write operation key=YEMPVKMDANPG tag=DBT60E37IYQD type=write size=857284 2023-12-03T11:28:31.999 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:31.998+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=62B59GQXY1TR type=del size=1869687 2023-12-03T11:28:32.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.000+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=7FSSY60UR8SO type=del 2023-12-03T11:28:32.005 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.002+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~5RH9F762VFXZ.0 size=1048576 2023-12-03T11:28:32.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.003+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~5RH9F762VFXZ.1 size=1048576 2023-12-03T11:28:32.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.004+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~5RH9F762VFXZ.2 size=322301 2023-12-03T11:28:32.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.004+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=5RH9F762VFXZ tag=TEBLLN28GM5W type=write size=3468029 2023-12-03T11:28:32.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.005+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~2AJZWM0VKT8J.0 size=862831 2023-12-03T11:28:32.008 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.007+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=2AJZWM0VKT8J tag=QC9CQQVDIPAN type=write size=1911407 2023-12-03T11:28:32.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.009+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~TRDO1BGK1AJR.0 size=538751 2023-12-03T11:28:32.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.009+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=TRDO1BGK1AJR tag=87ZJSP7DT92F type=write size=1587327 2023-12-03T11:28:32.012 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.011+0000 7fe67fa49780 1 < suggested update operation key=YEMPVKMDANPG tag=1Q8A0RF3LH9Q type=del size=3993355 2023-12-03T11:28:32.013 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.012+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=8AWMKDPXVZPI type=del size=3872199 2023-12-03T11:28:32.014 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.013+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~8IAMQ61X0UCH.0 size=306845 2023-12-03T11:28:32.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.015+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=8IAMQ61X0UCH tag=SXIV4AI8X85E type=write size=1355421 2023-12-03T11:28:32.018 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.017+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~VQUU4CU02YCK.0 size=210778 2023-12-03T11:28:32.018 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.017+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=VQUU4CU02YCK tag=KIB5O0Q94XHP type=write size=1259354 2023-12-03T11:28:32.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.018+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=VSEG9UJOVL4O type=del 2023-12-03T11:28:32.020 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.019+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=7H955Z6ZCEVA type=del size=872246 2023-12-03T11:28:32.021 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.020+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~BC4RQFLJ7SKM.0 size=1048576 2023-12-03T11:28:32.021 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.020+0000 7fe67fa49780 1 < canceled part key=_multipart_0GQZY07Y2PVI.2~BC4RQFLJ7SKM.1 size=728360 2023-12-03T11:28:32.023 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.022+0000 7fe67fa49780 1 < canceled multipart upload key=0GQZY07Y2PVI upload=BC4RQFLJ7SKM tag=UFRJPA0AA0TR type=write size=2825512 2023-12-03T11:28:32.024 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.024+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=K1DZXK3811Q9 type=del size=685159 2023-12-03T11:28:32.027 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.026+0000 7fe67fa49780 1 < suggested update operation key=SXVBDBJ5B09V tag=CEEXSFJBGZP1 type=del size=430832 2023-12-03T11:28:32.029 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.029+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~0M8QJI4ZBP5F.0 size=1048576 2023-12-03T11:28:32.031 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.030+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~0M8QJI4ZBP5F.1 size=597772 2023-12-03T11:28:32.031 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.030+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=0M8QJI4ZBP5F tag=FWH4GSS1B81F type=write size=2694924 2023-12-03T11:28:32.033 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.032+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=DCLWSDK85F1T type=del 2023-12-03T11:28:32.035 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.034+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~M2ZNSOCW25W4.0 size=1048576 2023-12-03T11:28:32.036 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.035+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~M2ZNSOCW25W4.1 size=1048576 2023-12-03T11:28:32.038 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.036+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~M2ZNSOCW25W4.2 size=936313 2023-12-03T11:28:32.038 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.036+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=M2ZNSOCW25W4 tag=SEH9EBV9LPUW type=write size=4082041 2023-12-03T11:28:32.040 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.039+0000 7fe67fa49780 1 < suggested remove operation key=PFBGR7OF7JQG tag=3Q3M4391E8GK type=del 2023-12-03T11:28:32.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.040+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=0H7SVJOFUHQX type=del size=2952337 2023-12-03T11:28:32.043 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.042+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~K8L1VACMCLEE.0 size=540099 2023-12-03T11:28:32.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.044+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=K8L1VACMCLEE tag=VOW8V61WY2GS type=write size=1588675 2023-12-03T11:28:32.046 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.045+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=623OQFNM9U8Q type=del size=1803889 2023-12-03T11:28:32.049 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.048+0000 7fe67fa49780 1 < suggested remove operation key=A7GOX2W0WB83 tag=ZBNCFG85TWYG type=del 2023-12-03T11:28:32.050 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.049+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=VR2ABB7WQ90H type=write size=716642 2023-12-03T11:28:32.050 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.049+0000 7fe67fa49780 1 < canceled part key=_multipart_OH2XUEEYL9JO.2~PJFW31XZHMQT.0 size=934820 2023-12-03T11:28:32.052 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.051+0000 7fe67fa49780 1 < canceled multipart upload key=OH2XUEEYL9JO upload=PJFW31XZHMQT tag=39KY0AFQM7JG type=write size=1983396 2023-12-03T11:28:32.053 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.052+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=T0EYZD8OMNAR type=del size=1485183 2023-12-03T11:28:32.054 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.053+0000 7fe67fa49780 -1 < failed to complete operation key=P05UIP1IU4Z7 tag=WMLXZOM85W4H type=del size=3925513: (22) Invalid argument 2023-12-03T11:28:32.055 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.054+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=RTJTOKPKS1B2 type=del size=1224568 2023-12-03T11:28:32.057 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.056+0000 7fe67fa49780 1 < completed delete operation key=Z1NFEIZNYYO2 tag=7YMPGL57HXJV type=del 2023-12-03T11:28:32.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.057+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=ZYVGSTFIWO03 type=del size=2267040 2023-12-03T11:28:32.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.058+0000 7fe67fa49780 1 < completed write operation key=Z1NFEIZNYYO2 tag=HQPO1O2Q0R10 type=write size=848580 2023-12-03T11:28:32.060 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.059+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=RAS4SUUIDJ12 type=del size=3378607 2023-12-03T11:28:32.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.061+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=62B59GQXY1TR type=del 2023-12-03T11:28:32.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.062+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=PXR3EXT8Q0IY type=del size=3473910 2023-12-03T11:28:32.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.063+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~5RH9F762VFXZ.0 size=1048576 2023-12-03T11:28:32.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.064+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~5RH9F762VFXZ.1 size=1048576 2023-12-03T11:28:32.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.065+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~5RH9F762VFXZ.2 size=322301 2023-12-03T11:28:32.068 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.067+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=5RH9F762VFXZ tag=TEBLLN28GM5W type=write size=3468029 2023-12-03T11:28:32.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.068+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=R41TLFZVAJKL type=write size=581874 2023-12-03T11:28:32.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.068+0000 7fe67fa49780 1 < canceled part key=_multipart_983BDZLASC3S.2~TRDO1BGK1AJR.0 size=538751 2023-12-03T11:28:32.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.070+0000 7fe67fa49780 1 < canceled multipart upload key=983BDZLASC3S upload=TRDO1BGK1AJR tag=87ZJSP7DT92F type=write size=1587327 2023-12-03T11:28:32.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.073+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~NRTL4XZXMGZ4.0 size=1048576 2023-12-03T11:28:32.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.074+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~NRTL4XZXMGZ4.1 size=1048576 2023-12-03T11:28:32.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.075+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~NRTL4XZXMGZ4.2 size=953135 2023-12-03T11:28:32.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.075+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=NRTL4XZXMGZ4 tag=7EBB2S9ZG2TZ type=write size=4098863 2023-12-03T11:28:32.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.076+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=8AWMKDPXVZPI type=del 2023-12-03T11:28:32.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.077+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=M7FJ3AQWIZ94 type=del size=3872220 2023-12-03T11:28:32.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.077+0000 7fe67fa49780 1 < canceled part key=_multipart_983BDZLASC3S.2~VQUU4CU02YCK.0 size=210778 2023-12-03T11:28:32.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.079+0000 7fe67fa49780 1 < canceled multipart upload key=983BDZLASC3S upload=VQUU4CU02YCK tag=KIB5O0Q94XHP type=write size=1259354 2023-12-03T11:28:32.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.081+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~IBR70DHMW5MQ.0 size=1048576 2023-12-03T11:28:32.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.082+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~IBR70DHMW5MQ.1 size=1048576 2023-12-03T11:28:32.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.083+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~IBR70DHMW5MQ.2 size=388048 2023-12-03T11:28:32.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.083+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=IBR70DHMW5MQ tag=ZPEBBQA7H4I3 type=write size=3533776 2023-12-03T11:28:32.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.084+0000 7fe67fa49780 -1 < failed to complete operation key=A7GOX2W0WB83 tag=7H955Z6ZCEVA type=del size=872246: (22) Invalid argument 2023-12-03T11:28:32.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.085+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=HZ74SPPACTAS type=del size=1994165 2023-12-03T11:28:32.088 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.088+0000 7fe67fa49780 1 < suggested remove operation key=SIES92K9QVJV tag=K1DZXK3811Q9 type=del 2023-12-03T11:28:32.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.090+0000 7fe67fa49780 1 > prepared part key=_multipart_OH2XUEEYL9JO.2~21UKBYJ177S5.0 size=332576 2023-12-03T11:28:32.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.090+0000 7fe67fa49780 1 > prepared multipart upload key=OH2XUEEYL9JO upload=21UKBYJ177S5 tag=DNR9IW7S2Y17 type=write size=1381152 2023-12-03T11:28:32.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.091+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~0M8QJI4ZBP5F.0 size=1048576 2023-12-03T11:28:32.093 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.092+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~0M8QJI4ZBP5F.1 size=597772 2023-12-03T11:28:32.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.094+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=0M8QJI4ZBP5F tag=FWH4GSS1B81F type=write size=2694924 2023-12-03T11:28:32.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.095+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=CSSBNFTTUF4K type=del size=3044738 2023-12-03T11:28:32.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.096+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~M2ZNSOCW25W4.0 size=1048576 2023-12-03T11:28:32.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.097+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~M2ZNSOCW25W4.1 size=1048576 2023-12-03T11:28:32.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.098+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~M2ZNSOCW25W4.2 size=936313 2023-12-03T11:28:32.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.100+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=M2ZNSOCW25W4 tag=SEH9EBV9LPUW type=write size=4082041 2023-12-03T11:28:32.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.101+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=SMEAGVT6CQEM type=del size=1885541 2023-12-03T11:28:32.103 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.102+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=0H7SVJOFUHQX type=del 2023-12-03T11:28:32.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.104+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~NT9Q1Q4ERMRC.0 size=1048576 2023-12-03T11:28:32.106 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.105+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~NT9Q1Q4ERMRC.1 size=1048576 2023-12-03T11:28:32.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.106+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~NT9Q1Q4ERMRC.2 size=508243 2023-12-03T11:28:32.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.106+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=NT9Q1Q4ERMRC tag=OQKGF2CECF79 type=write size=3653971 2023-12-03T11:28:32.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.108+0000 7fe67fa49780 1 < suggested remove operation key=H8MBLWXG7BCZ tag=623OQFNM9U8Q type=del 2023-12-03T11:28:32.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.109+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=9LG0KCNSLL6D type=write size=716214 2023-12-03T11:28:32.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.111+0000 7fe67fa49780 1 < completed write operation key=N87KA638VE01 tag=VR2ABB7WQ90H type=write size=716642 2023-12-03T11:28:32.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.112+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=HI4XW6HDYZ5R type=del size=3118630 2023-12-03T11:28:32.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.114+0000 7fe67fa49780 1 < suggested remove operation key=006X4CSXV0KA tag=T0EYZD8OMNAR type=del 2023-12-03T11:28:32.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.115+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=MPR7S6M4KA4K type=del size=3639785 2023-12-03T11:28:32.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.116+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=RTJTOKPKS1B2 type=del 2023-12-03T11:28:32.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.117+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=3WUJRIKE80PE type=del size=2037494 2023-12-03T11:28:32.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.118+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=ZYVGSTFIWO03 type=del 2023-12-03T11:28:32.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.119+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=FSB0DNG0RJXC type=del size=2166585 2023-12-03T11:28:32.121 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.120+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=RAS4SUUIDJ12 type=del 2023-12-03T11:28:32.123 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.122+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=QA01S9D1ZAL2 type=del size=3681858 2023-12-03T11:28:32.124 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.123+0000 7fe67fa49780 -1 < failed to complete operation key=SIES92K9QVJV tag=PXR3EXT8Q0IY type=del size=3473910: (22) Invalid argument 2023-12-03T11:28:32.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.125+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~NVL97SF6PIBK.0 size=161595 2023-12-03T11:28:32.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.125+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=NVL97SF6PIBK tag=O6GZJA2KH4UM type=write size=1210171 2023-12-03T11:28:32.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.126+0000 7fe67fa49780 1 < completed write operation key=V9ZVWHO8IF8L tag=R41TLFZVAJKL type=write size=581874 2023-12-03T11:28:32.128 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.127+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=AJBB6Q0HBEIL type=del size=97318 2023-12-03T11:28:32.129 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.128+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~NRTL4XZXMGZ4.0 size=1048576 2023-12-03T11:28:32.130 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.129+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~NRTL4XZXMGZ4.1 size=1048576 2023-12-03T11:28:32.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.130+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~NRTL4XZXMGZ4.2 size=953135 2023-12-03T11:28:32.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.132+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=NRTL4XZXMGZ4 tag=7EBB2S9ZG2TZ type=write size=4098863 2023-12-03T11:28:32.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.133+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=541KHX2JLUL4 type=del size=288999 2023-12-03T11:28:32.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.134+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=M7FJ3AQWIZ94 type=del 2023-12-03T11:28:32.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.135+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=TFLJ3XBFNITJ type=del size=1652469 2023-12-03T11:28:32.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.136+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~IBR70DHMW5MQ.0 size=1048576 2023-12-03T11:28:32.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.137+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~IBR70DHMW5MQ.1 size=1048576 2023-12-03T11:28:32.139 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.138+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~IBR70DHMW5MQ.2 size=388048 2023-12-03T11:28:32.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.140+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=IBR70DHMW5MQ tag=ZPEBBQA7H4I3 type=write size=3533776 2023-12-03T11:28:32.143 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.142+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=REG28AS257I3 type=del size=1444635 2023-12-03T11:28:32.144 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.143+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=HZ74SPPACTAS type=del 2023-12-03T11:28:32.145 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.144+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=ZZW070DB7TI5 type=del size=4112452 2023-12-03T11:28:32.146 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.145+0000 7fe67fa49780 1 < completed part key=_multipart_OH2XUEEYL9JO.2~21UKBYJ177S5.0 size=332576 2023-12-03T11:28:32.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.147+0000 7fe67fa49780 1 < completed multipart upload key=OH2XUEEYL9JO upload=21UKBYJ177S5 tag=DNR9IW7S2Y17 type=write size=1381152 2023-12-03T11:28:32.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.148+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=CH08E2T2OBMV type=del size=3450414 2023-12-03T11:28:32.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.151+0000 7fe67fa49780 1 < suggested update operation key=0GQZY07Y2PVI tag=CSSBNFTTUF4K type=del size=3044738 2023-12-03T11:28:32.154 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.153+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~CCRPSO5UYHG8.0 size=1048576 2023-12-03T11:28:32.155 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.154+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~CCRPSO5UYHG8.1 size=1048576 2023-12-03T11:28:32.155 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.155+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~CCRPSO5UYHG8.2 size=65635 2023-12-03T11:28:32.156 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.155+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=CCRPSO5UYHG8 tag=8RRA3RGVW6I5 type=write size=3211363 2023-12-03T11:28:32.158 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.157+0000 7fe67fa49780 1 < suggested update operation key=CIB1NZHJGO46 tag=SMEAGVT6CQEM type=del size=1885541 2023-12-03T11:28:32.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.158+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=X1MZX08HHICY type=del size=3304853 2023-12-03T11:28:32.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.158+0000 7fe67fa49780 1 < canceled part key=_multipart_CC1X1OP7L6BJ.2~NT9Q1Q4ERMRC.0 size=1048576 2023-12-03T11:28:32.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.158+0000 7fe67fa49780 1 < canceled part key=_multipart_CC1X1OP7L6BJ.2~NT9Q1Q4ERMRC.1 size=1048576 2023-12-03T11:28:32.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.159+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~NT9Q1Q4ERMRC.2 size=508243 2023-12-03T11:28:32.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.161+0000 7fe67fa49780 1 < canceled multipart upload key=CC1X1OP7L6BJ upload=NT9Q1Q4ERMRC tag=OQKGF2CECF79 type=write size=3653971 2023-12-03T11:28:32.164 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.163+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~0ZFH6UN6GNA3.0 size=1048576 2023-12-03T11:28:32.165 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.164+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~0ZFH6UN6GNA3.1 size=1048576 2023-12-03T11:28:32.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.165+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~0ZFH6UN6GNA3.2 size=268377 2023-12-03T11:28:32.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.165+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=0ZFH6UN6GNA3 tag=62C8YOVJBFD9 type=write size=3414105 2023-12-03T11:28:32.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.166+0000 7fe67fa49780 1 < completed write operation key=UL24DVOA31Y7 tag=9LG0KCNSLL6D type=write size=716214 2023-12-03T11:28:32.168 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.168+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=P37P7E2CYHBR type=del size=4193671 2023-12-03T11:28:32.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.169+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=HI4XW6HDYZ5R type=del 2023-12-03T11:28:32.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.170+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=K1QS26ZGP2S1 type=write size=559533 2023-12-03T11:28:32.172 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.171+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=MPR7S6M4KA4K type=del 2023-12-03T11:28:32.174 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.173+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~9B7RLDERWXHN.0 size=191399 2023-12-03T11:28:32.174 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.173+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=9B7RLDERWXHN tag=RZSIAA5RMAZ3 type=write size=1239975 2023-12-03T11:28:32.175 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.174+0000 7fe67fa49780 1 < completed delete operation key=9AUO0SRFTAUJ tag=3WUJRIKE80PE type=del 2023-12-03T11:28:32.177 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.176+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~5ODXTCM1AMZ5.0 size=1048576 2023-12-03T11:28:32.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.177+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~5ODXTCM1AMZ5.1 size=639510 2023-12-03T11:28:32.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.177+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=5ODXTCM1AMZ5 tag=DWBWBGF9DZBE type=write size=2736662 2023-12-03T11:28:32.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.178+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=FSB0DNG0RJXC type=del 2023-12-03T11:28:32.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.179+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=30F4O4LM2RY5 type=write size=442293 2023-12-03T11:28:32.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.181+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=QA01S9D1ZAL2 type=del 2023-12-03T11:28:32.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.182+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=YM5EQP9HOE0I type=del size=844343 2023-12-03T11:28:32.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.183+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~NVL97SF6PIBK.0 size=161595 2023-12-03T11:28:32.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.185+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=NVL97SF6PIBK tag=O6GZJA2KH4UM type=write size=1210171 2023-12-03T11:28:32.187 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.186+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=W1YJ6HUBK8DW type=write size=90188 2023-12-03T11:28:32.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.187+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=AJBB6Q0HBEIL type=del 2023-12-03T11:28:32.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.189+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~KPQTEJ0FHRLP.0 size=1048576 2023-12-03T11:28:32.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.190+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~KPQTEJ0FHRLP.1 size=1048576 2023-12-03T11:28:32.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.191+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~KPQTEJ0FHRLP.2 size=840256 2023-12-03T11:28:32.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.191+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=KPQTEJ0FHRLP tag=3DT7PYQQFD71 type=write size=3985984 2023-12-03T11:28:32.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.192+0000 7fe67fa49780 1 < canceled operation key=IIW1Y6QYEODQ tag=541KHX2JLUL4 type=del size=288999 2023-12-03T11:28:32.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.194+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~E1E1FKQHIM7H.0 size=1048576 2023-12-03T11:28:32.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.195+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~E1E1FKQHIM7H.1 size=393114 2023-12-03T11:28:32.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.195+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=E1E1FKQHIM7H tag=S764K5SBX5O7 type=write size=2490266 2023-12-03T11:28:32.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.197+0000 7fe67fa49780 1 < suggested remove operation key=V9ZVWHO8IF8L tag=TFLJ3XBFNITJ type=del 2023-12-03T11:28:32.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.198+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=PO3C6GY0KLOV type=del size=3758715 2023-12-03T11:28:32.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.201+0000 7fe67fa49780 1 < suggested update operation key=YEMPVKMDANPG tag=REG28AS257I3 type=del size=1444635 2023-12-03T11:28:32.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.202+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=A3V1UZMWU4MR type=del size=1506913 2023-12-03T11:28:32.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.203+0000 7fe67fa49780 -1 < failed to complete operation key=YEMPVKMDANPG tag=ZZW070DB7TI5 type=del size=4112452: (22) Invalid argument 2023-12-03T11:28:32.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.204+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=9KWESS3TPI9D type=del size=678246 2023-12-03T11:28:32.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.206+0000 7fe67fa49780 -1 < failed to complete operation key=0GQZY07Y2PVI tag=CH08E2T2OBMV type=del size=3450414: (22) Invalid argument 2023-12-03T11:28:32.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.208+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~ETEU2WELV1XA.0 size=960290 2023-12-03T11:28:32.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.208+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=ETEU2WELV1XA tag=BLEA1NYA42XK type=write size=2008866 2023-12-03T11:28:32.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.208+0000 7fe67fa49780 1 < canceled part key=_multipart_0GQZY07Y2PVI.2~CCRPSO5UYHG8.0 size=1048576 2023-12-03T11:28:32.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.209+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~CCRPSO5UYHG8.1 size=1048576 2023-12-03T11:28:32.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.210+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~CCRPSO5UYHG8.2 size=65635 2023-12-03T11:28:32.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.212+0000 7fe67fa49780 1 < canceled multipart upload key=0GQZY07Y2PVI upload=CCRPSO5UYHG8 tag=8RRA3RGVW6I5 type=write size=3211363 2023-12-03T11:28:32.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.213+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=OIEPI0I1MWCL type=del size=3801504 2023-12-03T11:28:32.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.215+0000 7fe67fa49780 1 < suggested remove operation key=2GX6IWVZH25N tag=X1MZX08HHICY type=del 2023-12-03T11:28:32.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.216+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=XMODFDPAZUTV type=del size=1666621 2023-12-03T11:28:32.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.218+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~0ZFH6UN6GNA3.0 size=1048576 2023-12-03T11:28:32.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.219+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~0ZFH6UN6GNA3.1 size=1048576 2023-12-03T11:28:32.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.219+0000 7fe67fa49780 1 < canceled part key=_multipart_6LQ18VAE3ZN6.2~0ZFH6UN6GNA3.2 size=268377 2023-12-03T11:28:32.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.221+0000 7fe67fa49780 1 < canceled multipart upload key=6LQ18VAE3ZN6 upload=0ZFH6UN6GNA3 tag=62C8YOVJBFD9 type=write size=3414105 2023-12-03T11:28:32.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.223+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~7OS38FFDW4IP.0 size=1048576 2023-12-03T11:28:32.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.224+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~7OS38FFDW4IP.1 size=955816 2023-12-03T11:28:32.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.224+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=7OS38FFDW4IP tag=WVKSQ31EONXZ type=write size=3052968 2023-12-03T11:28:32.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.225+0000 7fe67fa49780 1 < completed delete operation key=SXVBDBJ5B09V tag=P37P7E2CYHBR type=del 2023-12-03T11:28:32.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.226+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=3CIURSDWI6SS type=del size=1245023 2023-12-03T11:28:32.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.228+0000 7fe67fa49780 1 < suggested update operation key=6LQ18VAE3ZN6 tag=K1QS26ZGP2S1 type=write size=559533 2023-12-03T11:28:32.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.229+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=K35G13LCWCG8 type=del size=1948056 2023-12-03T11:28:32.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.230+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~9B7RLDERWXHN.0 size=191399 2023-12-03T11:28:32.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.232+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=9B7RLDERWXHN tag=RZSIAA5RMAZ3 type=write size=1239975 2023-12-03T11:28:32.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.233+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=6A9UJVUKXBZX type=del size=769509 2023-12-03T11:28:32.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.235+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~5ODXTCM1AMZ5.0 size=1048576 2023-12-03T11:28:32.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.236+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~5ODXTCM1AMZ5.1 size=639510 2023-12-03T11:28:32.238 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.238+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=5ODXTCM1AMZ5 tag=DWBWBGF9DZBE type=write size=2736662 2023-12-03T11:28:32.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.239+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=I47XPLLDUR93 type=del size=4178176 2023-12-03T11:28:32.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.240+0000 7fe67fa49780 1 < completed write operation key=SXVBDBJ5B09V tag=30F4O4LM2RY5 type=write size=442293 2023-12-03T11:28:32.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.241+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=XQ2ITGACB3UQ type=del size=3904081 2023-12-03T11:28:32.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.242+0000 7fe67fa49780 -1 < failed to complete operation key=2GX6IWVZH25N tag=YM5EQP9HOE0I type=del size=844343: (22) Invalid argument 2023-12-03T11:28:32.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.243+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=YDWXDXOGORRV type=del size=882582 2023-12-03T11:28:32.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.245+0000 7fe67fa49780 1 < completed write operation key=TXVHRE03Z3DA tag=W1YJ6HUBK8DW type=write size=90188 2023-12-03T11:28:32.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.246+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=PSLK7LF3YXBU type=write size=558898 2023-12-03T11:28:32.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.247+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~KPQTEJ0FHRLP.0 size=1048576 2023-12-03T11:28:32.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.248+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~KPQTEJ0FHRLP.1 size=1048576 2023-12-03T11:28:32.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.249+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~KPQTEJ0FHRLP.2 size=840256 2023-12-03T11:28:32.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.252+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=KPQTEJ0FHRLP tag=3DT7PYQQFD71 type=write size=3985984 2023-12-03T11:28:32.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.253+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=AJ6MJWBMAGNV type=del size=2594011 2023-12-03T11:28:32.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.254+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~E1E1FKQHIM7H.0 size=1048576 2023-12-03T11:28:32.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.255+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~E1E1FKQHIM7H.1 size=393114 2023-12-03T11:28:32.258 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.257+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=E1E1FKQHIM7H tag=S764K5SBX5O7 type=write size=2490266 2023-12-03T11:28:32.259 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.258+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=3UXE2543ELLZ type=del size=3898565 2023-12-03T11:28:32.261 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.260+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=PO3C6GY0KLOV type=del 2023-12-03T11:28:32.264 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.262+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~Y40D2Z2NSRWI.0 size=1048576 2023-12-03T11:28:32.265 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.263+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~Y40D2Z2NSRWI.1 size=1048576 2023-12-03T11:28:32.265 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.264+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~Y40D2Z2NSRWI.2 size=173877 2023-12-03T11:28:32.265 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.264+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=Y40D2Z2NSRWI tag=FDRTDD6KGP5L type=write size=3319605 2023-12-03T11:28:32.266 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.265+0000 7fe67fa49780 -1 < failed to complete operation key=6LQ18VAE3ZN6 tag=A3V1UZMWU4MR type=del size=1506913: (22) Invalid argument 2023-12-03T11:28:32.268 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.267+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~KFHS04PJ3QER.0 size=1048576 2023-12-03T11:28:32.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.268+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~KFHS04PJ3QER.1 size=1048576 2023-12-03T11:28:32.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.269+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~KFHS04PJ3QER.2 size=53354 2023-12-03T11:28:32.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.269+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=KFHS04PJ3QER tag=AKB1B7WTAVT3 type=write size=3199082 2023-12-03T11:28:32.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.270+0000 7fe67fa49780 1 < canceled operation key=0G8KNJBJ9K1Z tag=9KWESS3TPI9D type=del size=678246 2023-12-03T11:28:32.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.272+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=WY3BJ190E51D type=del size=81679 2023-12-03T11:28:32.274 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.273+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~ETEU2WELV1XA.0 size=960290 2023-12-03T11:28:32.276 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.275+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=ETEU2WELV1XA tag=BLEA1NYA42XK type=write size=2008866 2023-12-03T11:28:32.277 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.276+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=F2HT2B8P1O1X type=del size=3924767 2023-12-03T11:28:32.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.278+0000 7fe67fa49780 1 < suggested remove operation key=ASODFGLQ5VNY tag=OIEPI0I1MWCL type=del 2023-12-03T11:28:32.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.281+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~AQ80G96F09KG.0 size=1048576 2023-12-03T11:28:32.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.282+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~AQ80G96F09KG.1 size=1048576 2023-12-03T11:28:32.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.283+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~AQ80G96F09KG.2 size=554822 2023-12-03T11:28:32.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.283+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=AQ80G96F09KG tag=ZZ7LSSEPAZJB type=write size=3700550 2023-12-03T11:28:32.285 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.284+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=XMODFDPAZUTV type=del 2023-12-03T11:28:32.286 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.285+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=LJS8GS35Q2DX type=write size=36811 2023-12-03T11:28:32.287 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.286+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~7OS38FFDW4IP.0 size=1048576 2023-12-03T11:28:32.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.287+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~7OS38FFDW4IP.1 size=955816 2023-12-03T11:28:32.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.289+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=7OS38FFDW4IP tag=WVKSQ31EONXZ type=write size=3052968 2023-12-03T11:28:32.292 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.291+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~WPX0U3N81ZOC.0 size=1048576 2023-12-03T11:28:32.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.292+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~WPX0U3N81ZOC.1 size=1048576 2023-12-03T11:28:32.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.293+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~WPX0U3N81ZOC.2 size=670794 2023-12-03T11:28:32.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.293+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=WPX0U3N81ZOC tag=QQOZFFHR08RN type=write size=3816522 2023-12-03T11:28:32.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.294+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=3CIURSDWI6SS type=del 2023-12-03T11:28:32.298 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.297+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~EDY05YC01RY3.0 size=930563 2023-12-03T11:28:32.298 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.297+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=EDY05YC01RY3 tag=A33NNRH7NT19 type=write size=1979139 2023-12-03T11:28:32.300 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.299+0000 7fe67fa49780 1 < suggested update operation key=0GQZY07Y2PVI tag=K35G13LCWCG8 type=del size=1948056 2023-12-03T11:28:32.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.300+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=VL0HSOHGA3KO type=del size=875984 2023-12-03T11:28:32.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.302+0000 7fe67fa49780 1 < suggested remove operation key=CIB1NZHJGO46 tag=6A9UJVUKXBZX type=del 2023-12-03T11:28:32.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.303+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=FONSZNLMDVYF type=del size=3011291 2023-12-03T11:28:32.305 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.304+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=I47XPLLDUR93 type=del 2023-12-03T11:28:32.306 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.306+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=R8OCKYUH0KL4 type=write size=37458 2023-12-03T11:28:32.308 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.307+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=XQ2ITGACB3UQ type=del 2023-12-03T11:28:32.309 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.308+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=T1NAPR44734E type=del size=1553065 2023-12-03T11:28:32.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.310+0000 7fe67fa49780 1 < suggested update operation key=P05UIP1IU4Z7 tag=YDWXDXOGORRV type=del size=882582 2023-12-03T11:28:32.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.311+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=QG30MGKOCGR2 type=del size=563593 2023-12-03T11:28:32.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.313+0000 7fe67fa49780 1 < completed write operation key=N87KA638VE01 tag=PSLK7LF3YXBU type=write size=558898 2023-12-03T11:28:32.315 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.314+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=TX4THVUNV2NG type=del size=1331888 2023-12-03T11:28:32.316 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.315+0000 7fe67fa49780 -1 < failed to complete operation key=P05UIP1IU4Z7 tag=AJ6MJWBMAGNV type=del size=2594011: (22) Invalid argument 2023-12-03T11:28:32.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.316+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=37Y2E5X4Z33O type=del size=3289176 2023-12-03T11:28:32.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.318+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=3UXE2543ELLZ type=del 2023-12-03T11:28:32.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.320+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~5LMVF0GWO0XI.0 size=1048576 2023-12-03T11:28:32.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.321+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~5LMVF0GWO0XI.1 size=1045386 2023-12-03T11:28:32.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.321+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=5LMVF0GWO0XI tag=KDRFZ271PHJM type=write size=3142538 2023-12-03T11:28:32.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.322+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~Y40D2Z2NSRWI.0 size=1048576 2023-12-03T11:28:32.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.323+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~Y40D2Z2NSRWI.1 size=1048576 2023-12-03T11:28:32.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.324+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~Y40D2Z2NSRWI.2 size=173877 2023-12-03T11:28:32.327 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.326+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=Y40D2Z2NSRWI tag=FDRTDD6KGP5L type=write size=3319605 2023-12-03T11:28:32.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.327+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=AJRB1DX372MO type=del size=4053921 2023-12-03T11:28:32.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.329+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~KFHS04PJ3QER.0 size=1048576 2023-12-03T11:28:32.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.329+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~KFHS04PJ3QER.1 size=1048576 2023-12-03T11:28:32.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.330+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~KFHS04PJ3QER.2 size=53354 2023-12-03T11:28:32.333 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.332+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=KFHS04PJ3QER tag=AKB1B7WTAVT3 type=write size=3199082 2023-12-03T11:28:32.335 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.334+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=V8PU68J982FF type=del size=2869565 2023-12-03T11:28:32.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.336+0000 7fe67fa49780 1 < suggested update operation key=OH2XUEEYL9JO tag=WY3BJ190E51D type=del size=81679 2023-12-03T11:28:32.339 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.338+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~OJEGSXMCYWMV.0 size=1048576 2023-12-03T11:28:32.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.339+0000 7fe67fa49780 1 > prepared part key=_multipart_983BDZLASC3S.2~OJEGSXMCYWMV.1 size=232923 2023-12-03T11:28:32.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.339+0000 7fe67fa49780 1 > prepared multipart upload key=983BDZLASC3S upload=OJEGSXMCYWMV tag=44V8FJ0QNN6Z type=write size=2330075 2023-12-03T11:28:32.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.340+0000 7fe67fa49780 -1 < failed to complete operation key=CIB1NZHJGO46 tag=F2HT2B8P1O1X type=del size=3924767: (22) Invalid argument 2023-12-03T11:28:32.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.342+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~WI6QR4X0N49C.0 size=369299 2023-12-03T11:28:32.344 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.342+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=WI6QR4X0N49C tag=K7M86ZCFWL7M type=write size=1417875 2023-12-03T11:28:32.345 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.344+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~AQ80G96F09KG.0 size=1048576 2023-12-03T11:28:32.346 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.345+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~AQ80G96F09KG.1 size=1048576 2023-12-03T11:28:32.347 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.346+0000 7fe67fa49780 1 < completed part key=_multipart_YEMPVKMDANPG.2~AQ80G96F09KG.2 size=554822 2023-12-03T11:28:32.348 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.347+0000 7fe67fa49780 1 < completed multipart upload key=YEMPVKMDANPG upload=AQ80G96F09KG tag=ZZ7LSSEPAZJB type=write size=3700550 2023-12-03T11:28:32.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.349+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=23AK0X1D7KB3 type=write size=718438 2023-12-03T11:28:32.352 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.351+0000 7fe67fa49780 1 < suggested remove operation key=9OD4G28SDLB4 tag=LJS8GS35Q2DX type=write 2023-12-03T11:28:32.353 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.352+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=XEXK6NO8NQZJ type=del size=3098370 2023-12-03T11:28:32.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.353+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~WPX0U3N81ZOC.0 size=1048576 2023-12-03T11:28:32.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.353+0000 7fe67fa49780 1 < canceled part key=_multipart_A7GOX2W0WB83.2~WPX0U3N81ZOC.1 size=1048576 2023-12-03T11:28:32.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.354+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~WPX0U3N81ZOC.2 size=670794 2023-12-03T11:28:32.357 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.356+0000 7fe67fa49780 1 < canceled multipart upload key=A7GOX2W0WB83 upload=WPX0U3N81ZOC tag=QQOZFFHR08RN type=write size=3816522 2023-12-03T11:28:32.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.357+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=3SDCY7GOHMBN type=del size=863374 2023-12-03T11:28:32.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.358+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~EDY05YC01RY3.0 size=930563 2023-12-03T11:28:32.362 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.361+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=EDY05YC01RY3 tag=A33NNRH7NT19 type=write size=1979139 2023-12-03T11:28:32.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.363+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=K1J1MN8A8MUG type=write size=841931 2023-12-03T11:28:32.366 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.365+0000 7fe67fa49780 1 < suggested update operation key=8UZJU9PNWIB6 tag=VL0HSOHGA3KO type=del size=875984 2023-12-03T11:28:32.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.366+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=W2T5HYRLYBNF type=del size=2452887 2023-12-03T11:28:32.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.368+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=FONSZNLMDVYF type=del 2023-12-03T11:28:32.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.371+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~TN1GOBS99ZQN.0 size=993431 2023-12-03T11:28:32.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.371+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=TN1GOBS99ZQN tag=NJECLXP1QUG0 type=write size=2042007 2023-12-03T11:28:32.373 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.373+0000 7fe67fa49780 1 < completed write operation key=IIW1Y6QYEODQ tag=R8OCKYUH0KL4 type=write size=37458 2023-12-03T11:28:32.375 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.374+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=LVOH5NKO9BP4 type=del size=3881623 2023-12-03T11:28:32.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.375+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=T1NAPR44734E type=del 2023-12-03T11:28:32.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.379+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~1YNSLVCWBN6Q.0 size=1048576 2023-12-03T11:28:32.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.382+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~1YNSLVCWBN6Q.1 size=1048576 2023-12-03T11:28:32.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.383+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~1YNSLVCWBN6Q.2 size=848851 2023-12-03T11:28:32.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.383+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=1YNSLVCWBN6Q tag=KV01VQOMMNCN type=write size=3994579 2023-12-03T11:28:32.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.384+0000 7fe67fa49780 1 < completed delete operation key=ASODFGLQ5VNY tag=QG30MGKOCGR2 type=del 2023-12-03T11:28:32.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.385+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=FVDH6RV4S228 type=del size=3263793 2023-12-03T11:28:32.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.386+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=TX4THVUNV2NG type=del 2023-12-03T11:28:32.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.388+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=ALOAW384B59I type=del size=2371630 2023-12-03T11:28:32.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.389+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=37Y2E5X4Z33O type=del 2023-12-03T11:28:32.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.391+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~N0X42S9U0309.0 size=467556 2023-12-03T11:28:32.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.391+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=N0X42S9U0309 tag=CPBOJBGFEXLG type=write size=1516132 2023-12-03T11:28:32.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.392+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~5LMVF0GWO0XI.0 size=1048576 2023-12-03T11:28:32.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.393+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~5LMVF0GWO0XI.1 size=1045386 2023-12-03T11:28:32.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.394+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=5LMVF0GWO0XI tag=KDRFZ271PHJM type=write size=3142538 2023-12-03T11:28:32.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.396+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=JPKXYWK3BS49 type=write size=424167 2023-12-03T11:28:32.398 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.397+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=AJRB1DX372MO type=del 2023-12-03T11:28:32.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.399+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~C25XE6RFWAFJ.0 size=1048576 2023-12-03T11:28:32.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.400+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~C25XE6RFWAFJ.1 size=89446 2023-12-03T11:28:32.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.400+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=C25XE6RFWAFJ tag=QZ8V5Q9P5JVH type=write size=2186598 2023-12-03T11:28:32.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.401+0000 7fe67fa49780 1 < completed delete operation key=V9ZVWHO8IF8L tag=V8PU68J982FF type=del 2023-12-03T11:28:32.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.402+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=NZQ9HGQV2W0F type=del size=1866014 2023-12-03T11:28:32.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.403+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~OJEGSXMCYWMV.0 size=1048576 2023-12-03T11:28:32.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.404+0000 7fe67fa49780 1 < completed part key=_multipart_983BDZLASC3S.2~OJEGSXMCYWMV.1 size=232923 2023-12-03T11:28:32.407 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.406+0000 7fe67fa49780 1 < completed multipart upload key=983BDZLASC3S upload=OJEGSXMCYWMV tag=44V8FJ0QNN6Z type=write size=2330075 2023-12-03T11:28:32.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.407+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=GK0FO8VO86AJ type=del size=992601 2023-12-03T11:28:32.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.408+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~WI6QR4X0N49C.0 size=369299 2023-12-03T11:28:32.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.410+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=WI6QR4X0N49C tag=K7M86ZCFWL7M type=write size=1417875 2023-12-03T11:28:32.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.412+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~G96AKGKHXM89.0 size=1048576 2023-12-03T11:28:32.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.413+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~G96AKGKHXM89.1 size=1048576 2023-12-03T11:28:32.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.413+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~G96AKGKHXM89.2 size=742480 2023-12-03T11:28:32.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.413+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=G96AKGKHXM89 tag=GUWFZLMAFC25 type=write size=3888208 2023-12-03T11:28:32.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.415+0000 7fe67fa49780 1 < canceled operation key=6LQ18VAE3ZN6 tag=23AK0X1D7KB3 type=write size=718438 2023-12-03T11:28:32.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.417+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~SPSBW4F6ET6H.0 size=1048576 2023-12-03T11:28:32.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.418+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~SPSBW4F6ET6H.1 size=736977 2023-12-03T11:28:32.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.418+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=SPSBW4F6ET6H tag=O5GQQQPE0YNA type=write size=2834129 2023-12-03T11:28:32.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.419+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=XEXK6NO8NQZJ type=del 2023-12-03T11:28:32.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.421+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~8HFH19JYH2JJ.0 size=762272 2023-12-03T11:28:32.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.421+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=8HFH19JYH2JJ tag=FQ35LN3LK4S9 type=write size=1810848 2023-12-03T11:28:32.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.422+0000 7fe67fa49780 1 < canceled operation key=N87KA638VE01 tag=3SDCY7GOHMBN type=del size=863374 2023-12-03T11:28:32.425 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.424+0000 7fe67fa49780 1 > prepared part key=_multipart_SIES92K9QVJV.2~KP8S8A0E5BD7.0 size=791868 2023-12-03T11:28:32.425 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.424+0000 7fe67fa49780 1 > prepared multipart upload key=SIES92K9QVJV upload=KP8S8A0E5BD7 tag=PZRW4NE6CS9B type=write size=1840444 2023-12-03T11:28:32.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.425+0000 7fe67fa49780 1 < completed write operation key=OH2XUEEYL9JO tag=K1J1MN8A8MUG type=write size=841931 2023-12-03T11:28:32.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.428+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=SN0J1DXXLKCZ type=del size=3834514 2023-12-03T11:28:32.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.430+0000 7fe67fa49780 1 < suggested remove operation key=0G8KNJBJ9K1Z tag=W2T5HYRLYBNF type=del 2023-12-03T11:28:32.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.432+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~FWDQD538RFJJ.0 size=1048576 2023-12-03T11:28:32.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.433+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~FWDQD538RFJJ.1 size=1048576 2023-12-03T11:28:32.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.434+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~FWDQD538RFJJ.2 size=150360 2023-12-03T11:28:32.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.434+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=FWDQD538RFJJ tag=P26MHMNSF5Z3 type=write size=3296088 2023-12-03T11:28:32.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.435+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~TN1GOBS99ZQN.0 size=993431 2023-12-03T11:28:32.438 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.437+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=TN1GOBS99ZQN tag=NJECLXP1QUG0 type=write size=2042007 2023-12-03T11:28:32.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.439+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~NIZKU12AO17J.0 size=1048576 2023-12-03T11:28:32.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.440+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~NIZKU12AO17J.1 size=862835 2023-12-03T11:28:32.441 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.440+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=NIZKU12AO17J tag=ESAVVCQD3V2M type=write size=2959987 2023-12-03T11:28:32.442 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.441+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=LVOH5NKO9BP4 type=del 2023-12-03T11:28:32.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.442+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=JQ7PBBD7V0I3 type=del size=3881926 2023-12-03T11:28:32.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.444+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~1YNSLVCWBN6Q.0 size=1048576 2023-12-03T11:28:32.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.444+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~1YNSLVCWBN6Q.1 size=1048576 2023-12-03T11:28:32.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.445+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~1YNSLVCWBN6Q.2 size=848851 2023-12-03T11:28:32.448 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.447+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=1YNSLVCWBN6Q tag=KV01VQOMMNCN type=write size=3994579 2023-12-03T11:28:32.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.448+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=0IUL2SCCI2EL type=del size=2389681 2023-12-03T11:28:32.451 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.450+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=FVDH6RV4S228 type=del 2023-12-03T11:28:32.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.451+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=4KFRMVQECF8W type=del size=938207 2023-12-03T11:28:32.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.453+0000 7fe67fa49780 1 < suggested update operation key=SIES92K9QVJV tag=ALOAW384B59I type=del size=2371630 2023-12-03T11:28:32.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.454+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=RVNHAFCH9164 type=del size=139268 2023-12-03T11:28:32.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.455+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~N0X42S9U0309.0 size=467556 2023-12-03T11:28:32.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.457+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=N0X42S9U0309 tag=CPBOJBGFEXLG type=write size=1516132 2023-12-03T11:28:32.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.458+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=9B15KRQCNRRI type=del size=3099946 2023-12-03T11:28:32.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.459+0000 7fe67fa49780 1 < completed write operation key=ASODFGLQ5VNY tag=JPKXYWK3BS49 type=write size=424167 2023-12-03T11:28:32.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.461+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~IWSLBBP7FJV5.0 size=1048576 2023-12-03T11:28:32.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.462+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~IWSLBBP7FJV5.1 size=721612 2023-12-03T11:28:32.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.462+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=IWSLBBP7FJV5 tag=EPZ1HQM5EMTV type=write size=2818764 2023-12-03T11:28:32.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.462+0000 7fe67fa49780 1 < canceled part key=_multipart_KMC5YD2M3I45.2~C25XE6RFWAFJ.0 size=1048576 2023-12-03T11:28:32.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.463+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~C25XE6RFWAFJ.1 size=89446 2023-12-03T11:28:32.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.465+0000 7fe67fa49780 1 < canceled multipart upload key=KMC5YD2M3I45 upload=C25XE6RFWAFJ tag=QZ8V5Q9P5JVH type=write size=2186598 2023-12-03T11:28:32.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.467+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~KY7M9W5TKG0K.0 size=1048576 2023-12-03T11:28:32.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.468+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~KY7M9W5TKG0K.1 size=574240 2023-12-03T11:28:32.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.468+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=KY7M9W5TKG0K tag=DYUL820C3YQR type=write size=2671392 2023-12-03T11:28:32.470 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.469+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=NZQ9HGQV2W0F type=del 2023-12-03T11:28:32.471 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.470+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=0Q3VRZV3CT9Z type=del size=2434654 2023-12-03T11:28:32.472 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.472+0000 7fe67fa49780 -1 < failed to complete operation key=0G8KNJBJ9K1Z tag=GK0FO8VO86AJ type=del size=992601: (22) Invalid argument 2023-12-03T11:28:32.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.473+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=60JY3ZIV55BL type=del size=645290 2023-12-03T11:28:32.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.475+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~G96AKGKHXM89.0 size=1048576 2023-12-03T11:28:32.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.476+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~G96AKGKHXM89.1 size=1048576 2023-12-03T11:28:32.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.477+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~G96AKGKHXM89.2 size=742480 2023-12-03T11:28:32.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.478+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=G96AKGKHXM89 tag=GUWFZLMAFC25 type=write size=3888208 2023-12-03T11:28:32.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.480+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=P95T5UJMPEDO type=del size=1576523 2023-12-03T11:28:32.482 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.481+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~SPSBW4F6ET6H.0 size=1048576 2023-12-03T11:28:32.483 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.482+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~SPSBW4F6ET6H.1 size=736977 2023-12-03T11:28:32.485 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.484+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=SPSBW4F6ET6H tag=O5GQQQPE0YNA type=write size=2834129 2023-12-03T11:28:32.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.485+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=511ETD65XQ0U type=del size=2825534 2023-12-03T11:28:32.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.485+0000 7fe67fa49780 1 < canceled part key=_multipart_YEMPVKMDANPG.2~8HFH19JYH2JJ.0 size=762272 2023-12-03T11:28:32.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.487+0000 7fe67fa49780 1 < canceled multipart upload key=YEMPVKMDANPG upload=8HFH19JYH2JJ tag=FQ35LN3LK4S9 type=write size=1810848 2023-12-03T11:28:32.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.488+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=UI4W29D1LSCT type=del size=3222387 2023-12-03T11:28:32.490 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.489+0000 7fe67fa49780 1 < completed part key=_multipart_SIES92K9QVJV.2~KP8S8A0E5BD7.0 size=791868 2023-12-03T11:28:32.492 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.491+0000 7fe67fa49780 1 < completed multipart upload key=SIES92K9QVJV upload=KP8S8A0E5BD7 tag=PZRW4NE6CS9B type=write size=1840444 2023-12-03T11:28:32.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.492+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=5YOHAGLU38XI type=del size=327366 2023-12-03T11:28:32.496 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.495+0000 7fe67fa49780 1 < suggested remove operation key=SIES92K9QVJV tag=SN0J1DXXLKCZ type=del 2023-12-03T11:28:32.497 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.496+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=G0RMTT3CO09K type=write size=1008508 2023-12-03T11:28:32.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.497+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~FWDQD538RFJJ.0 size=1048576 2023-12-03T11:28:32.499 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.498+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~FWDQD538RFJJ.1 size=1048576 2023-12-03T11:28:32.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.499+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~FWDQD538RFJJ.2 size=150360 2023-12-03T11:28:32.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.501+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=FWDQD538RFJJ tag=P26MHMNSF5Z3 type=write size=3296088 2023-12-03T11:28:32.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.503+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~ZF8G78QGM8G0.0 size=1048576 2023-12-03T11:28:32.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.504+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~ZF8G78QGM8G0.1 size=1048576 2023-12-03T11:28:32.505 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.504+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~ZF8G78QGM8G0.2 size=578687 2023-12-03T11:28:32.505 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.504+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=ZF8G78QGM8G0 tag=CEBWBA12SPYJ type=write size=3724415 2023-12-03T11:28:32.506 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.506+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~NIZKU12AO17J.0 size=1048576 2023-12-03T11:28:32.507 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.506+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~NIZKU12AO17J.1 size=862835 2023-12-03T11:28:32.509 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.508+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=NIZKU12AO17J tag=ESAVVCQD3V2M type=write size=2959987 2023-12-03T11:28:32.510 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.510+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=3WE3P338WQ78 type=del size=526349 2023-12-03T11:28:32.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.511+0000 7fe67fa49780 1 < canceled operation key=UL24DVOA31Y7 tag=JQ7PBBD7V0I3 type=del size=3881926 2023-12-03T11:28:32.513 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.512+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=DP8NGN9VSSB5 type=write size=634946 2023-12-03T11:28:32.514 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.513+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=0IUL2SCCI2EL type=del 2023-12-03T11:28:32.516 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.515+0000 7fe67fa49780 1 > prepared part key=_multipart_V9ZVWHO8IF8L.2~IE3OCV11F6KV.0 size=390992 2023-12-03T11:28:32.516 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.515+0000 7fe67fa49780 1 > prepared multipart upload key=V9ZVWHO8IF8L upload=IE3OCV11F6KV tag=W6L4WLGS3ROD type=write size=1439568 2023-12-03T11:28:32.518 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.517+0000 7fe67fa49780 1 < suggested remove operation key=Y0VRZR6S8FP6 tag=4KFRMVQECF8W type=del 2023-12-03T11:28:32.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.519+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=LDR098DKEPHG type=del size=1222182 2023-12-03T11:28:32.521 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.521+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=RVNHAFCH9164 type=del 2023-12-03T11:28:32.523 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.522+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=USFTZVU72TPU type=del size=905391 2023-12-03T11:28:32.524 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.523+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=9B15KRQCNRRI type=del 2023-12-03T11:28:32.525 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.524+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=SOS08SFFDXS6 type=del size=41461 2023-12-03T11:28:32.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.525+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~IWSLBBP7FJV5.0 size=1048576 2023-12-03T11:28:32.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.526+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~IWSLBBP7FJV5.1 size=721612 2023-12-03T11:28:32.529 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.528+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=IWSLBBP7FJV5 tag=EPZ1HQM5EMTV type=write size=2818764 2023-12-03T11:28:32.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.530+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~R62GXV0D51AV.0 size=257549 2023-12-03T11:28:32.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.530+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=R62GXV0D51AV tag=O3TWUHQPN4L2 type=write size=1306125 2023-12-03T11:28:32.532 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.531+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~KY7M9W5TKG0K.0 size=1048576 2023-12-03T11:28:32.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.532+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~KY7M9W5TKG0K.1 size=574240 2023-12-03T11:28:32.535 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.534+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=KY7M9W5TKG0K tag=DYUL820C3YQR type=write size=2671392 2023-12-03T11:28:32.536 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.535+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=QUPLHYZWOZ0A type=del size=2107003 2023-12-03T11:28:32.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.536+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=0Q3VRZV3CT9Z type=del 2023-12-03T11:28:32.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.538+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=PH4MEUB63IVR type=del size=3014047 2023-12-03T11:28:32.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.540+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=60JY3ZIV55BL type=del 2023-12-03T11:28:32.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.542+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~HO8MBTTT3QZ1.0 size=330281 2023-12-03T11:28:32.543 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.542+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=HO8MBTTT3QZ1 tag=331N815SH74N type=write size=1378857 2023-12-03T11:28:32.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.544+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=P95T5UJMPEDO type=del 2023-12-03T11:28:32.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.546+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~HIQPD2320AQ4.0 size=683521 2023-12-03T11:28:32.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.546+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=HIQPD2320AQ4 tag=XCGRGGUAY188 type=write size=1732097 2023-12-03T11:28:32.549 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.548+0000 7fe67fa49780 1 < suggested update operation key=983BDZLASC3S tag=511ETD65XQ0U type=del size=2825534 2023-12-03T11:28:32.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.550+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=25OQ7HEVHUU5 type=del size=2191836 2023-12-03T11:28:32.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.551+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=UI4W29D1LSCT type=del 2023-12-03T11:28:32.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.553+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~FR003HX6FOJK.0 size=1048576 2023-12-03T11:28:32.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.554+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~FR003HX6FOJK.1 size=316786 2023-12-03T11:28:32.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.554+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=FR003HX6FOJK tag=85D4VKFC29QN type=write size=2413938 2023-12-03T11:28:32.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.555+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=5YOHAGLU38XI type=del 2023-12-03T11:28:32.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.557+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~IWE1L32FHSZ4.0 size=1048576 2023-12-03T11:28:32.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.558+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~IWE1L32FHSZ4.1 size=1048576 2023-12-03T11:28:32.560 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.559+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~IWE1L32FHSZ4.2 size=112237 2023-12-03T11:28:32.560 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.559+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=IWE1L32FHSZ4 tag=U6R4ZIH3LZVL type=write size=3257965 2023-12-03T11:28:32.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.560+0000 7fe67fa49780 1 < completed write operation key=XZHCD4R4EVZR tag=G0RMTT3CO09K type=write size=1008508 2023-12-03T11:28:32.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.562+0000 7fe67fa49780 1 > prepared part key=_multipart_KMC5YD2M3I45.2~EAZQVQ4EBEBL.0 size=423501 2023-12-03T11:28:32.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.562+0000 7fe67fa49780 1 > prepared multipart upload key=KMC5YD2M3I45 upload=EAZQVQ4EBEBL tag=MPR5VQEELJQF type=write size=1472077 2023-12-03T11:28:32.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.564+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~ZF8G78QGM8G0.0 size=1048576 2023-12-03T11:28:32.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.565+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~ZF8G78QGM8G0.1 size=1048576 2023-12-03T11:28:32.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.566+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~ZF8G78QGM8G0.2 size=578687 2023-12-03T11:28:32.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.568+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=ZF8G78QGM8G0 tag=CEBWBA12SPYJ type=write size=3724415 2023-12-03T11:28:32.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.570+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~SGTHPFCU7Z40.0 size=1048576 2023-12-03T11:28:32.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.571+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~SGTHPFCU7Z40.1 size=1048576 2023-12-03T11:28:32.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.572+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~SGTHPFCU7Z40.2 size=627490 2023-12-03T11:28:32.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.572+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=SGTHPFCU7Z40 tag=33UJ1PZ3O3EA type=write size=3773218 2023-12-03T11:28:32.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.574+0000 7fe67fa49780 1 < suggested update operation key=OH2XUEEYL9JO tag=3WE3P338WQ78 type=del size=526349 2023-12-03T11:28:32.576 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.575+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=XTT5FZBV49J3 type=del size=3937075 2023-12-03T11:28:32.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.576+0000 7fe67fa49780 1 < completed write operation key=CIB1NZHJGO46 tag=DP8NGN9VSSB5 type=write size=634946 2023-12-03T11:28:32.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.579+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~OL0OMBEF9RI0.0 size=1048576 2023-12-03T11:28:32.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.579+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~OL0OMBEF9RI0.1 size=740409 2023-12-03T11:28:32.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.579+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=OL0OMBEF9RI0 tag=PLCR1S89T3AL type=write size=2837561 2023-12-03T11:28:32.582 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.581+0000 7fe67fa49780 1 < completed part key=_multipart_V9ZVWHO8IF8L.2~IE3OCV11F6KV.0 size=390992 2023-12-03T11:28:32.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.583+0000 7fe67fa49780 1 < completed multipart upload key=V9ZVWHO8IF8L upload=IE3OCV11F6KV tag=W6L4WLGS3ROD type=write size=1439568 2023-12-03T11:28:32.586 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.585+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=C7ILU3IMQ8I8 type=write size=766778 2023-12-03T11:28:32.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.586+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=LDR098DKEPHG type=del 2023-12-03T11:28:32.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.587+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=7WP15GKG14EE type=del size=325348 2023-12-03T11:28:32.590 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.589+0000 7fe67fa49780 1 < suggested update operation key=KMC5YD2M3I45 tag=USFTZVU72TPU type=del size=905391 2023-12-03T11:28:32.592 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.591+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=GQIP3PNSZJBR type=del size=1412528 2023-12-03T11:28:32.593 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.592+0000 7fe67fa49780 -1 < failed to complete operation key=KMC5YD2M3I45 tag=SOS08SFFDXS6 type=del size=41461: (22) Invalid argument 2023-12-03T11:28:32.595 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.594+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~FMMPC2446IQT.0 size=796221 2023-12-03T11:28:32.595 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.594+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=FMMPC2446IQT tag=SER8HIJVRI73 type=write size=1844797 2023-12-03T11:28:32.596 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.595+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~R62GXV0D51AV.0 size=257549 2023-12-03T11:28:32.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.597+0000 7fe67fa49780 1 < completed multipart upload key=006X4CSXV0KA upload=R62GXV0D51AV tag=O3TWUHQPN4L2 type=write size=1306125 2023-12-03T11:28:32.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.598+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=J6OSROETZOMW type=del size=608109 2023-12-03T11:28:32.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.599+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=QUPLHYZWOZ0A type=del 2023-12-03T11:28:32.601 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.600+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=9KVUR0KGKCM6 type=write size=275145 2023-12-03T11:28:32.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.601+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=PH4MEUB63IVR type=del 2023-12-03T11:28:32.604 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.603+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=OF448JELQOMB type=del size=457469 2023-12-03T11:28:32.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.604+0000 7fe67fa49780 1 < completed part key=_multipart_0GQZY07Y2PVI.2~HO8MBTTT3QZ1.0 size=330281 2023-12-03T11:28:32.606 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.606+0000 7fe67fa49780 1 < completed multipart upload key=0GQZY07Y2PVI upload=HO8MBTTT3QZ1 tag=331N815SH74N type=write size=1378857 2023-12-03T11:28:32.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.607+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=NUW9JSNUFSAF type=write size=332091 2023-12-03T11:28:32.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.608+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~HIQPD2320AQ4.0 size=683521 2023-12-03T11:28:32.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.610+0000 7fe67fa49780 1 < completed multipart upload key=PFBGR7OF7JQG upload=HIQPD2320AQ4 tag=XCGRGGUAY188 type=write size=1732097 2023-12-03T11:28:32.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.611+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=Q6ZW5C1TAFAY type=write size=555980 2023-12-03T11:28:32.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.612+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=25OQ7HEVHUU5 type=del 2023-12-03T11:28:32.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.613+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=EV62TJSNREUS type=del size=801133 2023-12-03T11:28:32.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.614+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~FR003HX6FOJK.0 size=1048576 2023-12-03T11:28:32.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.615+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~FR003HX6FOJK.1 size=316786 2023-12-03T11:28:32.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.617+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=FR003HX6FOJK tag=85D4VKFC29QN type=write size=2413938 2023-12-03T11:28:32.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.619+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~F3N13YJV7SEN.0 size=822362 2023-12-03T11:28:32.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.619+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=F3N13YJV7SEN tag=RW8BU9RHTJJK type=write size=1870938 2023-12-03T11:28:32.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.620+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~IWE1L32FHSZ4.0 size=1048576 2023-12-03T11:28:32.622 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.621+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~IWE1L32FHSZ4.1 size=1048576 2023-12-03T11:28:32.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.622+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~IWE1L32FHSZ4.2 size=112237 2023-12-03T11:28:32.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.624+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=IWE1L32FHSZ4 tag=U6R4ZIH3LZVL type=write size=3257965 2023-12-03T11:28:32.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.625+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=H8CPKOZSUESH type=del size=1342183 2023-12-03T11:28:32.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.626+0000 7fe67fa49780 1 < completed part key=_multipart_KMC5YD2M3I45.2~EAZQVQ4EBEBL.0 size=423501 2023-12-03T11:28:32.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.628+0000 7fe67fa49780 1 < completed multipart upload key=KMC5YD2M3I45 upload=EAZQVQ4EBEBL tag=MPR5VQEELJQF type=write size=1472077 2023-12-03T11:28:32.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.630+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~25L3XUORSMYQ.0 size=1048576 2023-12-03T11:28:32.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.631+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~25L3XUORSMYQ.1 size=1048576 2023-12-03T11:28:32.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.632+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~25L3XUORSMYQ.2 size=293025 2023-12-03T11:28:32.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.632+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=25L3XUORSMYQ tag=VXY43P99NRV7 type=write size=3438753 2023-12-03T11:28:32.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.634+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~SGTHPFCU7Z40.0 size=1048576 2023-12-03T11:28:32.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.634+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~SGTHPFCU7Z40.1 size=1048576 2023-12-03T11:28:32.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.636+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~SGTHPFCU7Z40.2 size=627490 2023-12-03T11:28:32.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.638+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=SGTHPFCU7Z40 tag=33UJ1PZ3O3EA type=write size=3773218 2023-12-03T11:28:32.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.640+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~1IY8I0A834N1.0 size=779058 2023-12-03T11:28:32.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.640+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=1IY8I0A834N1 tag=K29AR8EJH1GU type=write size=1827634 2023-12-03T11:28:32.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.642+0000 7fe67fa49780 1 < suggested remove operation key=Y0VRZR6S8FP6 tag=XTT5FZBV49J3 type=del 2023-12-03T11:28:32.644 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.643+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=2VWMEH2U8P47 type=write size=24397 2023-12-03T11:28:32.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.644+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~OL0OMBEF9RI0.0 size=1048576 2023-12-03T11:28:32.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.645+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~OL0OMBEF9RI0.1 size=740409 2023-12-03T11:28:32.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.647+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=OL0OMBEF9RI0 tag=PLCR1S89T3AL type=write size=2837561 2023-12-03T11:28:32.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.648+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=LPIOWGVCPMMX type=del size=4057524 2023-12-03T11:28:32.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.651+0000 7fe67fa49780 1 < suggested update operation key=A7GOX2W0WB83 tag=C7ILU3IMQ8I8 type=write size=766778 2023-12-03T11:28:32.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.652+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=IGAF0W18MXIL type=del size=1168372 2023-12-03T11:28:32.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.653+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=7WP15GKG14EE type=del 2023-12-03T11:28:32.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.656+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~1S7ZCC2TOZEA.0 size=1048576 2023-12-03T11:28:32.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.657+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~1S7ZCC2TOZEA.1 size=1048576 2023-12-03T11:28:32.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.658+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~1S7ZCC2TOZEA.2 size=65690 2023-12-03T11:28:32.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.658+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=1S7ZCC2TOZEA tag=MMPNJNI26R7P type=write size=3211418 2023-12-03T11:28:32.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.659+0000 7fe67fa49780 1 < completed delete operation key=URVD2U16EW75 tag=GQIP3PNSZJBR type=del 2023-12-03T11:28:32.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.660+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=XEFYW23MB6VU type=del size=2171456 2023-12-03T11:28:32.663 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.662+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~FMMPC2446IQT.0 size=796221 2023-12-03T11:28:32.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.664+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=FMMPC2446IQT tag=SER8HIJVRI73 type=write size=1844797 2023-12-03T11:28:32.666 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.665+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=IDK8I6OZUJMG type=write size=41111 2023-12-03T11:28:32.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.666+0000 7fe67fa49780 -1 < failed to complete operation key=Y0VRZR6S8FP6 tag=J6OSROETZOMW type=del size=608109: (22) Invalid argument 2023-12-03T11:28:32.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.668+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~ARUT4HJLZ9HY.0 size=589330 2023-12-03T11:28:32.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.668+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=ARUT4HJLZ9HY tag=C6J034PXP9AV type=write size=1637906 2023-12-03T11:28:32.671 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.670+0000 7fe67fa49780 1 < completed write operation key=2GX6IWVZH25N tag=9KVUR0KGKCM6 type=write size=275145 2023-12-03T11:28:32.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.672+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~YWI4YVXXS5XY.0 size=1048576 2023-12-03T11:28:32.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.673+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~YWI4YVXXS5XY.1 size=1021245 2023-12-03T11:28:32.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.673+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=YWI4YVXXS5XY tag=HJ3O5NLK7HUO type=write size=3118397 2023-12-03T11:28:32.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.674+0000 7fe67fa49780 1 < completed delete operation key=OH2XUEEYL9JO tag=OF448JELQOMB type=del 2023-12-03T11:28:32.676 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.675+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=A5ZAHGOV03IH type=del size=3874582 2023-12-03T11:28:32.677 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.676+0000 7fe67fa49780 1 < completed write operation key=SIES92K9QVJV tag=NUW9JSNUFSAF type=write size=332091 2023-12-03T11:28:32.679 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.678+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~5NU82IR9SFGO.0 size=534231 2023-12-03T11:28:32.679 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.678+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=5NU82IR9SFGO tag=XAIQSX52TZ67 type=write size=1582807 2023-12-03T11:28:32.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.679+0000 7fe67fa49780 1 < canceled operation key=DDHGOWEI7WEI tag=Q6ZW5C1TAFAY type=write size=555980 2023-12-03T11:28:32.682 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.681+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~EPP7U3AWC5BR.0 size=302430 2023-12-03T11:28:32.682 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.681+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=EPP7U3AWC5BR tag=5BRJ4551ST52 type=write size=1351006 2023-12-03T11:28:32.684 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.683+0000 7fe67fa49780 1 < canceled operation key=N87KA638VE01 tag=EV62TJSNREUS type=del size=801133 2023-12-03T11:28:32.685 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.684+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=UTQ7SW0FEUBV type=del size=1760980 2023-12-03T11:28:32.686 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.685+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~F3N13YJV7SEN.0 size=822362 2023-12-03T11:28:32.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.687+0000 7fe67fa49780 1 < completed multipart upload key=6LQ18VAE3ZN6 upload=F3N13YJV7SEN tag=RW8BU9RHTJJK type=write size=1870938 2023-12-03T11:28:32.690 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.689+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~COQVW79U6JI2.0 size=1048576 2023-12-03T11:28:32.691 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.690+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~COQVW79U6JI2.1 size=1048576 2023-12-03T11:28:32.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.691+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~COQVW79U6JI2.2 size=584035 2023-12-03T11:28:32.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.691+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=COQVW79U6JI2 tag=IS5VN17RL63P type=write size=3729763 2023-12-03T11:28:32.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.692+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=H8CPKOZSUESH type=del 2023-12-03T11:28:32.696 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.695+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~ILCGKKZ70TLE.0 size=1048576 2023-12-03T11:28:32.697 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.696+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~ILCGKKZ70TLE.1 size=1048576 2023-12-03T11:28:32.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.697+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~ILCGKKZ70TLE.2 size=445106 2023-12-03T11:28:32.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.697+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=ILCGKKZ70TLE tag=DTF2P3TMP40P type=write size=3590834 2023-12-03T11:28:32.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.699+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~25L3XUORSMYQ.0 size=1048576 2023-12-03T11:28:32.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.699+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~25L3XUORSMYQ.1 size=1048576 2023-12-03T11:28:32.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.700+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~25L3XUORSMYQ.2 size=293025 2023-12-03T11:28:32.703 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.702+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=25L3XUORSMYQ tag=VXY43P99NRV7 type=write size=3438753 2023-12-03T11:28:32.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.704+0000 7fe67fa49780 1 > prepared part key=_multipart_0GQZY07Y2PVI.2~EAV1LREE4PQL.0 size=897383 2023-12-03T11:28:32.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.704+0000 7fe67fa49780 1 > prepared multipart upload key=0GQZY07Y2PVI upload=EAV1LREE4PQL tag=HQ3INWMRKU58 type=write size=1945959 2023-12-03T11:28:32.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.706+0000 7fe67fa49780 1 < completed part key=_multipart_CIB1NZHJGO46.2~1IY8I0A834N1.0 size=779058 2023-12-03T11:28:32.708 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.708+0000 7fe67fa49780 1 < completed multipart upload key=CIB1NZHJGO46 upload=1IY8I0A834N1 tag=K29AR8EJH1GU type=write size=1827634 2023-12-03T11:28:32.710 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.709+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=BT001ZE19W40 type=write size=392355 2023-12-03T11:28:32.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.711+0000 7fe67fa49780 1 < suggested update operation key=0GQZY07Y2PVI tag=2VWMEH2U8P47 type=write size=24397 2023-12-03T11:28:32.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.712+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=ZHQTVK6AFX05 type=write size=181773 2023-12-03T11:28:32.714 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.713+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=LPIOWGVCPMMX type=del 2023-12-03T11:28:32.716 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.715+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~D17RNV5U1XOT.0 size=1048576 2023-12-03T11:28:32.717 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.716+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~D17RNV5U1XOT.1 size=690694 2023-12-03T11:28:32.717 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.716+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=D17RNV5U1XOT tag=JUB7D3EOU5VT type=write size=2787846 2023-12-03T11:28:32.718 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.717+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=IGAF0W18MXIL type=del 2023-12-03T11:28:32.719 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.719+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=SVUCKFBT22FC type=del size=1572291 2023-12-03T11:28:32.720 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.719+0000 7fe67fa49780 1 < canceled part key=_multipart_6LQ18VAE3ZN6.2~1S7ZCC2TOZEA.0 size=1048576 2023-12-03T11:28:32.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.720+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~1S7ZCC2TOZEA.1 size=1048576 2023-12-03T11:28:32.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.721+0000 7fe67fa49780 1 < completed part key=_multipart_6LQ18VAE3ZN6.2~1S7ZCC2TOZEA.2 size=65690 2023-12-03T11:28:32.723 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.722+0000 7fe67fa49780 1 < canceled multipart upload key=6LQ18VAE3ZN6 upload=1S7ZCC2TOZEA tag=MMPNJNI26R7P type=write size=3211418 2023-12-03T11:28:32.725 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.724+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=F34LP1F1I71Y type=del size=3827173 2023-12-03T11:28:32.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.725+0000 7fe67fa49780 1 < completed delete operation key=CIB1NZHJGO46 tag=XEFYW23MB6VU type=del 2023-12-03T11:28:32.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.726+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=BJ3PCTABJU8T type=del size=3807931 2023-12-03T11:28:32.728 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.727+0000 7fe67fa49780 1 < completed write operation key=TXVHRE03Z3DA tag=IDK8I6OZUJMG type=write size=41111 2023-12-03T11:28:32.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.729+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~RO92HZTOVGI6.0 size=1048576 2023-12-03T11:28:32.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.730+0000 7fe67fa49780 1 > prepared part key=_multipart_2GX6IWVZH25N.2~RO92HZTOVGI6.1 size=92575 2023-12-03T11:28:32.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.730+0000 7fe67fa49780 1 > prepared multipart upload key=2GX6IWVZH25N upload=RO92HZTOVGI6 tag=7WMJV72FBK2G type=write size=2189727 2023-12-03T11:28:32.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.731+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~ARUT4HJLZ9HY.0 size=589330 2023-12-03T11:28:32.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.733+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=ARUT4HJLZ9HY tag=C6J034PXP9AV type=write size=1637906 2023-12-03T11:28:32.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.734+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=NI56PFLYFR7S type=write size=328617 2023-12-03T11:28:32.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.735+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~YWI4YVXXS5XY.0 size=1048576 2023-12-03T11:28:32.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.736+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~YWI4YVXXS5XY.1 size=1021245 2023-12-03T11:28:32.739 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.738+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=YWI4YVXXS5XY tag=HJ3O5NLK7HUO type=write size=3118397 2023-12-03T11:28:32.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.739+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=1BJWVNNOZM3Q type=del size=595625 2023-12-03T11:28:32.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.740+0000 7fe67fa49780 1 < canceled operation key=P05UIP1IU4Z7 tag=A5ZAHGOV03IH type=del size=3874582 2023-12-03T11:28:32.743 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.742+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~03BZU44AA6D1.0 size=1048576 2023-12-03T11:28:32.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.743+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~03BZU44AA6D1.1 size=1048576 2023-12-03T11:28:32.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.744+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~03BZU44AA6D1.2 size=363290 2023-12-03T11:28:32.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.744+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=03BZU44AA6D1 tag=1AXE178AP1XO type=write size=3509018 2023-12-03T11:28:32.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.745+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~5NU82IR9SFGO.0 size=534231 2023-12-03T11:28:32.750 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.749+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=5NU82IR9SFGO tag=XAIQSX52TZ67 type=write size=1582807 2023-12-03T11:28:32.751 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.750+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=DEQK9SISHW7O type=write size=160420 2023-12-03T11:28:32.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.751+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~EPP7U3AWC5BR.0 size=302430 2023-12-03T11:28:32.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.753+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=EPP7U3AWC5BR tag=5BRJ4551ST52 type=write size=1351006 2023-12-03T11:28:32.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.754+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=CTM5ODKSQ91P type=del size=2298273 2023-12-03T11:28:32.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.755+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=UTQ7SW0FEUBV type=del 2023-12-03T11:28:32.758 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.757+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=XWE1RKKKAM04 type=del size=566236 2023-12-03T11:28:32.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.758+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~COQVW79U6JI2.0 size=1048576 2023-12-03T11:28:32.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.759+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~COQVW79U6JI2.1 size=1048576 2023-12-03T11:28:32.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.760+0000 7fe67fa49780 1 < completed part key=_multipart_UL24DVOA31Y7.2~COQVW79U6JI2.2 size=584035 2023-12-03T11:28:32.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.762+0000 7fe67fa49780 1 < completed multipart upload key=UL24DVOA31Y7 upload=COQVW79U6JI2 tag=IS5VN17RL63P type=write size=3729763 2023-12-03T11:28:32.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.763+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=Y6TTL7Q87FSQ type=del size=464688 2023-12-03T11:28:32.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.764+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~ILCGKKZ70TLE.0 size=1048576 2023-12-03T11:28:32.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.765+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~ILCGKKZ70TLE.1 size=1048576 2023-12-03T11:28:32.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.766+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~ILCGKKZ70TLE.2 size=445106 2023-12-03T11:28:32.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.768+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=ILCGKKZ70TLE tag=DTF2P3TMP40P type=write size=3590834 2023-12-03T11:28:32.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.769+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=D8ZDHWYTO5AW type=del size=3202603 2023-12-03T11:28:32.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.770+0000 7fe67fa49780 1 < canceled part key=_multipart_0GQZY07Y2PVI.2~EAV1LREE4PQL.0 size=897383 2023-12-03T11:28:32.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.772+0000 7fe67fa49780 1 < canceled multipart upload key=0GQZY07Y2PVI upload=EAV1LREE4PQL tag=HQ3INWMRKU58 type=write size=1945959 2023-12-03T11:28:32.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.774+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~8LEHNFXIRYR6.0 size=19251 2023-12-03T11:28:32.775 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.774+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=8LEHNFXIRYR6 tag=C1V827H2U91F type=write size=1067827 2023-12-03T11:28:32.776 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.775+0000 7fe67fa49780 1 < completed write operation key=XZHCD4R4EVZR tag=BT001ZE19W40 type=write size=392355 2023-12-03T11:28:32.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.777+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~T7KSWHHSWEGL.0 size=1048576 2023-12-03T11:28:32.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.778+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~T7KSWHHSWEGL.1 size=803542 2023-12-03T11:28:32.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.778+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=T7KSWHHSWEGL tag=V55D2EPB9L5D type=write size=2900694 2023-12-03T11:28:32.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.779+0000 7fe67fa49780 1 < completed write operation key=6LQ18VAE3ZN6 tag=ZHQTVK6AFX05 type=write size=181773 2023-12-03T11:28:32.782 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.781+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~XT11I77UQHA7.0 size=1048576 2023-12-03T11:28:32.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.782+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~XT11I77UQHA7.1 size=1048576 2023-12-03T11:28:32.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.783+0000 7fe67fa49780 1 > prepared part key=_multipart_DDHGOWEI7WEI.2~XT11I77UQHA7.2 size=451681 2023-12-03T11:28:32.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.783+0000 7fe67fa49780 1 > prepared multipart upload key=DDHGOWEI7WEI upload=XT11I77UQHA7 tag=7SXR8MGRI2OG type=write size=3597409 2023-12-03T11:28:32.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.783+0000 7fe67fa49780 1 < canceled part key=_multipart_9AUO0SRFTAUJ.2~D17RNV5U1XOT.0 size=1048576 2023-12-03T11:28:32.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.784+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~D17RNV5U1XOT.1 size=690694 2023-12-03T11:28:32.787 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.786+0000 7fe67fa49780 1 < canceled multipart upload key=9AUO0SRFTAUJ upload=D17RNV5U1XOT tag=JUB7D3EOU5VT type=write size=2787846 2023-12-03T11:28:32.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.787+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=1M71OOQTY703 type=del size=2232722 2023-12-03T11:28:32.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.789+0000 7fe67fa49780 1 < suggested remove operation key=OH2XUEEYL9JO tag=SVUCKFBT22FC type=del 2023-12-03T11:28:32.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.792+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~LNB7PT491MHM.0 size=1048576 2023-12-03T11:28:32.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.792+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~LNB7PT491MHM.1 size=39274 2023-12-03T11:28:32.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.792+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=LNB7PT491MHM tag=4KL4M2H7Z59A type=write size=2136426 2023-12-03T11:28:32.796 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.795+0000 7fe67fa49780 1 < suggested update operation key=IIW1Y6QYEODQ tag=F34LP1F1I71Y type=del size=3827173 2023-12-03T11:28:32.798 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.797+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~57Y8SEIM91RF.0 size=1048576 2023-12-03T11:28:32.799 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.798+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~57Y8SEIM91RF.1 size=561688 2023-12-03T11:28:32.799 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.798+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=57Y8SEIM91RF tag=3MJ88BOX9VWM type=write size=2658840 2023-12-03T11:28:32.800 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.799+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=BJ3PCTABJU8T type=del 2023-12-03T11:28:32.801 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.800+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=N6BI525ABD9A type=write size=350018 2023-12-03T11:28:32.803 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.803+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~RO92HZTOVGI6.0 size=1048576 2023-12-03T11:28:32.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.804+0000 7fe67fa49780 1 < completed part key=_multipart_2GX6IWVZH25N.2~RO92HZTOVGI6.1 size=92575 2023-12-03T11:28:32.808 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.807+0000 7fe67fa49780 1 < completed multipart upload key=2GX6IWVZH25N upload=RO92HZTOVGI6 tag=7WMJV72FBK2G type=write size=2189727 2023-12-03T11:28:32.810 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.809+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=374VJW7K5503 type=del size=946803 2023-12-03T11:28:32.811 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.810+0000 7fe67fa49780 1 < completed write operation key=6LQ18VAE3ZN6 tag=NI56PFLYFR7S type=write size=328617 2023-12-03T11:28:32.812 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.811+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=9IUQZNAHSXYH type=del size=257514 2023-12-03T11:28:32.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.812+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=1BJWVNNOZM3Q type=del 2023-12-03T11:28:32.815 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.815+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~NR2498OW5TNV.0 size=1048576 2023-12-03T11:28:32.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.815+0000 7fe67fa49780 1 > prepared part key=_multipart_ASODFGLQ5VNY.2~NR2498OW5TNV.1 size=305935 2023-12-03T11:28:32.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.815+0000 7fe67fa49780 1 > prepared multipart upload key=ASODFGLQ5VNY upload=NR2498OW5TNV tag=3XXVH4HS11AG type=write size=2403087 2023-12-03T11:28:32.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.817+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~03BZU44AA6D1.0 size=1048576 2023-12-03T11:28:32.819 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.818+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~03BZU44AA6D1.1 size=1048576 2023-12-03T11:28:32.820 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.819+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~03BZU44AA6D1.2 size=363290 2023-12-03T11:28:32.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.821+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=03BZU44AA6D1 tag=1AXE178AP1XO type=write size=3509018 2023-12-03T11:28:32.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.823+0000 7fe67fa49780 1 > prepared part key=_multipart_P05UIP1IU4Z7.2~1EDJCVUC6LFF.0 size=486361 2023-12-03T11:28:32.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.823+0000 7fe67fa49780 1 > prepared multipart upload key=P05UIP1IU4Z7 upload=1EDJCVUC6LFF tag=18K33ZP6KODM type=write size=1534937 2023-12-03T11:28:32.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.824+0000 7fe67fa49780 1 < completed write operation key=8UZJU9PNWIB6 tag=DEQK9SISHW7O type=write size=160420 2023-12-03T11:28:32.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.826+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~LULVYALA3073.0 size=1048576 2023-12-03T11:28:32.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.827+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~LULVYALA3073.1 size=805630 2023-12-03T11:28:32.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.827+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=LULVYALA3073 tag=OIHZRSHT015V type=write size=2902782 2023-12-03T11:28:32.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.828+0000 7fe67fa49780 -1 < failed to complete operation key=OH2XUEEYL9JO tag=CTM5ODKSQ91P type=del size=2298273: (22) Invalid argument 2023-12-03T11:28:32.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.830+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=WS78L3T8S9OU type=del size=1472967 2023-12-03T11:28:32.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.831+0000 7fe67fa49780 1 < completed delete operation key=SIES92K9QVJV tag=XWE1RKKKAM04 type=del 2023-12-03T11:28:32.833 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.832+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=DS6VROTASL66 type=del size=2371669 2023-12-03T11:28:32.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.833+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=Y6TTL7Q87FSQ type=del 2023-12-03T11:28:32.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.835+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~17ULK3G49F8P.0 size=828156 2023-12-03T11:28:32.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.835+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=17ULK3G49F8P tag=42QZ5W1LWN50 type=write size=1876732 2023-12-03T11:28:32.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.836+0000 7fe67fa49780 1 < completed delete operation key=TXVHRE03Z3DA tag=D8ZDHWYTO5AW type=del 2023-12-03T11:28:32.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.837+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=YHDH8OJFUHKI type=del size=1487024 2023-12-03T11:28:32.839 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.838+0000 7fe67fa49780 1 < canceled part key=_multipart_N87KA638VE01.2~8LEHNFXIRYR6.0 size=19251 2023-12-03T11:28:32.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.839+0000 7fe67fa49780 1 < canceled multipart upload key=N87KA638VE01 upload=8LEHNFXIRYR6 tag=C1V827H2U91F type=write size=1067827 2023-12-03T11:28:32.841 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.841+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=JEI3ATR907HY type=del size=2927952 2023-12-03T11:28:32.843 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.842+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~T7KSWHHSWEGL.0 size=1048576 2023-12-03T11:28:32.844 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.843+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~T7KSWHHSWEGL.1 size=803542 2023-12-03T11:28:32.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.845+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=T7KSWHHSWEGL tag=V55D2EPB9L5D type=write size=2900694 2023-12-03T11:28:32.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.847+0000 7fe67fa49780 1 > prepared part key=_multipart_9OD4G28SDLB4.2~72HOOKEKTZL0.0 size=431861 2023-12-03T11:28:32.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.847+0000 7fe67fa49780 1 > prepared multipart upload key=9OD4G28SDLB4 upload=72HOOKEKTZL0 tag=AEZ4135XBD1T type=write size=1480437 2023-12-03T11:28:32.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.848+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~XT11I77UQHA7.0 size=1048576 2023-12-03T11:28:32.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.849+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~XT11I77UQHA7.1 size=1048576 2023-12-03T11:28:32.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.850+0000 7fe67fa49780 1 < completed part key=_multipart_DDHGOWEI7WEI.2~XT11I77UQHA7.2 size=451681 2023-12-03T11:28:32.853 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.852+0000 7fe67fa49780 1 < completed multipart upload key=DDHGOWEI7WEI upload=XT11I77UQHA7 tag=7SXR8MGRI2OG type=write size=3597409 2023-12-03T11:28:32.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.853+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=6DUH8F2NC740 type=del size=1558379 2023-12-03T11:28:32.855 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.854+0000 7fe67fa49780 1 < completed delete operation key=983BDZLASC3S tag=1M71OOQTY703 type=del 2023-12-03T11:28:32.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.855+0000 7fe67fa49780 1 > prepared operation key=IIW1Y6QYEODQ tag=TDOMGH7AVA28 type=del size=1495509 2023-12-03T11:28:32.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.856+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~LNB7PT491MHM.0 size=1048576 2023-12-03T11:28:32.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.857+0000 7fe67fa49780 1 < completed part key=_multipart_CC1X1OP7L6BJ.2~LNB7PT491MHM.1 size=39274 2023-12-03T11:28:32.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.859+0000 7fe67fa49780 1 < completed multipart upload key=CC1X1OP7L6BJ upload=LNB7PT491MHM tag=4KL4M2H7Z59A type=write size=2136426 2023-12-03T11:28:32.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.861+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~BN8KPIUAI602.0 size=1048576 2023-12-03T11:28:32.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.862+0000 7fe67fa49780 1 > prepared part key=_multipart_TXVHRE03Z3DA.2~BN8KPIUAI602.1 size=112135 2023-12-03T11:28:32.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.862+0000 7fe67fa49780 1 > prepared multipart upload key=TXVHRE03Z3DA upload=BN8KPIUAI602 tag=842TB6PKESXG type=write size=2209287 2023-12-03T11:28:32.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.864+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~57Y8SEIM91RF.0 size=1048576 2023-12-03T11:28:32.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.864+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~57Y8SEIM91RF.1 size=561688 2023-12-03T11:28:32.867 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.866+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=57Y8SEIM91RF tag=3MJ88BOX9VWM type=write size=2658840 2023-12-03T11:28:32.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.868+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=AJQ6YUG1T7U7 type=del size=3138754 2023-12-03T11:28:32.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.869+0000 7fe67fa49780 1 < completed write operation key=983BDZLASC3S tag=N6BI525ABD9A type=write size=350018 2023-12-03T11:28:32.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.870+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=PIUXR4KQMTJT type=del size=4081149 2023-12-03T11:28:32.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.871+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=374VJW7K5503 type=del 2023-12-03T11:28:32.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.872+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=DCG8PIGU3DYR type=del size=3261598 2023-12-03T11:28:32.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.873+0000 7fe67fa49780 1 < canceled operation key=CIB1NZHJGO46 tag=9IUQZNAHSXYH type=del size=257514 2023-12-03T11:28:32.875 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.875+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=TEFZELT1ERMH type=write size=616638 2023-12-03T11:28:32.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.876+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~NR2498OW5TNV.0 size=1048576 2023-12-03T11:28:32.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.877+0000 7fe67fa49780 1 < completed part key=_multipart_ASODFGLQ5VNY.2~NR2498OW5TNV.1 size=305935 2023-12-03T11:28:32.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.879+0000 7fe67fa49780 1 < completed multipart upload key=ASODFGLQ5VNY upload=NR2498OW5TNV tag=3XXVH4HS11AG type=write size=2403087 2023-12-03T11:28:32.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.880+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=94B28ZA8A57D type=write size=308119 2023-12-03T11:28:32.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.881+0000 7fe67fa49780 1 < completed part key=_multipart_P05UIP1IU4Z7.2~1EDJCVUC6LFF.0 size=486361 2023-12-03T11:28:32.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.883+0000 7fe67fa49780 1 < completed multipart upload key=P05UIP1IU4Z7 upload=1EDJCVUC6LFF tag=18K33ZP6KODM type=write size=1534937 2023-12-03T11:28:32.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.884+0000 7fe67fa49780 1 > prepared operation key=CC1X1OP7L6BJ tag=OZK50OZDJSXC type=del size=3174019 2023-12-03T11:28:32.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.885+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~LULVYALA3073.0 size=1048576 2023-12-03T11:28:32.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.886+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~LULVYALA3073.1 size=805630 2023-12-03T11:28:32.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.888+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=LULVYALA3073 tag=OIHZRSHT015V type=write size=2902782 2023-12-03T11:28:32.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.889+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=F9ISVTRR794B type=write size=756807 2023-12-03T11:28:32.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.890+0000 7fe67fa49780 1 < completed delete operation key=H8MBLWXG7BCZ tag=WS78L3T8S9OU type=del 2023-12-03T11:28:32.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.892+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~RP94ZW2EZXX1.0 size=1048576 2023-12-03T11:28:32.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.893+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~RP94ZW2EZXX1.1 size=620736 2023-12-03T11:28:32.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.893+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=RP94ZW2EZXX1 tag=0076ULREN1IN type=write size=2717888 2023-12-03T11:28:32.895 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.894+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=DS6VROTASL66 type=del 2023-12-03T11:28:32.896 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.895+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=CCU84BPXUN14 type=del size=3080035 2023-12-03T11:28:32.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.897+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~17ULK3G49F8P.0 size=828156 2023-12-03T11:28:32.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.899+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=17ULK3G49F8P tag=42QZ5W1LWN50 type=write size=1876732 2023-12-03T11:28:32.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.900+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=53Q1DAYBD2I8 type=del size=1649657 2023-12-03T11:28:32.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.901+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=YHDH8OJFUHKI type=del 2023-12-03T11:28:32.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.902+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=TZK9AUGFCGKF type=write size=195848 2023-12-03T11:28:32.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.905+0000 7fe67fa49780 1 < suggested remove operation key=983BDZLASC3S tag=JEI3ATR907HY type=del 2023-12-03T11:28:32.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.909+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~QZQBOUNNQE65.0 size=973108 2023-12-03T11:28:32.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.909+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=QZQBOUNNQE65 tag=E4LCB1XXXNM8 type=write size=2021684 2023-12-03T11:28:32.911 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.910+0000 7fe67fa49780 1 < completed part key=_multipart_9OD4G28SDLB4.2~72HOOKEKTZL0.0 size=431861 2023-12-03T11:28:32.913 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.912+0000 7fe67fa49780 1 < completed multipart upload key=9OD4G28SDLB4 upload=72HOOKEKTZL0 tag=AEZ4135XBD1T type=write size=1480437 2023-12-03T11:28:32.916 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.915+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~4AND00T029E3.0 size=387147 2023-12-03T11:28:32.916 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.915+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=4AND00T029E3 tag=4LKEVA9Q9BI0 type=write size=1435723 2023-12-03T11:28:32.917 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.916+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=6DUH8F2NC740 type=del 2023-12-03T11:28:32.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.917+0000 7fe67fa49780 1 > prepared operation key=8UZJU9PNWIB6 tag=QKHNS6TQYB9Q type=del size=1385191 2023-12-03T11:28:32.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.919+0000 7fe67fa49780 1 < completed delete operation key=IIW1Y6QYEODQ tag=TDOMGH7AVA28 type=del 2023-12-03T11:28:32.921 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.920+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=NYNRAYPV27E4 type=del size=347414 2023-12-03T11:28:32.922 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.921+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~BN8KPIUAI602.0 size=1048576 2023-12-03T11:28:32.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.922+0000 7fe67fa49780 1 < completed part key=_multipart_TXVHRE03Z3DA.2~BN8KPIUAI602.1 size=112135 2023-12-03T11:28:32.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.924+0000 7fe67fa49780 1 < completed multipart upload key=TXVHRE03Z3DA upload=BN8KPIUAI602 tag=842TB6PKESXG type=write size=2209287 2023-12-03T11:28:32.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.925+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=SHNS8FPPPXBK type=del size=4124136 2023-12-03T11:28:32.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.926+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=AJQ6YUG1T7U7 type=del 2023-12-03T11:28:32.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.927+0000 7fe67fa49780 1 > prepared operation key=V9ZVWHO8IF8L tag=V97ATL3T3620 type=del size=2865206 2023-12-03T11:28:32.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.928+0000 7fe67fa49780 1 < completed delete operation key=DDHGOWEI7WEI tag=PIUXR4KQMTJT type=del 2023-12-03T11:28:32.930 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.929+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=SVQR4YTT5WJV type=del size=2029928 2023-12-03T11:28:32.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.932+0000 7fe67fa49780 1 < suggested remove operation key=PFBGR7OF7JQG tag=DCG8PIGU3DYR type=del 2023-12-03T11:28:32.934 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.933+0000 7fe67fa49780 1 > prepared operation key=H8MBLWXG7BCZ tag=LV4OQKMADES9 type=write size=501498 2023-12-03T11:28:32.935 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.934+0000 7fe67fa49780 1 < completed write operation key=OH2XUEEYL9JO tag=TEFZELT1ERMH type=write size=616638 2023-12-03T11:28:32.936 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.935+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=JJ9RSHIMKILH type=del size=2518062 2023-12-03T11:28:32.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.936+0000 7fe67fa49780 1 < completed write operation key=A7GOX2W0WB83 tag=94B28ZA8A57D type=write size=308119 2023-12-03T11:28:32.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.938+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=J69UJKA32VAU type=del size=1169990 2023-12-03T11:28:32.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.940+0000 7fe67fa49780 1 < suggested update operation key=CC1X1OP7L6BJ tag=OZK50OZDJSXC type=del size=3174019 2023-12-03T11:28:32.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.941+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=9PZ1UD7BGVFK type=del size=634393 2023-12-03T11:28:32.944 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.943+0000 7fe67fa49780 1 < suggested update operation key=P05UIP1IU4Z7 tag=F9ISVTRR794B type=write size=756807 2023-12-03T11:28:32.945 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.944+0000 7fe67fa49780 1 > prepared operation key=9OD4G28SDLB4 tag=F2CP3RRMFRPC type=del size=4057362 2023-12-03T11:28:32.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.945+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~RP94ZW2EZXX1.0 size=1048576 2023-12-03T11:28:32.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.946+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~RP94ZW2EZXX1.1 size=620736 2023-12-03T11:28:32.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.948+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=RP94ZW2EZXX1 tag=0076ULREN1IN type=write size=2717888 2023-12-03T11:28:32.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.949+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=1YL4E2K1L80V type=del size=1481716 2023-12-03T11:28:32.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.950+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=CCU84BPXUN14 type=del 2023-12-03T11:28:32.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.952+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~ATD8PQ1EFLWU.0 size=1048576 2023-12-03T11:28:32.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.953+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~ATD8PQ1EFLWU.1 size=1048576 2023-12-03T11:28:32.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.954+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~ATD8PQ1EFLWU.2 size=595387 2023-12-03T11:28:32.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.954+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=ATD8PQ1EFLWU tag=0TZIS39R9WA1 type=write size=3741115 2023-12-03T11:28:32.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.955+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=53Q1DAYBD2I8 type=del 2023-12-03T11:28:32.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.956+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=2MRUSXNSBNE4 type=write size=400634 2023-12-03T11:28:32.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.959+0000 7fe67fa49780 1 < suggested remove operation key=V9ZVWHO8IF8L tag=TZK9AUGFCGKF type=write 2023-12-03T11:28:32.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.960+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=1DBIKH9I1T8V type=write size=273768 2023-12-03T11:28:32.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.961+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~QZQBOUNNQE65.0 size=973108 2023-12-03T11:28:32.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.963+0000 7fe67fa49780 1 < completed multipart upload key=N87KA638VE01 upload=QZQBOUNNQE65 tag=E4LCB1XXXNM8 type=write size=2021684 2023-12-03T11:28:32.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.964+0000 7fe67fa49780 1 > prepared operation key=TXVHRE03Z3DA tag=UWOXF497QO5S type=write size=453840 2023-12-03T11:28:32.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.964+0000 7fe67fa49780 1 < canceled part key=_multipart_H8MBLWXG7BCZ.2~4AND00T029E3.0 size=387147 2023-12-03T11:28:32.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.966+0000 7fe67fa49780 1 < canceled multipart upload key=H8MBLWXG7BCZ upload=4AND00T029E3 tag=4LKEVA9Q9BI0 type=write size=1435723 2023-12-03T11:28:32.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.967+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=Y94YJBO9NKV3 type=del size=2637177 2023-12-03T11:28:32.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.968+0000 7fe67fa49780 1 < completed delete operation key=8UZJU9PNWIB6 tag=QKHNS6TQYB9Q type=del 2023-12-03T11:28:32.971 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.970+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~R2SQI7YDYHYI.0 size=1048576 2023-12-03T11:28:32.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.971+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~R2SQI7YDYHYI.1 size=254872 2023-12-03T11:28:32.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.971+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=R2SQI7YDYHYI tag=GG3TAXJ6Z9L5 type=write size=2352024 2023-12-03T11:28:32.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.973+0000 7fe67fa49780 1 < completed delete operation key=KMC5YD2M3I45 tag=NYNRAYPV27E4 type=del 2023-12-03T11:28:32.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.975+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~UNLCO3AQ9FT7.0 size=1048576 2023-12-03T11:28:32.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.976+0000 7fe67fa49780 1 > prepared part key=_multipart_N87KA638VE01.2~UNLCO3AQ9FT7.1 size=552698 2023-12-03T11:28:32.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.976+0000 7fe67fa49780 1 > prepared multipart upload key=N87KA638VE01 upload=UNLCO3AQ9FT7 tag=XB1CXNLF0YXT type=write size=2649850 2023-12-03T11:28:32.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.977+0000 7fe67fa49780 -1 < failed to complete operation key=PFBGR7OF7JQG tag=SHNS8FPPPXBK type=del size=4124136: (22) Invalid argument 2023-12-03T11:28:32.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.978+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=UYPVTWTVOF49 type=del size=2659912 2023-12-03T11:28:32.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.979+0000 7fe67fa49780 -1 < failed to complete operation key=V9ZVWHO8IF8L tag=V97ATL3T3620 type=del size=2865206: (22) Invalid argument 2023-12-03T11:28:32.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.980+0000 7fe67fa49780 1 > prepared operation key=XZHCD4R4EVZR tag=J338FMMB092B type=del size=1588230 2023-12-03T11:28:32.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.981+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=SVQR4YTT5WJV type=del 2023-12-03T11:28:32.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.983+0000 7fe67fa49780 1 > prepared operation key=SIES92K9QVJV tag=WVTIQ3MMMFLE type=write size=511648 2023-12-03T11:28:32.986 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.985+0000 7fe67fa49780 1 < suggested remove operation key=H8MBLWXG7BCZ tag=LV4OQKMADES9 type=write 2023-12-03T11:28:32.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.986+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=T1ZYDD0L4FD1 type=del size=306902 2023-12-03T11:28:32.988 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.987+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=JJ9RSHIMKILH type=del 2023-12-03T11:28:32.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.989+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~5ND71WTJ6QTN.0 size=1048576 2023-12-03T11:28:32.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.990+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~5ND71WTJ6QTN.1 size=511945 2023-12-03T11:28:32.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.990+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=5ND71WTJ6QTN tag=7E6SWE9YIFZI type=write size=2609097 2023-12-03T11:28:32.994 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.993+0000 7fe67fa49780 1 < completed delete operation key=Y0VRZR6S8FP6 tag=J69UJKA32VAU type=del 2023-12-03T11:28:32.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.994+0000 7fe67fa49780 1 > prepared operation key=9AUO0SRFTAUJ tag=1K6RBB3FDWV8 type=write size=527945 2023-12-03T11:28:32.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.995+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=9PZ1UD7BGVFK type=del 2023-12-03T11:28:32.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.996+0000 7fe67fa49780 1 > prepared operation key=6LQ18VAE3ZN6 tag=WU81D4CH0SSI type=del size=323734 2023-12-03T11:28:32.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.997+0000 7fe67fa49780 1 < completed delete operation key=9OD4G28SDLB4 tag=F2CP3RRMFRPC type=del 2023-12-03T11:28:32.999 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:32.998+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=X9ICZD3D4AFQ type=del size=3032432 2023-12-03T11:28:33.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.000+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=1YL4E2K1L80V type=del 2023-12-03T11:28:33.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.001+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=Y6KZVE13DJL5 type=del size=3479653 2023-12-03T11:28:33.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.001+0000 7fe67fa49780 1 < canceled part key=_multipart_PFBGR7OF7JQG.2~ATD8PQ1EFLWU.0 size=1048576 2023-12-03T11:28:33.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.002+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~ATD8PQ1EFLWU.1 size=1048576 2023-12-03T11:28:33.004 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.003+0000 7fe67fa49780 1 < completed part key=_multipart_PFBGR7OF7JQG.2~ATD8PQ1EFLWU.2 size=595387 2023-12-03T11:28:33.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.005+0000 7fe67fa49780 1 < canceled multipart upload key=PFBGR7OF7JQG upload=ATD8PQ1EFLWU tag=0TZIS39R9WA1 type=write size=3741115 2023-12-03T11:28:33.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.006+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=LF5TWPBQYMVP type=del size=1275352 2023-12-03T11:28:33.008 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.007+0000 7fe67fa49780 1 < completed write operation key=A7GOX2W0WB83 tag=2MRUSXNSBNE4 type=write size=400634 2023-12-03T11:28:33.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.009+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~S3X1N7NR1OPE.0 size=17661 2023-12-03T11:28:33.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.009+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=S3X1N7NR1OPE tag=DATR12LSDK66 type=write size=1066237 2023-12-03T11:28:33.013 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.012+0000 7fe67fa49780 1 < suggested update operation key=Y0VRZR6S8FP6 tag=1DBIKH9I1T8V type=write size=273768 2023-12-03T11:28:33.015 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.014+0000 7fe67fa49780 1 > prepared part key=_multipart_CIB1NZHJGO46.2~RCCJEC6ORSMM.0 size=303168 2023-12-03T11:28:33.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.014+0000 7fe67fa49780 1 > prepared multipart upload key=CIB1NZHJGO46 upload=RCCJEC6ORSMM tag=3D1YUKCC78MZ type=write size=1351744 2023-12-03T11:28:33.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.015+0000 7fe67fa49780 1 < completed write operation key=TXVHRE03Z3DA tag=UWOXF497QO5S type=write size=453840 2023-12-03T11:28:33.018 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.017+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~2649Q2OR4AKA.0 size=182795 2023-12-03T11:28:33.018 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.017+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=2649Q2OR4AKA tag=LUWTZ63LBYXA type=write size=1231371 2023-12-03T11:28:33.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.018+0000 7fe67fa49780 1 < completed delete operation key=N87KA638VE01 tag=Y94YJBO9NKV3 type=del 2023-12-03T11:28:33.020 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.019+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=I1MRYJEH524N type=del size=2303850 2023-12-03T11:28:33.021 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.020+0000 7fe67fa49780 1 < completed part key=_multipart_006X4CSXV0KA.2~R2SQI7YDYHYI.0 size=1048576 2023-12-03T11:28:33.021 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.020+0000 7fe67fa49780 1 < canceled part key=_multipart_006X4CSXV0KA.2~R2SQI7YDYHYI.1 size=254872 2023-12-03T11:28:33.023 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.022+0000 7fe67fa49780 1 < canceled multipart upload key=006X4CSXV0KA upload=R2SQI7YDYHYI tag=GG3TAXJ6Z9L5 type=write size=2352024 2023-12-03T11:28:33.025 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.025+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~9OKZBRZFQI4O.0 size=1048576 2023-12-03T11:28:33.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.027+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~9OKZBRZFQI4O.1 size=1048576 2023-12-03T11:28:33.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.028+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~9OKZBRZFQI4O.2 size=889273 2023-12-03T11:28:33.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.028+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=9OKZBRZFQI4O tag=JW4QQ8J3GLX9 type=write size=4035001 2023-12-03T11:28:33.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.028+0000 7fe67fa49780 1 < canceled part key=_multipart_N87KA638VE01.2~UNLCO3AQ9FT7.0 size=1048576 2023-12-03T11:28:33.030 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.029+0000 7fe67fa49780 1 < completed part key=_multipart_N87KA638VE01.2~UNLCO3AQ9FT7.1 size=552698 2023-12-03T11:28:33.032 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.031+0000 7fe67fa49780 1 < canceled multipart upload key=N87KA638VE01 upload=UNLCO3AQ9FT7 tag=XB1CXNLF0YXT type=write size=2649850 2023-12-03T11:28:33.034 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.034+0000 7fe67fa49780 1 > prepared part key=_multipart_PFBGR7OF7JQG.2~NZTUQDTJYP0Z.0 size=26628 2023-12-03T11:28:33.035 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.034+0000 7fe67fa49780 1 > prepared multipart upload key=PFBGR7OF7JQG upload=NZTUQDTJYP0Z tag=JCYH43YPP9CY type=write size=1075204 2023-12-03T11:28:33.036 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.035+0000 7fe67fa49780 1 < canceled operation key=N87KA638VE01 tag=UYPVTWTVOF49 type=del size=2659912 2023-12-03T11:28:33.038 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.037+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~3IWDF6S22O10.0 size=1048576 2023-12-03T11:28:33.039 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.038+0000 7fe67fa49780 1 > prepared part key=_multipart_Q6GBIBMIJRKV.2~3IWDF6S22O10.1 size=564815 2023-12-03T11:28:33.039 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.038+0000 7fe67fa49780 1 > prepared multipart upload key=Q6GBIBMIJRKV upload=3IWDF6S22O10 tag=9MMGTXEAI6M5 type=write size=2661967 2023-12-03T11:28:33.040 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.039+0000 7fe67fa49780 1 < completed delete operation key=XZHCD4R4EVZR tag=J338FMMB092B type=del 2023-12-03T11:28:33.041 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.040+0000 7fe67fa49780 1 > prepared operation key=PFBGR7OF7JQG tag=BT7DZPC39B4L type=del size=888077 2023-12-03T11:28:33.042 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.041+0000 7fe67fa49780 1 < completed write operation key=SIES92K9QVJV tag=WVTIQ3MMMFLE type=write size=511648 2023-12-03T11:28:33.044 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.043+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~DYC0F6SVIAKV.0 size=1048576 2023-12-03T11:28:33.045 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.044+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~DYC0F6SVIAKV.1 size=1048576 2023-12-03T11:28:33.046 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.045+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~DYC0F6SVIAKV.2 size=855060 2023-12-03T11:28:33.046 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.045+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=DYC0F6SVIAKV tag=V4W8REWR96KE type=write size=4000788 2023-12-03T11:28:33.049 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.047+0000 7fe67fa49780 1 < suggested remove operation key=Q6GBIBMIJRKV tag=T1ZYDD0L4FD1 type=del 2023-12-03T11:28:33.052 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.050+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~2GORLL3X8HS7.0 size=1048576 2023-12-03T11:28:33.052 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.050+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~2GORLL3X8HS7.1 size=1048576 2023-12-03T11:28:33.052 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.051+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~2GORLL3X8HS7.2 size=574549 2023-12-03T11:28:33.052 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.051+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=2GORLL3X8HS7 tag=GPRL70LXPD13 type=write size=3720277 2023-12-03T11:28:33.053 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.053+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~5ND71WTJ6QTN.0 size=1048576 2023-12-03T11:28:33.055 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.054+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~5ND71WTJ6QTN.1 size=511945 2023-12-03T11:28:33.057 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.055+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=5ND71WTJ6QTN tag=7E6SWE9YIFZI type=write size=2609097 2023-12-03T11:28:33.058 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.057+0000 7fe67fa49780 1 > prepared operation key=YEMPVKMDANPG tag=2PM56LRUEZ7S type=del size=2384807 2023-12-03T11:28:33.059 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.058+0000 7fe67fa49780 1 < completed write operation key=9AUO0SRFTAUJ tag=1K6RBB3FDWV8 type=write size=527945 2023-12-03T11:28:33.060 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.059+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=PNEPACPPG2NI type=del size=101174 2023-12-03T11:28:33.061 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.060+0000 7fe67fa49780 1 < completed delete operation key=6LQ18VAE3ZN6 tag=WU81D4CH0SSI type=del 2023-12-03T11:28:33.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.061+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=WJSJE81JV5K7 type=del size=2938646 2023-12-03T11:28:33.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.063+0000 7fe67fa49780 1 < completed delete operation key=2GX6IWVZH25N tag=X9ICZD3D4AFQ type=del 2023-12-03T11:28:33.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.064+0000 7fe67fa49780 1 > prepared operation key=006X4CSXV0KA tag=0YB2HKOZRG2Q type=del size=1962776 2023-12-03T11:28:33.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.065+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=Y6KZVE13DJL5 type=del 2023-12-03T11:28:33.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.066+0000 7fe67fa49780 1 > prepared operation key=SXVBDBJ5B09V tag=PE4XFKHHGOXQ type=write size=262253 2023-12-03T11:28:33.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.067+0000 7fe67fa49780 1 < completed delete operation key=0GQZY07Y2PVI tag=LF5TWPBQYMVP type=del 2023-12-03T11:28:33.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.068+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=1WCZQ1VS8924 type=write size=170956 2023-12-03T11:28:33.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.070+0000 7fe67fa49780 1 < completed part key=_multipart_A7GOX2W0WB83.2~S3X1N7NR1OPE.0 size=17661 2023-12-03T11:28:33.073 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.072+0000 7fe67fa49780 1 < completed multipart upload key=A7GOX2W0WB83 upload=S3X1N7NR1OPE tag=DATR12LSDK66 type=write size=1066237 2023-12-03T11:28:33.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.073+0000 7fe67fa49780 1 > prepared operation key=0GQZY07Y2PVI tag=SEIRLP15JPWU type=del size=3791961 2023-12-03T11:28:33.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.073+0000 7fe67fa49780 1 < canceled part key=_multipart_CIB1NZHJGO46.2~RCCJEC6ORSMM.0 size=303168 2023-12-03T11:28:33.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.075+0000 7fe67fa49780 1 < canceled multipart upload key=CIB1NZHJGO46 upload=RCCJEC6ORSMM tag=3D1YUKCC78MZ type=write size=1351744 2023-12-03T11:28:33.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.076+0000 7fe67fa49780 1 > prepared operation key=A7GOX2W0WB83 tag=K6Q8UD09M4C1 type=del size=999645 2023-12-03T11:28:33.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.077+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~2649Q2OR4AKA.0 size=182795 2023-12-03T11:28:33.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.079+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=2649Q2OR4AKA tag=LUWTZ63LBYXA type=write size=1231371 2023-12-03T11:28:33.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.080+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=YPHSY35UOI0C type=del size=912749 2023-12-03T11:28:33.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.081+0000 7fe67fa49780 -1 < failed to complete operation key=Q6GBIBMIJRKV tag=I1MRYJEH524N type=del size=2303850: (22) Invalid argument 2023-12-03T11:28:33.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.083+0000 7fe67fa49780 1 > prepared part key=_multipart_9AUO0SRFTAUJ.2~DF2S3HREAAGG.0 size=380408 2023-12-03T11:28:33.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.083+0000 7fe67fa49780 1 > prepared multipart upload key=9AUO0SRFTAUJ upload=DF2S3HREAAGG tag=JG29EOMFVLCP type=write size=1428984 2023-12-03T11:28:33.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.085+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~9OKZBRZFQI4O.0 size=1048576 2023-12-03T11:28:33.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.086+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~9OKZBRZFQI4O.1 size=1048576 2023-12-03T11:28:33.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.087+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~9OKZBRZFQI4O.2 size=889273 2023-12-03T11:28:33.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.089+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=9OKZBRZFQI4O tag=JW4QQ8J3GLX9 type=write size=4035001 2023-12-03T11:28:33.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.091+0000 7fe67fa49780 1 > prepared part key=_multipart_SXVBDBJ5B09V.2~KF0TZQDF1PX8.0 size=63647 2023-12-03T11:28:33.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.091+0000 7fe67fa49780 1 > prepared multipart upload key=SXVBDBJ5B09V upload=KF0TZQDF1PX8 tag=RFLSUQU0RUR2 type=write size=1112223 2023-12-03T11:28:33.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.091+0000 7fe67fa49780 1 < canceled part key=_multipart_PFBGR7OF7JQG.2~NZTUQDTJYP0Z.0 size=26628 2023-12-03T11:28:33.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.093+0000 7fe67fa49780 1 < canceled multipart upload key=PFBGR7OF7JQG upload=NZTUQDTJYP0Z tag=JCYH43YPP9CY type=write size=1075204 2023-12-03T11:28:33.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.094+0000 7fe67fa49780 1 > prepared operation key=ASODFGLQ5VNY tag=ZFRCB1OVDLPB type=write size=744469 2023-12-03T11:28:33.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.095+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~3IWDF6S22O10.0 size=1048576 2023-12-03T11:28:33.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.096+0000 7fe67fa49780 1 < completed part key=_multipart_Q6GBIBMIJRKV.2~3IWDF6S22O10.1 size=564815 2023-12-03T11:28:33.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.098+0000 7fe67fa49780 1 < completed multipart upload key=Q6GBIBMIJRKV upload=3IWDF6S22O10 tag=9MMGTXEAI6M5 type=write size=2661967 2023-12-03T11:28:33.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.099+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=Y79WJIN0X488 type=del size=1620166 2023-12-03T11:28:33.103 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.102+0000 7fe67fa49780 1 < completed delete operation key=PFBGR7OF7JQG tag=BT7DZPC39B4L type=del 2023-12-03T11:28:33.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.104+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~C1GGSNEMZ0PF.0 size=1048576 2023-12-03T11:28:33.106 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.105+0000 7fe67fa49780 1 > prepared part key=_multipart_0G8KNJBJ9K1Z.2~C1GGSNEMZ0PF.1 size=533661 2023-12-03T11:28:33.106 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.105+0000 7fe67fa49780 1 > prepared multipart upload key=0G8KNJBJ9K1Z upload=C1GGSNEMZ0PF tag=H9JH96AS8ER4 type=write size=2630813 2023-12-03T11:28:33.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.106+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~DYC0F6SVIAKV.0 size=1048576 2023-12-03T11:28:33.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.107+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~DYC0F6SVIAKV.1 size=1048576 2023-12-03T11:28:33.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.108+0000 7fe67fa49780 1 < completed part key=_multipart_8UZJU9PNWIB6.2~DYC0F6SVIAKV.2 size=855060 2023-12-03T11:28:33.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.110+0000 7fe67fa49780 1 < completed multipart upload key=8UZJU9PNWIB6 upload=DYC0F6SVIAKV tag=V4W8REWR96KE type=write size=4000788 2023-12-03T11:28:33.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.113+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~7NSVDVN2587W.0 size=1048576 2023-12-03T11:28:33.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.113+0000 7fe67fa49780 1 > prepared part key=_multipart_H8MBLWXG7BCZ.2~7NSVDVN2587W.1 size=364971 2023-12-03T11:28:33.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.113+0000 7fe67fa49780 1 > prepared multipart upload key=H8MBLWXG7BCZ upload=7NSVDVN2587W tag=D1YA4M1GQVTL type=write size=2462123 2023-12-03T11:28:33.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.115+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~2GORLL3X8HS7.0 size=1048576 2023-12-03T11:28:33.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.116+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~2GORLL3X8HS7.1 size=1048576 2023-12-03T11:28:33.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.117+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~2GORLL3X8HS7.2 size=574549 2023-12-03T11:28:33.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.119+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=2GORLL3X8HS7 tag=GPRL70LXPD13 type=write size=3720277 2023-12-03T11:28:33.122 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.121+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~C2J5QWTAUKG2.0 size=1048576 2023-12-03T11:28:33.123 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.122+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~C2J5QWTAUKG2.1 size=1048576 2023-12-03T11:28:33.124 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.123+0000 7fe67fa49780 1 > prepared part key=_multipart_Y0VRZR6S8FP6.2~C2J5QWTAUKG2.2 size=766977 2023-12-03T11:28:33.124 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.123+0000 7fe67fa49780 1 > prepared multipart upload key=Y0VRZR6S8FP6 upload=C2J5QWTAUKG2 tag=QT0U0TQ1U2B7 type=write size=3912705 2023-12-03T11:28:33.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.124+0000 7fe67fa49780 1 < completed delete operation key=YEMPVKMDANPG tag=2PM56LRUEZ7S type=del 2023-12-03T11:28:33.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.125+0000 7fe67fa49780 1 > prepared operation key=P05UIP1IU4Z7 tag=ZNM86CN33WQG type=del size=929392 2023-12-03T11:28:33.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.126+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=PNEPACPPG2NI type=del 2023-12-03T11:28:33.128 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.127+0000 7fe67fa49780 1 > prepared operation key=0G8KNJBJ9K1Z tag=1YXU8ICHABEY type=del size=517753 2023-12-03T11:28:33.130 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.129+0000 7fe67fa49780 1 < completed delete operation key=UL24DVOA31Y7 tag=WJSJE81JV5K7 type=del 2023-12-03T11:28:33.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.131+0000 7fe67fa49780 1 > prepared part key=_multipart_IIW1Y6QYEODQ.2~Z6TVV6T4JYRQ.0 size=159287 2023-12-03T11:28:33.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.131+0000 7fe67fa49780 1 > prepared multipart upload key=IIW1Y6QYEODQ upload=Z6TVV6T4JYRQ tag=K60JHKJVYAPI type=write size=1207863 2023-12-03T11:28:33.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.132+0000 7fe67fa49780 1 < completed delete operation key=006X4CSXV0KA tag=0YB2HKOZRG2Q type=del 2023-12-03T11:28:33.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.133+0000 7fe67fa49780 1 > prepared operation key=N87KA638VE01 tag=KNE2MYS4VMIA type=write size=903101 2023-12-03T11:28:33.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.134+0000 7fe67fa49780 1 < completed write operation key=SXVBDBJ5B09V tag=PE4XFKHHGOXQ type=write size=262253 2023-12-03T11:28:33.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.135+0000 7fe67fa49780 1 > prepared operation key=UL24DVOA31Y7 tag=L440C8T1J7BK type=write size=727200 2023-12-03T11:28:33.140 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.139+0000 7fe67fa49780 1 < suggested remove operation key=N87KA638VE01 tag=1WCZQ1VS8924 type=write 2023-12-03T11:28:33.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.140+0000 7fe67fa49780 1 > prepared operation key=Y0VRZR6S8FP6 tag=Y08M6FKMH79C type=del size=2510766 2023-12-03T11:28:33.144 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.143+0000 7fe67fa49780 1 < suggested remove operation key=0GQZY07Y2PVI tag=SEIRLP15JPWU type=del 2023-12-03T11:28:33.146 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.145+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~B4A08394XQ7J.0 size=1048576 2023-12-03T11:28:33.147 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.146+0000 7fe67fa49780 1 > prepared part key=_multipart_Z1NFEIZNYYO2.2~B4A08394XQ7J.1 size=773564 2023-12-03T11:28:33.147 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.146+0000 7fe67fa49780 1 > prepared multipart upload key=Z1NFEIZNYYO2 upload=B4A08394XQ7J tag=151J6F3Q4V26 type=write size=2870716 2023-12-03T11:28:33.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.147+0000 7fe67fa49780 1 < completed delete operation key=A7GOX2W0WB83 tag=K6Q8UD09M4C1 type=del 2023-12-03T11:28:33.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.148+0000 7fe67fa49780 1 > prepared operation key=Q6GBIBMIJRKV tag=FDIQDJWH3U5H type=del size=3560475 2023-12-03T11:28:33.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.149+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=YPHSY35UOI0C type=del 2023-12-03T11:28:33.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.150+0000 7fe67fa49780 1 > prepared operation key=OH2XUEEYL9JO tag=GE1C8I49ILCH type=del size=1581878 2023-12-03T11:28:33.153 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.152+0000 7fe67fa49780 1 < completed part key=_multipart_9AUO0SRFTAUJ.2~DF2S3HREAAGG.0 size=380408 2023-12-03T11:28:33.155 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.154+0000 7fe67fa49780 1 < completed multipart upload key=9AUO0SRFTAUJ upload=DF2S3HREAAGG tag=JG29EOMFVLCP type=write size=1428984 2023-12-03T11:28:33.156 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.156+0000 7fe67fa49780 1 > prepared operation key=983BDZLASC3S tag=LXXSL5AFX24P type=del size=2168277 2023-12-03T11:28:33.158 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.157+0000 7fe67fa49780 1 < completed part key=_multipart_SXVBDBJ5B09V.2~KF0TZQDF1PX8.0 size=63647 2023-12-03T11:28:33.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.159+0000 7fe67fa49780 1 < completed multipart upload key=SXVBDBJ5B09V upload=KF0TZQDF1PX8 tag=RFLSUQU0RUR2 type=write size=1112223 2023-12-03T11:28:33.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.161+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~MMCZJE72WKUG.0 size=1048576 2023-12-03T11:28:33.163 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.162+0000 7fe67fa49780 1 > prepared part key=_multipart_8UZJU9PNWIB6.2~MMCZJE72WKUG.1 size=770070 2023-12-03T11:28:33.163 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.162+0000 7fe67fa49780 1 > prepared multipart upload key=8UZJU9PNWIB6 upload=MMCZJE72WKUG tag=DCL9XDQK531L type=write size=2867222 2023-12-03T11:28:33.164 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.163+0000 7fe67fa49780 1 < completed write operation key=ASODFGLQ5VNY tag=ZFRCB1OVDLPB type=write size=744469 2023-12-03T11:28:33.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.165+0000 7fe67fa49780 1 > prepared part key=_multipart_UL24DVOA31Y7.2~XGTT92L7LF1B.0 size=1029109 2023-12-03T11:28:33.166 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.165+0000 7fe67fa49780 1 > prepared multipart upload key=UL24DVOA31Y7 upload=XGTT92L7LF1B tag=08CEF9E4D00T type=write size=2077685 2023-12-03T11:28:33.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.168+0000 7fe67fa49780 1 < suggested remove operation key=Y0VRZR6S8FP6 tag=Y79WJIN0X488 type=del 2023-12-03T11:28:33.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.170+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~1115FZQN5SYH.0 size=1048576 2023-12-03T11:28:33.172 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.171+0000 7fe67fa49780 1 > prepared part key=_multipart_6LQ18VAE3ZN6.2~1115FZQN5SYH.1 size=110403 2023-12-03T11:28:33.172 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.171+0000 7fe67fa49780 1 > prepared multipart upload key=6LQ18VAE3ZN6 upload=1115FZQN5SYH tag=E7XTP96QTZRY type=write size=2207555 2023-12-03T11:28:33.173 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.172+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~C1GGSNEMZ0PF.0 size=1048576 2023-12-03T11:28:33.174 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.173+0000 7fe67fa49780 1 < completed part key=_multipart_0G8KNJBJ9K1Z.2~C1GGSNEMZ0PF.1 size=533661 2023-12-03T11:28:33.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.175+0000 7fe67fa49780 1 < completed multipart upload key=0G8KNJBJ9K1Z upload=C1GGSNEMZ0PF tag=H9JH96AS8ER4 type=write size=2630813 2023-12-03T11:28:33.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.178+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=Z3ATC81SB0DX type=del size=2948927 2023-12-03T11:28:33.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.180+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~7NSVDVN2587W.0 size=1048576 2023-12-03T11:28:33.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.181+0000 7fe67fa49780 1 < completed part key=_multipart_H8MBLWXG7BCZ.2~7NSVDVN2587W.1 size=364971 2023-12-03T11:28:33.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.184+0000 7fe67fa49780 1 < completed multipart upload key=H8MBLWXG7BCZ upload=7NSVDVN2587W tag=D1YA4M1GQVTL type=write size=2462123 2023-12-03T11:28:33.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.185+0000 7fe67fa49780 1 > prepared operation key=KMC5YD2M3I45 tag=DMCTNDA7LEOW type=del size=2054070 2023-12-03T11:28:33.187 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.186+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~C2J5QWTAUKG2.0 size=1048576 2023-12-03T11:28:33.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.187+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~C2J5QWTAUKG2.1 size=1048576 2023-12-03T11:28:33.189 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.188+0000 7fe67fa49780 1 < completed part key=_multipart_Y0VRZR6S8FP6.2~C2J5QWTAUKG2.2 size=766977 2023-12-03T11:28:33.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.190+0000 7fe67fa49780 1 < completed multipart upload key=Y0VRZR6S8FP6 upload=C2J5QWTAUKG2 tag=QT0U0TQ1U2B7 type=write size=3912705 2023-12-03T11:28:33.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.192+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~DNSGVDW4XBHK.0 size=1048576 2023-12-03T11:28:33.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.193+0000 7fe67fa49780 1 > prepared part key=_multipart_CC1X1OP7L6BJ.2~DNSGVDW4XBHK.1 size=417154 2023-12-03T11:28:33.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.193+0000 7fe67fa49780 1 > prepared multipart upload key=CC1X1OP7L6BJ upload=DNSGVDW4XBHK tag=XILOVRDSDO4N type=write size=2514306 2023-12-03T11:28:33.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.194+0000 7fe67fa49780 1 < completed delete operation key=P05UIP1IU4Z7 tag=ZNM86CN33WQG type=del 2023-12-03T11:28:33.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.197+0000 7fe67fa49780 1 > prepared part key=_multipart_A7GOX2W0WB83.2~RTFDZS5OH5E2.0 size=391088 2023-12-03T11:28:33.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.197+0000 7fe67fa49780 1 > prepared multipart upload key=A7GOX2W0WB83 upload=RTFDZS5OH5E2 tag=7YUA5KBV2IXB type=write size=1439664 2023-12-03T11:28:33.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.198+0000 7fe67fa49780 1 < completed delete operation key=0G8KNJBJ9K1Z tag=1YXU8ICHABEY type=del 2023-12-03T11:28:33.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.199+0000 7fe67fa49780 1 > prepared operation key=URVD2U16EW75 tag=OWXPHO92KEV9 type=write size=143615 2023-12-03T11:28:33.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.200+0000 7fe67fa49780 1 < completed part key=_multipart_IIW1Y6QYEODQ.2~Z6TVV6T4JYRQ.0 size=159287 2023-12-03T11:28:33.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.203+0000 7fe67fa49780 1 < completed multipart upload key=IIW1Y6QYEODQ upload=Z6TVV6T4JYRQ tag=K60JHKJVYAPI type=write size=1207863 2023-12-03T11:28:33.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.204+0000 7fe67fa49780 1 > prepared operation key=DDHGOWEI7WEI tag=7UTJA38EVPS9 type=del size=3249734 2023-12-03T11:28:33.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.205+0000 7fe67fa49780 -1 < failed to complete operation key=N87KA638VE01 tag=KNE2MYS4VMIA type=write size=903101: (22) Invalid argument 2023-12-03T11:28:33.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.207+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~M1ZJY6AKIO6Q.0 size=1048576 2023-12-03T11:28:33.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.208+0000 7fe67fa49780 1 > prepared part key=_multipart_YEMPVKMDANPG.2~M1ZJY6AKIO6Q.1 size=369546 2023-12-03T11:28:33.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.208+0000 7fe67fa49780 1 > prepared multipart upload key=YEMPVKMDANPG upload=M1ZJY6AKIO6Q tag=D8916308YASV type=write size=2466698 2023-12-03T11:28:33.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.209+0000 7fe67fa49780 1 < canceled operation key=UL24DVOA31Y7 tag=L440C8T1J7BK type=write size=727200 2023-12-03T11:28:33.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.210+0000 7fe67fa49780 1 > prepared operation key=2GX6IWVZH25N tag=BV0YYP73TR08 type=del size=3613791 2023-12-03T11:28:33.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.211+0000 7fe67fa49780 -1 < failed to complete operation key=Y0VRZR6S8FP6 tag=Y08M6FKMH79C type=del size=2510766: (22) Invalid argument 2023-12-03T11:28:33.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.212+0000 7fe67fa49780 1 > prepared operation key=CIB1NZHJGO46 tag=IOBJ1FLARGG1 type=write size=36617 2023-12-03T11:28:33.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.214+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~B4A08394XQ7J.0 size=1048576 2023-12-03T11:28:33.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.215+0000 7fe67fa49780 1 < completed part key=_multipart_Z1NFEIZNYYO2.2~B4A08394XQ7J.1 size=773564 2023-12-03T11:28:33.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.217+0000 7fe67fa49780 1 < completed multipart upload key=Z1NFEIZNYYO2 upload=B4A08394XQ7J tag=151J6F3Q4V26 type=write size=2870716 2023-12-03T11:28:33.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.219+0000 7fe67fa49780 1 > prepared part key=_multipart_006X4CSXV0KA.2~CY0TIEL34SXF.0 size=278089 2023-12-03T11:28:33.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:28:33.219+0000 7fe67fa49780 1 > prepared multipart upload key=006X4CSXV0KA upload=CY0TIEL34SXF tag=VUOCMJU9H5S6 type=write size=1326665 2023-12-03T11:28:33.220 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] cls_rgw_stats.simulate (8863 ms) 2023-12-03T11:28:33.220 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 1 test from cls_rgw_stats (8863 ms total) 2023-12-03T11:28:33.220 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:28:33.220 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:28:34.185 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 1 test from 1 test suite ran. (11680 ms total) 2023-12-03T11:28:34.185 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 1 test. 2023-12-03T11:28:34.189 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:28:34.189 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:28:34.259 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2023-12-03T11:28:34.261 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2023-12-03T11:28:34.261 DEBUG:teuthology.orchestra.run.smithi131:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2023-12-03T11:28:34.331 INFO:tasks.workunit.client.0.smithi131.stdout:Running main() from gmock_main.cc 2023-12-03T11:28:34.331 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 31 tests from 1 test suite. 2023-12-03T11:28:34.331 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:28:36.187 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 31 tests from CmpOmap 2023-12-03T11:28:36.187 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2023-12-03T11:28:36.204 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (18 ms) 2023-12-03T11:28:36.204 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2023-12-03T11:28:36.209 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (5 ms) 2023-12-03T11:28:36.209 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2023-12-03T11:28:36.212 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2023-12-03T11:28:36.212 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2023-12-03T11:28:36.215 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2023-12-03T11:28:36.215 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_str 2023-12-03T11:28:36.222 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2023-12-03T11:28:36.222 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2023-12-03T11:28:36.227 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_u64 (5 ms) 2023-12-03T11:28:36.228 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2023-12-03T11:28:36.231 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2023-12-03T11:28:36.231 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2023-12-03T11:28:36.234 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2023-12-03T11:28:36.234 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2023-12-03T11:28:36.238 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2023-12-03T11:28:36.238 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2023-12-03T11:28:36.242 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2023-12-03T11:28:36.243 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2023-12-03T11:28:36.243 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2023-12-03T11:28:36.243 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2023-12-03T11:28:36.244 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2023-12-03T11:28:36.244 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2023-12-03T11:28:36.250 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (6 ms) 2023-12-03T11:28:36.250 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2023-12-03T11:28:36.257 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2023-12-03T11:28:36.257 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2023-12-03T11:28:36.265 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (8 ms) 2023-12-03T11:28:36.265 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2023-12-03T11:28:36.271 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2023-12-03T11:28:36.271 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2023-12-03T11:28:36.278 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_set_vals_str (7 ms) 2023-12-03T11:28:36.278 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2023-12-03T11:28:36.287 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (9 ms) 2023-12-03T11:28:36.288 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2023-12-03T11:28:36.290 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2023-12-03T11:28:36.290 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2023-12-03T11:28:36.293 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2023-12-03T11:28:36.293 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2023-12-03T11:28:36.294 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2023-12-03T11:28:36.294 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2023-12-03T11:28:36.294 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2023-12-03T11:28:36.295 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2023-12-03T11:28:36.300 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (6 ms) 2023-12-03T11:28:36.300 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2023-12-03T11:28:36.306 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2023-12-03T11:28:36.306 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2023-12-03T11:28:36.313 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2023-12-03T11:28:36.313 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2023-12-03T11:28:36.322 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (9 ms) 2023-12-03T11:28:36.322 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2023-12-03T11:28:36.324 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2023-12-03T11:28:36.325 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2023-12-03T11:28:36.327 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2023-12-03T11:28:36.327 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2023-12-03T11:28:36.328 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2023-12-03T11:28:36.328 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2023-12-03T11:28:36.329 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2023-12-03T11:28:36.329 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2023-12-03T11:28:36.336 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2023-12-03T11:28:36.336 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 31 tests from CmpOmap (150 ms total) 2023-12-03T11:28:36.336 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:28:36.337 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:28:37.200 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 31 tests from 1 test suite ran. (2869 ms total) 2023-12-03T11:28:37.200 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 31 tests. 2023-12-03T11:28:37.203 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:28:37.203 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:28:37.276 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2023-12-03T11:28:37.277 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2023-12-03T11:28:37.277 DEBUG:teuthology.orchestra.run.smithi131:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2023-12-03T11:28:37.349 INFO:tasks.workunit.client.0.smithi131.stdout:Running main() from gmock_main.cc 2023-12-03T11:28:37.349 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:28:37.349 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:28:37.349 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 24 tests from TestCls2PCQueue 2023-12-03T11:28:37.349 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2023-12-03T11:28:40.218 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2869 ms) 2023-12-03T11:28:40.218 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2023-12-03T11:28:43.242 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3024 ms) 2023-12-03T11:28:43.242 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.Reserve 2023-12-03T11:28:46.265 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.Reserve (3022 ms) 2023-12-03T11:28:46.265 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2023-12-03T11:28:49.291 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3027 ms) 2023-12-03T11:28:49.291 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.Commit 2023-12-03T11:28:52.302 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.Commit (3011 ms) 2023-12-03T11:28:52.302 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.Stats 2023-12-03T11:28:55.327 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.Stats (3025 ms) 2023-12-03T11:28:55.328 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2023-12-03T11:28:59.353 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4026 ms) 2023-12-03T11:28:59.354 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.Abort 2023-12-03T11:29:02.374 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.Abort (3021 ms) 2023-12-03T11:29:02.375 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2023-12-03T11:29:05.393 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.ReserveError (3018 ms) 2023-12-03T11:29:05.393 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.CommitError 2023-12-03T11:29:08.410 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.CommitError (3018 ms) 2023-12-03T11:29:08.411 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.AbortError 2023-12-03T11:29:11.429 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.AbortError (3019 ms) 2023-12-03T11:29:11.429 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2023-12-03T11:29:14.447 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3017 ms) 2023-12-03T11:29:14.447 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2023-12-03T11:29:17.463 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3017 ms) 2023-12-03T11:29:17.463 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2023-12-03T11:29:20.471 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3007 ms) 2023-12-03T11:29:20.471 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2023-12-03T11:29:23.512 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3041 ms) 2023-12-03T11:29:23.512 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2023-12-03T11:29:26.540 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3029 ms) 2023-12-03T11:29:26.541 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2023-12-03T11:29:29.553 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3013 ms) 2023-12-03T11:29:29.553 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2023-12-03T11:29:32.558 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.Cleanup (3005 ms) 2023-12-03T11:29:32.558 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2023-12-03T11:29:43.205 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10647 ms) 2023-12-03T11:29:43.206 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2023-12-03T11:29:47.231 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (4026 ms) 2023-12-03T11:29:47.231 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2023-12-03T11:29:59.273 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (12042 ms) 2023-12-03T11:29:59.273 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2023-12-03T11:30:03.299 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4026 ms) 2023-12-03T11:30:03.299 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2023-12-03T11:30:09.337 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6034 ms) 2023-12-03T11:30:09.337 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2023-12-03T11:30:14.365 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5032 ms) 2023-12-03T11:30:14.365 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 24 tests from TestCls2PCQueue (97016 ms total) 2023-12-03T11:30:14.366 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:14.366 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:14.366 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 24 tests from 1 test suite ran. (97016 ms total) 2023-12-03T11:30:14.366 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 24 tests. 2023-12-03T11:30:14.371 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:30:14.371 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:30:14.440 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2023-12-03T11:30:14.441 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2023-12-03T11:30:14.442 DEBUG:teuthology.orchestra.run.smithi131:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2023-12-03T11:30:14.519 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:14.519 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:14.519 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 6 tests from 1 test suite. 2023-12-03T11:30:14.519 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:16.373 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 6 tests from rgw_gc_log 2023-12-03T11:30:16.373 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2023-12-03T11:30:16.424 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] rgw_gc_log.init_existing_queue (52 ms) 2023-12-03T11:30:16.424 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2023-12-03T11:30:16.427 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2023-12-03T11:30:16.427 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2023-12-03T11:30:16.430 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2023-12-03T11:30:16.430 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2023-12-03T11:30:16.431 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2023-12-03T11:30:16.432 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2023-12-03T11:30:16.434 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2023-12-03T11:30:16.434 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2023-12-03T11:30:16.436 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] rgw_gc_log.defer2_before_init (1 ms) 2023-12-03T11:30:16.436 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 6 tests from rgw_gc_log (63 ms total) 2023-12-03T11:30:16.436 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:16.436 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:17.394 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 6 tests from 1 test suite ran. (2874 ms total) 2023-12-03T11:30:17.394 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 6 tests. 2023-12-03T11:30:17.397 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:30:17.398 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:30:17.471 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2023-12-03T11:30:17.472 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2023-12-03T11:30:17.472 DEBUG:teuthology.orchestra.run.smithi131:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2023-12-03T11:30:17.555 INFO:tasks.workunit.client.0.smithi131.stdout:Running main() from gmock_main.cc 2023-12-03T11:30:17.555 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 4 tests from 1 test suite. 2023-12-03T11:30:17.555 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:17.555 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 4 tests from TestRGWObj 2023-12-03T11:30:17.555 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestRGWObj.underscore 2023-12-03T11:30:17.555 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.555 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.555 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns= i= 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns= i= 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns= i= 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout: "obj1": { 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.556 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: "obj2": { 2023-12-03T11:30:17.557 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.558 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3": { 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.559 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3-2": { 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.560 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns=ns i= 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns=ns i= 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.561 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns=ns i= 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: "obj1": { 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.562 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: "obj2": { 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.563 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3": { 2023-12-03T11:30:17.564 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.565 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3-2": { 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.566 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns= i=v1 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns= i=v1 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.567 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns= i=v1 2023-12-03T11:30:17.568 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.568 INFO:tasks.workunit.client.0.smithi131.stdout: "obj1": { 2023-12-03T11:30:17.568 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.568 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.568 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.568 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.568 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.568 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.568 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.568 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.568 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: "obj2": { 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.569 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.570 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3": { 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.571 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3-2": { 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.572 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.573 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.573 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.573 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.573 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.573 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.573 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.573 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.573 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.573 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns=ns i=v1 2023-12-03T11:30:17.574 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.574 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.574 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns=ns i=v1 2023-12-03T11:30:17.574 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.574 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: _obj[v1] 2023-12-03T11:30:17.574 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: _obj ns=ns i=v1 2023-12-03T11:30:17.574 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.575 INFO:tasks.workunit.client.0.smithi131.stdout: "obj1": { 2023-12-03T11:30:17.575 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.575 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.575 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.575 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.575 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.575 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.576 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.576 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.576 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.576 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.576 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.576 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.576 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.577 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.577 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.577 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.577 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.577 INFO:tasks.workunit.client.0.smithi131.stdout: "obj2": { 2023-12-03T11:30:17.577 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.577 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.578 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.578 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.578 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.578 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.578 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.578 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.578 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.579 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.579 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.579 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.579 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.579 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.579 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.580 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.580 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.580 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3": { 2023-12-03T11:30:17.580 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.580 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.580 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.580 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.581 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.581 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.581 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.581 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.581 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.581 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.581 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.582 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.582 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.582 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.582 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.582 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.582 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.582 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3-2": { 2023-12-03T11:30:17.583 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.583 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.583 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.583 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.583 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.583 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.584 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.584 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.584 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.584 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.584 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.584 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.584 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_obj", 2023-12-03T11:30:17.585 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.585 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.585 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.585 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.585 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.585 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2023-12-03T11:30:17.585 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestRGWObj.no_underscore 2023-12-03T11:30:17.586 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.586 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.586 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns= i= 2023-12-03T11:30:17.586 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.586 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.586 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns= i= 2023-12-03T11:30:17.586 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.587 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.587 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns= i= 2023-12-03T11:30:17.587 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.587 INFO:tasks.workunit.client.0.smithi131.stdout: "obj1": { 2023-12-03T11:30:17.587 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.587 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.587 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.588 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.588 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.588 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.588 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.588 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.588 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.589 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.589 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.589 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.589 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.589 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.589 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.590 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.590 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.590 INFO:tasks.workunit.client.0.smithi131.stdout: "obj2": { 2023-12-03T11:30:17.590 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.590 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.590 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.590 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.591 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.591 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.591 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.591 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.591 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.591 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.591 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.592 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.592 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.592 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.592 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.592 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.592 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.592 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3": { 2023-12-03T11:30:17.593 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.593 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.593 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.593 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.593 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.593 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.593 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.594 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.594 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.594 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.594 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.594 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.594 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.595 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.595 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.595 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.595 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.595 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3-2": { 2023-12-03T11:30:17.595 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.596 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.596 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.596 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.596 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.596 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.596 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.597 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.597 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.597 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.597 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.597 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.597 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.598 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.598 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.598 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.598 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.598 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.599 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.599 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.599 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns=ns i= 2023-12-03T11:30:17.599 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.599 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.599 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns=ns i= 2023-12-03T11:30:17.599 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.600 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj 2023-12-03T11:30:17.600 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns=ns i= 2023-12-03T11:30:17.600 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.600 INFO:tasks.workunit.client.0.smithi131.stdout: "obj1": { 2023-12-03T11:30:17.600 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.600 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.600 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.600 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.600 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: "obj2": { 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.602 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3": { 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.603 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3-2": { 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.604 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns= i=v1 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns= i=v1 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.605 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns= i=v1 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "obj1": { 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.606 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "obj2": { 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.607 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3": { 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3-2": { 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.609 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.610 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns=ns i=v1 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns=ns i=v1 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout:parsed: obj[v1] 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout:stripped: obj ns=ns i=v1 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout: "obj1": { 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.611 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "obj2": { 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.612 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3": { 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.613 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "obj3-2": { 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.614 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "obj", 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "v1", 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.615 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestRGWObj.obj_to_raw 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.617 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.618 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.618 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.618 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.618 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.618 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.618 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.618 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.618 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.618 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker_myobj", 2023-12-03T11:30:17.618 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.618 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.619 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.620 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.621 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.622 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker_myobj", 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.623 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.625 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.626 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.627 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.628 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.629 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.630 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.632 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.633 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.634 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.635 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.636 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.637 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.638 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.639 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.641 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.642 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.643 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.644 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.644 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.644 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.644 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.645 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.646 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.647 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.648 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.650 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.651 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker___myobj", 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj" 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.652 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.653 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.654 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.655 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker___myobj", 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj" 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.656 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.657 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.658 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.659 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.660 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.661 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.662 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.663 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.664 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.665 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.666 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:30:17.667 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj" 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.668 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.669 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.670 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj" 2023-12-03T11:30:17.671 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.672 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.673 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.674 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.675 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.676 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.677 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.678 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.679 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.680 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.681 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.682 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker___myobj_", 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj_" 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.683 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.684 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.685 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.686 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker___myobj_", 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj_" 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.687 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.688 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.689 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.690 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.691 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.693 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.694 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.695 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.696 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.697 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj_" 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.699 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.700 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.701 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj_" 2023-12-03T11:30:17.702 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.703 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.705 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": "default-placement.data", 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.706 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "test", 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": "", 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": "" 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.707 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.708 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "obj": { 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.709 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.710 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.711 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] TestRGWObj.old_to_raw 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker_myobj", 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.712 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker_myobj 2023-12-03T11:30:17.713 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker_myobj", 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.714 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker_myobj 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.715 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.716 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker__ns_myobj 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns_myobj", 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.717 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.718 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker__ns_myobj 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.719 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.720 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker__:inst_myobj 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst_myobj", 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.721 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.722 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker__:inst_myobj 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.723 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker__ns:inst_myobj 2023-12-03T11:30:17.724 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst_myobj", 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.725 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "myobj", 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker__ns:inst_myobj 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.726 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker___myobj", 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj" 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.727 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker___myobj 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker___myobj", 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj" 2023-12-03T11:30:17.728 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.729 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker___myobj 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.730 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.731 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker__ns__myobj 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns__myobj", 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.732 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.733 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker__ns__myobj 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj" 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.734 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.735 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker__:inst__myobj 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst__myobj", 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj" 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.736 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker__:inst__myobj 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.737 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker__ns:inst__myobj 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.739 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst__myobj", 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.740 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj", 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker__ns:inst__myobj 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker___myobj_", 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj_" 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.741 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.742 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker___myobj_ 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker___myobj_", 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj_" 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.743 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.744 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker___myobj_ 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.745 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.746 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker__ns__myobj_ 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns__myobj_", 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.747 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "", 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker__ns__myobj_ 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.748 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj_" 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.749 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker__:inst__myobj_ 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__:inst__myobj_", 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "marker__myobj_" 2023-12-03T11:30:17.750 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.751 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "" 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker__:inst__myobj_ 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj": { 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj": { 2023-12-03T11:30:17.752 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout: "raw_obj2": { 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout: "pool": ".data-pool", 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout: "oid": "marker__ns:inst__myobj_", 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout: "loc": "" 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout: "new_obj2": { 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket": { 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "ebtest", 2023-12-03T11:30:17.754 INFO:tasks.workunit.client.0.smithi131.stdout: "marker": "marker", 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_id": "bucket-id", 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: "tenant": "", 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: "explicit_placement": { 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: "data_pool": ".data-pool", 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: "data_extra_pool": "", 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: "index_pool": ".index-pool" 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: "key": { 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: "name": "_myobj_", 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: "instance": "inst", 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: "ns": "ns" 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.755 INFO:tasks.workunit.client.0.smithi131.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2023-12-03T11:30:17.756 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2023-12-03T11:30:17.756 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2023-12-03T11:30:17.756 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:17.756 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:17.756 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2023-12-03T11:30:17.756 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 4 tests. 2023-12-03T11:30:17.756 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:30:17.756 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:30:17.787 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2023-12-03T11:30:17.788 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2023-12-03T11:30:17.788 DEBUG:teuthology.orchestra.run.smithi131:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2023-12-03T11:30:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:17.910 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:17.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.924+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.925+0000 7f14a9212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:30:17.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.925+0000 7f14a9212800 20 realm 2023-12-03T11:30:17.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.925+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.925+0000 7f14a9212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:30:17.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.925+0000 7f14a9212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:30:17.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.925+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.926+0000 7f14a9212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:30:17.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.926+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.926+0000 7f14a9212800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:30:17.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.926+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.927+0000 7f14a9212800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:30:17.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.927+0000 7f14a9212800 20 searching for the correct realm 2023-12-03T11:30:17.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.938+0000 7f14a492a640 0 -- 172.21.15.131:0/880718079 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55988c633470 msgr2=0x55988c635860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:30:17.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.939+0000 7f14a9212800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:30:17.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.939+0000 7f14a9212800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:30:17.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.939+0000 7f14a9212800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:30:17.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.939+0000 7f14a9212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:30:17.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.939+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.939+0000 7f14a9212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:30:17.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.939+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 20 zone default found 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 4 Realm: () 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 20 zonegroup default 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:30:17.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.940+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.941+0000 7f14a9212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:30:17.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.941+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.941+0000 7f14a9212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:30:17.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.941+0000 7f14a9212800 20 started sync module instance, tier type = 2023-12-03T11:30:17.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.941+0000 7f14a9212800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:30:17.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.948+0000 7f149ffff640 0 -- 172.21.15.131:0/880718079 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55988c638400 msgr2=0x55988c63a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:30:17.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.951+0000 7f14a9212800 20 add_watcher() i=0 2023-12-03T11:30:17.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.951+0000 7f14a9212800 20 add_watcher() i=1 2023-12-03T11:30:17.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.951+0000 7f14a9212800 20 add_watcher() i=2 2023-12-03T11:30:17.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.951+0000 7f14a9212800 20 add_watcher() i=3 2023-12-03T11:30:17.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.951+0000 7f14a9212800 20 add_watcher() i=4 2023-12-03T11:30:17.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.951+0000 7f14a9212800 20 add_watcher() i=5 2023-12-03T11:30:17.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.951+0000 7f14a9212800 20 add_watcher() i=6 2023-12-03T11:30:17.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.952+0000 7f14a9212800 20 add_watcher() i=7 2023-12-03T11:30:17.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.952+0000 7f14a9212800 2 all 8 watchers are set, enabling cache 2023-12-03T11:30:17.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.954+0000 7f146a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:30:17.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.954+0000 7f14a9212800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:30:17.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.954+0000 7f14a9212800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.960+0000 7f14a9212800 5 note: GC not initialized 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.960+0000 7f13d97fa640 20 reqs_thread_entry: start 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.960+0000 7f14a9212800 20 init_complete bucket index max shards: 1 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.960+0000 7f14a9212800 20 Filter name: none 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.960+0000 7f13d2ffd640 20 reqs_thread_entry: start 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.960+0000 7f14a9212800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.960+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:30:17.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2023-12-03T11:30:17.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-12-03T11:30:17.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 10 cache get: name=default.rgw.meta+users.keys+uZGk9smwzF8q3ZzJkuGGlJv0K78= : miss 2023-12-03T11:30:17.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 20 rados->read ofs=0 len=0 2023-12-03T11:30:17.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:30:17.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 10 cache put: name=default.rgw.meta+users.keys+uZGk9smwzF8q3ZzJkuGGlJv0K78= info.flags=0x0 2023-12-03T11:30:17.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 10 adding default.rgw.meta+users.keys+uZGk9smwzF8q3ZzJkuGGlJv0K78= to cache LRU end 2023-12-03T11:30:17.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 10 cache get: name=default.rgw.meta+users.keys+uZGk9smwzF8q3ZzJkuGGlJv0K78= : hit (negative entry) 2023-12-03T11:30:17.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.961+0000 7f14a9212800 10 cache get: name=default.rgw.meta+users.keys+uZGk9smwzF8q3ZzJkuGGlJv0K78= : hit (negative entry) 2023-12-03T11:30:17.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.963+0000 7f14a9212800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2023-12-03T11:30:17.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.963+0000 7f14a9212800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-12-03T11:30:17.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.963+0000 7f14a9212800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2023-12-03T11:30:17.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.963+0000 7f1486ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1039382085633 cookie 94113678736368 notifier 5619 bl.length()=663 2023-12-03T11:30:17.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.963+0000 7f1486ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2023-12-03T11:30:17.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.963+0000 7f1486ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2023-12-03T11:30:17.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.965+0000 7f14a9212800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2023-12-03T11:30:17.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.965+0000 7f14a9212800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-12-03T11:30:17.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.965+0000 7f14a9212800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2023-12-03T11:30:17.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.965+0000 7f1486ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1039382085632 cookie 94113678710000 notifier 5619 bl.length()=194 2023-12-03T11:30:17.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.965+0000 7f1486ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2023-12-03T11:30:17.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.965+0000 7f1486ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2023-12-03T11:30:17.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.967+0000 7f14a9212800 10 cache put: name=default.rgw.meta+users.keys+uZGk9smwzF8q3ZzJkuGGlJv0K78= info.flags=0x7 2023-12-03T11:30:17.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.967+0000 7f14a9212800 10 moving default.rgw.meta+users.keys+uZGk9smwzF8q3ZzJkuGGlJv0K78= to cache LRU end 2023-12-03T11:30:17.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.967+0000 7f14a9212800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:uZGk9smwzF8q3ZzJkuGGlJv0K78=, ofs0, ns] 2023-12-03T11:30:17.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.967+0000 7f14867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1039382085634 cookie 94113678736368 notifier 5619 bl.length()=203 2023-12-03T11:30:17.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.967+0000 7f14867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+uZGk9smwzF8q3ZzJkuGGlJv0K78= info.flags=0x7 2023-12-03T11:30:17.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.967+0000 7f14867fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+uZGk9smwzF8q3ZzJkuGGlJv0K78= to cache LRU end 2023-12-03T11:30:17.969 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:30:17.969 INFO:tasks.workunit.client.0.smithi131.stdout: "user_id": "ceph-test-librgw-file", 2023-12-03T11:30:17.969 INFO:tasks.workunit.client.0.smithi131.stdout: "display_name": "librgw test user", 2023-12-03T11:30:17.969 INFO:tasks.workunit.client.0.smithi131.stdout: "email": "librgw@example.com", 2023-12-03T11:30:17.969 INFO:tasks.workunit.client.0.smithi131.stdout: "suspended": 0, 2023-12-03T11:30:17.969 INFO:tasks.workunit.client.0.smithi131.stdout: "max_buckets": 1000, 2023-12-03T11:30:17.969 INFO:tasks.workunit.client.0.smithi131.stdout: "subusers": [], 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "keys": [ 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: { 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "user": "ceph-test-librgw-file", 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "access_key": "uZGk9smwzF8q3ZzJkuGGlJv0K78=", 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "secret_key": "HoY3eRfQVU5hXuEYEWKzu+js/EgtP0wKUZpoW3dw9SFVW8ixZn5eDA==" 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: ], 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "swift_keys": [], 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "caps": [], 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "op_mask": "read, write, delete", 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "default_placement": "", 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "default_storage_class": "", 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "placement_tags": [], 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_quota": { 2023-12-03T11:30:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: "enabled": false, 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "max_size": -1, 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "max_objects": -1 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "user_quota": { 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "enabled": false, 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "max_size": -1, 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "max_objects": -1 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "temp_url_keys": [], 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "type": "rgw", 2023-12-03T11:30:17.971 INFO:tasks.workunit.client.0.smithi131.stdout: "mfa_ids": [] 2023-12-03T11:30:17.972 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:30:17.972 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:17.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.968+0000 7f146a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:30:17.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.970+0000 7f14a9212800 20 remove_watcher() i=0 2023-12-03T11:30:17.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.970+0000 7f14a9212800 2 removed watcher, disabling cache 2023-12-03T11:30:17.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.971+0000 7f14a9212800 20 remove_watcher() i=1 2023-12-03T11:30:17.973 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.972+0000 7f14a9212800 20 remove_watcher() i=2 2023-12-03T11:30:17.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.973+0000 7f14a9212800 20 remove_watcher() i=3 2023-12-03T11:30:17.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.974+0000 7f14a9212800 20 remove_watcher() i=4 2023-12-03T11:30:17.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.975+0000 7f14a9212800 20 remove_watcher() i=5 2023-12-03T11:30:17.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.976+0000 7f14a9212800 20 remove_watcher() i=6 2023-12-03T11:30:17.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:17.977+0000 7f14a9212800 20 remove_watcher() i=7 2023-12-03T11:30:17.983 INFO:tasks.workunit.client.0.smithi131.stdout:phase 1.1 2023-12-03T11:30:18.002 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:30:18.002 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:18.002 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 24 tests from LibRGW 2023-12-03T11:30:18.002 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:30:18.012 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:18.013 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:18.179 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.INIT (176 ms) 2023-12-03T11:30:18.179 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-12-03T11:30:18.180 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2023-12-03T11:30:18.180 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:30:18.180 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:30:18.180 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-12-03T11:30:18.187 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/bar/baz/quux 2023-12-03T11:30:18.191 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/f1 2023-12-03T11:30:18.197 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/f2 2023-12-03T11:30:18.200 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/bar/f1 2023-12-03T11:30:18.204 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/bar/d1/ 2023-12-03T11:30:18.207 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/bar/baz/hungry 2023-12-03T11:30:18.210 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2023-12-03T11:30:18.213 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/bar/baz/momma 2023-12-03T11:30:18.216 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/bar/baz/bear/ 2023-12-03T11:30:18.219 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2023-12-03T11:30:18.222 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2023-12-03T11:30:18.224 INFO:tasks.workunit.client.0.smithi131.stdout:creating: nfsroot:foo/bar/baz/frobozz 2023-12-03T11:30:18.227 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SETUP_HIER1 (47 ms) 2023-12-03T11:30:18.227 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-12-03T11:30:18.308 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SETUP_DIRS1 (80 ms) 2023-12-03T11:30:18.308 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SETATTR 2023-12-03T11:30:18.308 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-12-03T11:30:18.308 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-12-03T11:30:18.322 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (15 ms) 2023-12-03T11:30:18.322 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-12-03T11:30:18.355 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (33 ms) 2023-12-03T11:30:18.355 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-12-03T11:30:18.355 INFO:tasks.workunit.client.0.smithi131.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2023-12-03T11:30:18.362 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2023-12-03T11:30:18.362 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-12-03T11:30:18.362 INFO:tasks.workunit.client.0.smithi131.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2023-12-03T11:30:18.368 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2023-12-03T11:30:18.368 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-12-03T11:30:18.368 INFO:tasks.workunit.client.0.smithi131.stdout:scanning objects in /bdirs1/dir_0 2023-12-03T11:30:18.368 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:18.368 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout:scanning objects in /bdirs1/dir_1 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout:scanning objects in /bdirs1/dir_2 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout:read back objects in /bdirs1/dir_0 2023-12-03T11:30:18.369 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_0/sfile_0 2023-12-03T11:30:18.370 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:30:18.370 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_0/sfile_1 2023-12-03T11:30:18.370 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:30:18.370 INFO:tasks.workunit.client.0.smithi131.stdout:read back objects in /bdirs1/dir_1 2023-12-03T11:30:18.370 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_1/sfile_0 2023-12-03T11:30:18.373 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:30:18.374 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_1/sfile_1 2023-12-03T11:30:18.374 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:30:18.374 INFO:tasks.workunit.client.0.smithi131.stdout:read back objects in /bdirs1/dir_2 2023-12-03T11:30:18.374 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_2/sfile_0 2023-12-03T11:30:18.374 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:30:18.374 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_2/sfile_1 2023-12-03T11:30:18.374 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:30:18.374 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2023-12-03T11:30:18.374 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-12-03T11:30:18.548 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READF_SETUP1 (173 ms) 2023-12-03T11:30:18.548 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-12-03T11:30:18.548 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-12-03T11:30:18.548 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-12-03T11:30:18.548 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-12-03T11:30:18.548 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-12-03T11:30:18.548 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:30:18.548 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:30:18.549 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:30:18.549 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:30:18.549 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:30:18.549 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:30:18.549 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:30:18.549 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:30:18.549 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:30:18.549 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:30:18.549 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:30:18.549 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:30:18.550 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-12-03T11:30:18.550 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.HIER1 2023-12-03T11:30:18.554 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/f2 (f2): FILE 2023-12-03T11:30:18.554 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/f1 (f1): FILE 2023-12-03T11:30:18.556 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2023-12-03T11:30:18.557 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2023-12-03T11:30:18.559 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:30:18.560 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:30:18.560 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2023-12-03T11:30:18.561 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2023-12-03T11:30:18.561 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:30:18.561 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:30:18.562 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2023-12-03T11:30:18.564 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2023-12-03T11:30:18.564 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz (baz): DIR 2023-12-03T11:30:18.564 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar (bar): DIR 2023-12-03T11:30:18.564 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo (foo): DIR 2023-12-03T11:30:18.564 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot (nfsroot): DIR 2023-12-03T11:30:18.564 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.HIER1 (16 ms) 2023-12-03T11:30:18.564 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:30:18.564 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2023-12-03T11:30:18.564 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:30:18.565 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:30:18.565 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:30:18.565 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:30:18.565 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:30:18.565 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:30:18.565 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:30:18.565 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:30:18.565 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:30:18.565 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:30:18.565 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:30:18.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:18.562+0000 7f315e5248c0 -1 shutting down 2023-12-03T11:30:18.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:18.564+0000 7f3137607640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97385, si_uid : 1000, si_addr0x3e800017c69, si_status0 2023-12-03T11:30:18.633 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SHUTDOWN (69 ms) 2023-12-03T11:30:18.633 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 24 tests from LibRGW (630 ms total) 2023-12-03T11:30:18.633 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:18.633 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:18.633 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 24 tests from 1 test suite ran. (630 ms total) 2023-12-03T11:30:18.633 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 24 tests. 2023-12-03T11:30:18.638 INFO:tasks.workunit.client.0.smithi131.stdout:phase 1.2 2023-12-03T11:30:18.658 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:30:18.658 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:18.658 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 24 tests from LibRGW 2023-12-03T11:30:18.658 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:30:18.665 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:18.665 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:19.019 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.INIT (362 ms) 2023-12-03T11:30:19.020 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SETATTR 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2023-12-03T11:30:19.021 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-12-03T11:30:19.022 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.HIER1 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:30:19.023 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:30:19.024 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:30:19.024 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:30:19.024 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:30:19.024 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:19.019+0000 7feb340128c0 -1 shutting down 2023-12-03T11:30:19.024 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:19.020+0000 7feb0ad93640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97495, si_uid : 1000, si_addr0x3e800017cd7, si_status0 2023-12-03T11:30:19.084 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SHUTDOWN (64 ms) 2023-12-03T11:30:19.084 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 24 tests from LibRGW (427 ms total) 2023-12-03T11:30:19.084 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:19.084 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:19.084 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 24 tests from 1 test suite ran. (427 ms total) 2023-12-03T11:30:19.084 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 24 tests. 2023-12-03T11:30:19.089 INFO:tasks.workunit.client.0.smithi131.stdout:phase 1.3 2023-12-03T11:30:19.109 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 24 tests from 1 test suite. 2023-12-03T11:30:19.109 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:19.109 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 24 tests from LibRGW 2023-12-03T11:30:19.109 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:30:19.119 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:19.119 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:19.273 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.INIT (164 ms) 2023-12-03T11:30:19.273 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2023-12-03T11:30:19.274 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2023-12-03T11:30:19.274 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:30:19.274 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:30:19.274 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SETUP_HIER1 2023-12-03T11:30:19.279 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SETUP_HIER1 (5 ms) 2023-12-03T11:30:19.279 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SETUP_DIRS1 (55 ms) 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SETATTR 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2023-12-03T11:30:19.335 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout:scanning objects in /bdirs1/dir_0 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout:scanning objects in /bdirs1/dir_1 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout:scanning objects in /bdirs1/dir_2 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2023-12-03T11:30:19.336 INFO:tasks.workunit.client.0.smithi131.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2023-12-03T11:30:19.337 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2023-12-03T11:30:19.337 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READ_DIRS1 2023-12-03T11:30:19.337 INFO:tasks.workunit.client.0.smithi131.stdout:read back objects in /bdirs1/dir_0 2023-12-03T11:30:19.337 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_0/sfile_0 2023-12-03T11:30:19.337 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:30:19.337 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_0/sfile_1 2023-12-03T11:30:19.337 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:30:19.337 INFO:tasks.workunit.client.0.smithi131.stdout:read back objects in /bdirs1/dir_1 2023-12-03T11:30:19.338 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_1/sfile_0 2023-12-03T11:30:19.338 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:30:19.338 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_1/sfile_1 2023-12-03T11:30:19.339 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:30:19.339 INFO:tasks.workunit.client.0.smithi131.stdout:read back objects in /bdirs1/dir_2 2023-12-03T11:30:19.339 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_2/sfile_0 2023-12-03T11:30:19.340 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_0 : "data for sfile_0" 2023-12-03T11:30:19.340 INFO:tasks.workunit.client.0.smithi131.stdout:reading 0,256 dir_2/sfile_1 2023-12-03T11:30:19.341 INFO:tasks.workunit.client.0.smithi131.stdout: read back from sfile_1 : "data for sfile_1" 2023-12-03T11:30:19.341 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READ_DIRS1 (7 ms) 2023-12-03T11:30:19.341 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READF_SETUP1 2023-12-03T11:30:19.341 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2023-12-03T11:30:19.341 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READF_DIRS1 2023-12-03T11:30:19.341 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2023-12-03T11:30:19.341 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2023-12-03T11:30:19.341 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_0 type: DIR refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_0 type: FILE refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sdir_1 type: DIR refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:release sfile_1 type: FILE refs: 2 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2023-12-03T11:30:19.342 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.HIER1 2023-12-03T11:30:19.346 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/f2 (f2): FILE 2023-12-03T11:30:19.347 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/f1 (f1): FILE 2023-12-03T11:30:19.349 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2023-12-03T11:30:19.350 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2023-12-03T11:30:19.353 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:30:19.353 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2023-12-03T11:30:19.353 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2023-12-03T11:30:19.354 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2023-12-03T11:30:19.354 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:30:19.355 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2023-12-03T11:30:19.355 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2023-12-03T11:30:19.357 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2023-12-03T11:30:19.357 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar/baz (baz): DIR 2023-12-03T11:30:19.357 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo/bar (bar): DIR 2023-12-03T11:30:19.357 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot/foo (foo): DIR 2023-12-03T11:30:19.357 INFO:tasks.workunit.client.0.smithi131.stdout:/nfsroot (nfsroot): DIR 2023-12-03T11:30:19.357 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.HIER1 (15 ms) 2023-12-03T11:30:19.357 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:30:19.357 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2023-12-03T11:30:19.357 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:30:19.357 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:30:19.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:30:19.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:30:19.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:30:19.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:30:19.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:30:19.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:30:19.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:30:19.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:30:19.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:30:19.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:19.356+0000 7ff7cbb268c0 -1 shutting down 2023-12-03T11:30:19.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:19.357+0000 7ff7a4c1f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97605, si_uid : 1000, si_addr0x3e800017d45, si_status0 2023-12-03T11:30:19.438 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SHUTDOWN (81 ms) 2023-12-03T11:30:19.438 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 24 tests from LibRGW (328 ms total) 2023-12-03T11:30:19.438 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:19.438 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:19.438 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 24 tests from 1 test suite ran. (329 ms total) 2023-12-03T11:30:19.438 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 24 tests. 2023-12-03T11:30:19.443 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2.1 2023-12-03T11:30:19.464 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 9 tests from 1 test suite. 2023-12-03T11:30:19.464 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:19.464 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 9 tests from LibRGW 2023-12-03T11:30:19.464 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:30:19.473 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:19.473 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:19.626 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.INIT (162 ms) 2023-12-03T11:30:19.626 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:30:19.626 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:30:19.626 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:30:19.633 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CREATE_BUCKET (7 ms) 2023-12-03T11:30:19.633 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:30:19.633 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-12-03T11:30:19.633 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2023-12-03T11:30:19.639 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave0 2023-12-03T11:30:19.646 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave1 2023-12-03T11:30:19.652 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave2 2023-12-03T11:30:19.658 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave3 2023-12-03T11:30:19.665 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave4 2023-12-03T11:30:19.671 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave5 2023-12-03T11:30:19.678 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave6 2023-12-03T11:30:19.684 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave7 2023-12-03T11:30:19.690 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave8 2023-12-03T11:30:19.697 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave9 2023-12-03T11:30:19.697 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (64 ms) 2023-12-03T11:30:19.697 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2023-12-03T11:30:19.839 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (142 ms) 2023-12-03T11:30:19.839 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:30:19.839 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:30:19.839 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:30:19.840 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:30:19.840 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:30:19.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:19.838+0000 7f6ee52c58c0 -1 shutting down 2023-12-03T11:30:19.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:19.839+0000 7f6ebdbee640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97715, si_uid : 1000, si_addr0x3e800017db3, si_status0 2023-12-03T11:30:19.891 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SHUTDOWN (51 ms) 2023-12-03T11:30:19.891 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 9 tests from LibRGW (427 ms total) 2023-12-03T11:30:19.891 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:19.891 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:19.891 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 9 tests from 1 test suite ran. (427 ms total) 2023-12-03T11:30:19.891 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 9 tests. 2023-12-03T11:30:19.896 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2.2 2023-12-03T11:30:19.917 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 9 tests from 1 test suite. 2023-12-03T11:30:19.917 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:19.917 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 9 tests from LibRGW 2023-12-03T11:30:19.917 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:30:19.926 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:19.926 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:20.078 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.INIT (161 ms) 2023-12-03T11:30:20.078 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:30:20.078 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:30:20.079 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:30:20.079 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-12-03T11:30:20.079 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:30:20.095 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_BUCKET (17 ms) 2023-12-03T11:30:20.095 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2023-12-03T11:30:20.102 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave0 2023-12-03T11:30:20.109 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave1 2023-12-03T11:30:20.115 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave2 2023-12-03T11:30:20.121 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave3 2023-12-03T11:30:20.128 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave4 2023-12-03T11:30:20.134 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave5 2023-12-03T11:30:20.140 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave6 2023-12-03T11:30:20.146 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave7 2023-12-03T11:30:20.152 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave8 2023-12-03T11:30:20.159 INFO:tasks.workunit.client.0.smithi131.stdout:created: sorrydave9 2023-12-03T11:30:20.159 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (64 ms) 2023-12-03T11:30:20.159 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2023-12-03T11:30:20.299 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (139 ms) 2023-12-03T11:30:20.299 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:30:20.299 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:30:20.299 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:30:20.299 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:30:20.299 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:30:20.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:20.297+0000 7ffb29e668c0 -1 shutting down 2023-12-03T11:30:20.300 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:20.298+0000 7ffb04d45640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97826, si_uid : 1000, si_addr0x3e800017e22, si_status0 2023-12-03T11:30:20.343 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SHUTDOWN (44 ms) 2023-12-03T11:30:20.343 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 9 tests from LibRGW (425 ms total) 2023-12-03T11:30:20.343 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:20.343 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:20.343 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 9 tests from 1 test suite ran. (425 ms total) 2023-12-03T11:30:20.343 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 9 tests. 2023-12-03T11:30:20.348 INFO:tasks.workunit.client.0.smithi131.stdout:phase 3.1 2023-12-03T11:30:20.664 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 13 tests from 1 test suite. 2023-12-03T11:30:20.664 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:20.664 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 13 tests from LibRGW 2023-12-03T11:30:20.664 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:30:20.673 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:20.673 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:20.826 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.INIT (162 ms) 2023-12-03T11:30:20.826 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:30:20.827 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:30:20.827 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:30:20.834 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CREATE_BUCKET (7 ms) 2023-12-03T11:30:20.834 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:30:20.836 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2023-12-03T11:30:20.837 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:30:20.838 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2023-12-03T11:30:20.838 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LARGE1 2023-12-03T11:30:20.900 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LARGE1 (62 ms) 2023-12-03T11:30:20.900 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LARGE2 2023-12-03T11:30:20.941 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LARGE2 (40 ms) 2023-12-03T11:30:20.941 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:30:20.941 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:30:20.941 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:30:20.941 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2023-12-03T11:30:20.941 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:30:20.941 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-12-03T11:30:20.941 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:30:20.941 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:30:20.942 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:30:20.942 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:30:20.942 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:30:20.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:20.939+0000 7f07fbf1f8c0 -1 shutting down 2023-12-03T11:30:20.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:20.941+0000 7f07d4f87640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 97936, si_uid : 1000, si_addr0x3e800017e90, si_status0 2023-12-03T11:30:20.991 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SHUTDOWN (50 ms) 2023-12-03T11:30:20.991 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 13 tests from LibRGW (326 ms total) 2023-12-03T11:30:20.991 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:20.991 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:20.991 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 13 tests from 1 test suite ran. (326 ms total) 2023-12-03T11:30:20.991 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 13 tests. 2023-12-03T11:30:20.997 INFO:tasks.workunit.client.0.smithi131.stdout:phase 3.2 2023-12-03T11:30:21.308 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 13 tests from 1 test suite. 2023-12-03T11:30:21.308 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:21.309 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 13 tests from LibRGW 2023-12-03T11:30:21.309 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:30:21.316 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:21.316 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:21.478 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.INIT (169 ms) 2023-12-03T11:30:21.478 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:30:21.478 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:30:21.478 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:30:21.478 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-12-03T11:30:21.478 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:30:21.483 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2023-12-03T11:30:21.483 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:30:21.486 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2023-12-03T11:30:21.486 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LARGE1 2023-12-03T11:30:21.919 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LARGE1 (433 ms) 2023-12-03T11:30:21.919 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LARGE2 2023-12-03T11:30:21.919 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2023-12-03T11:30:21.919 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:30:21.920 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:30:21.920 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:30:21.924 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2023-12-03T11:30:21.924 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:30:21.938 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_BUCKET (14 ms) 2023-12-03T11:30:21.938 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:30:21.939 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:30:21.939 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:30:21.939 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:30:21.939 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:30:21.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:21.937+0000 7fe1683298c0 -1 shutting down 2023-12-03T11:30:21.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:21.939+0000 7fe1413d5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98046, si_uid : 1000, si_addr0x3e800017efe, si_status0 2023-12-03T11:30:22.042 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SHUTDOWN (104 ms) 2023-12-03T11:30:22.043 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 13 tests from LibRGW (734 ms total) 2023-12-03T11:30:22.043 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:22.043 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:22.043 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 13 tests from 1 test suite ran. (734 ms total) 2023-12-03T11:30:22.043 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 13 tests. 2023-12-03T11:30:22.050 INFO:tasks.workunit.client.0.smithi131.stdout:phase 4.1 2023-12-03T11:30:22.069 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 11 tests from 1 test suite. 2023-12-03T11:30:22.069 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:22.070 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 11 tests from LibRGW 2023-12-03T11:30:22.070 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.TVAR 2023-12-03T11:30:22.070 INFO:tasks.workunit.client.0.smithi131.stdout:read i1: 64001 2023-12-03T11:30:22.070 INFO:tasks.workunit.client.0.smithi131.stdout:read s1: blunderbuss 2023-12-03T11:30:22.070 INFO:tasks.workunit.client.0.smithi131.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2023-12-03T11:30:22.070 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:30:22.080 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:22.080 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:22.222 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.INIT (153 ms) 2023-12-03T11:30:22.222 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:30:22.222 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2023-12-03T11:30:22.223 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:30:22.237 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2023-12-03T11:30:22.237 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:30:22.618 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_0 2023-12-03T11:30:22.618 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_1 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_2 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_3 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_4 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_5 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_6 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_7 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_8 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_9 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_10 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_11 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_12 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_13 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_14 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_15 2023-12-03T11:30:22.619 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_16 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_17 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_18 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_19 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_20 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_21 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_22 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_23 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_24 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_25 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_26 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_27 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_28 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_29 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_30 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_31 2023-12-03T11:30:22.620 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_32 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_33 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_34 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_35 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_36 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_37 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_38 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_39 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_40 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_41 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_42 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_43 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_44 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_45 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_46 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_47 2023-12-03T11:30:22.621 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_48 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_49 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_50 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_51 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_52 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_53 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_54 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_55 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_56 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_57 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_58 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_59 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_60 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_61 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_62 2023-12-03T11:30:22.622 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_63 2023-12-03T11:30:22.623 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_64 2023-12-03T11:30:22.623 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_65 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_66 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_67 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_68 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_69 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_70 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_71 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_72 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_73 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_74 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_75 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_76 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_77 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_78 2023-12-03T11:30:22.624 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_79 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_80 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_81 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_82 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_83 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_84 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_85 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_86 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_87 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_88 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_89 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_90 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_91 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_92 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_93 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_94 2023-12-03T11:30:22.625 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_95 2023-12-03T11:30:22.626 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_96 2023-12-03T11:30:22.626 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_97 2023-12-03T11:30:22.626 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_98 2023-12-03T11:30:22.626 INFO:tasks.workunit.client.0.smithi131.stdout:created: dmarker:f_99 2023-12-03T11:30:22.626 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (381 ms) 2023-12-03T11:30:22.626 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:30:22.627 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2023-12-03T11:30:22.627 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2023-12-03T11:30:22.627 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-12-03T11:30:22.627 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-12-03T11:30:22.627 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-12-03T11:30:22.627 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-12-03T11:30:22.627 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-12-03T11:30:22.627 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-12-03T11:30:22.627 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-12-03T11:30:22.628 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-12-03T11:30:22.629 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-12-03T11:30:22.630 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-12-03T11:30:22.631 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-12-03T11:30:22.632 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-12-03T11:30:22.633 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-12-03T11:30:22.634 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-12-03T11:30:22.635 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-12-03T11:30:22.636 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-12-03T11:30:22.637 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-12-03T11:30:22.638 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-12-03T11:30:22.639 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:30:22.640 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:30:22.641 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:30:22.641 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:30:22.641 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:30:22.641 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:30:22.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:22.623+0000 7f1fd80108c0 -1 shutting down 2023-12-03T11:30:22.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:22.625+0000 7f1faee7f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98156, si_uid : 1000, si_addr0x3e800017f6c, si_status0 2023-12-03T11:30:22.686 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SHUTDOWN (62 ms) 2023-12-03T11:30:22.686 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 11 tests from LibRGW (617 ms total) 2023-12-03T11:30:22.686 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:22.686 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:22.687 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 11 tests from 1 test suite ran. (617 ms total) 2023-12-03T11:30:22.687 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 11 tests. 2023-12-03T11:30:22.692 INFO:tasks.workunit.client.0.smithi131.stdout:phase 4.2 2023-12-03T11:30:22.714 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 11 tests from 1 test suite. 2023-12-03T11:30:22.714 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:22.714 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 11 tests from LibRGW 2023-12-03T11:30:22.715 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.TVAR 2023-12-03T11:30:22.715 INFO:tasks.workunit.client.0.smithi131.stdout:read i1: 64001 2023-12-03T11:30:22.715 INFO:tasks.workunit.client.0.smithi131.stdout:read s1: blunderbuss 2023-12-03T11:30:22.715 INFO:tasks.workunit.client.0.smithi131.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2023-12-03T11:30:22.715 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:30:22.722 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:22.722 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:23.077 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.INIT (363 ms) 2023-12-03T11:30:23.077 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:30:23.077 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:30:23.078 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2023-12-03T11:30:23.086 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (8 ms) 2023-12-03T11:30:23.086 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2023-12-03T11:30:23.086 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2023-12-03T11:30:23.086 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2023-12-03T11:30:23.086 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2023-12-03T11:30:23.086 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2023-12-03T11:30:23.089 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2023-12-03T11:30:23.090 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2023-12-03T11:30:23.091 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2023-12-03T11:30:23.092 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2023-12-03T11:30:23.093 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2023-12-03T11:30:23.094 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2023-12-03T11:30:23.095 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:30:23.096 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:30:23.097 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:30:23.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:23.088+0000 7fc3975a28c0 -1 shutting down 2023-12-03T11:30:23.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:23.089+0000 7fc372483640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98266, si_uid : 1000, si_addr0x3e800017fda, si_status0 2023-12-03T11:30:23.142 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SHUTDOWN (53 ms) 2023-12-03T11:30:23.142 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 11 tests from LibRGW (428 ms total) 2023-12-03T11:30:23.142 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:23.143 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:23.143 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 11 tests from 1 test suite ran. (428 ms total) 2023-12-03T11:30:23.143 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 11 tests. 2023-12-03T11:30:23.147 INFO:tasks.workunit.client.0.smithi131.stdout:phase 5.1 2023-12-03T11:30:23.176 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 19 tests from 1 test suite. 2023-12-03T11:30:23.177 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:23.177 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 19 tests from LibRGW 2023-12-03T11:30:23.177 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:30:23.187 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:23.187 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:23.340 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.INIT (163 ms) 2023-12-03T11:30:23.340 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:30:23.340 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:30:23.340 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:30:23.347 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CREATE_BUCKET (7 ms) 2023-12-03T11:30:23.347 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:30:23.351 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2023-12-03T11:30:23.351 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2023-12-03T11:30:23.351 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2023-12-03T11:30:23.351 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:30:23.352 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2023-12-03T11:30:23.352 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.OBJ_OPEN 2023-12-03T11:30:23.352 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2023-12-03T11:30:23.352 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.PUT_OBJECT 2023-12-03T11:30:23.355 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.PUT_OBJECT (3 ms) 2023-12-03T11:30:23.355 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.GET_OBJECT 2023-12-03T11:30:23.357 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.GET_OBJECT (1 ms) 2023-12-03T11:30:23.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:30:23.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:30:23.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2023-12-03T11:30:23.358 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2023-12-03T11:30:23.359 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.WRITEV 2023-12-03T11:30:23.359 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2023-12-03T11:30:23.359 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READV 2023-12-03T11:30:23.359 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READV (0 ms) 2023-12-03T11:30:23.359 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2023-12-03T11:30:23.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2023-12-03T11:30:23.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:30:23.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2023-12-03T11:30:23.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:30:23.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2023-12-03T11:30:23.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:30:23.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:30:23.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:30:23.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:30:23.360 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:30:23.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:23.356+0000 7f5870f228c0 -1 shutting down 2023-12-03T11:30:23.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:23.357+0000 7f5849f41640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98376, si_uid : 1000, si_addr0x3e800018048, si_status0 2023-12-03T11:30:23.404 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SHUTDOWN (48 ms) 2023-12-03T11:30:23.404 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 19 tests from LibRGW (228 ms total) 2023-12-03T11:30:23.404 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:23.404 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:23.404 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 19 tests from 1 test suite ran. (228 ms total) 2023-12-03T11:30:23.404 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 19 tests. 2023-12-03T11:30:23.409 INFO:tasks.workunit.client.0.smithi131.stdout:phase 5.2 2023-12-03T11:30:23.438 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] Running 19 tests from 1 test suite. 2023-12-03T11:30:23.438 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment set-up. 2023-12-03T11:30:23.438 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 19 tests from LibRGW 2023-12-03T11:30:23.438 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.INIT 2023-12-03T11:30:23.445 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:30:23.445 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:30:23.602 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.INIT (163 ms) 2023-12-03T11:30:23.602 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.MOUNT 2023-12-03T11:30:23.602 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2023-12-03T11:30:23.602 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2023-12-03T11:30:23.603 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2023-12-03T11:30:23.603 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2023-12-03T11:30:23.607 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.OBJ_OPEN 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.PUT_OBJECT 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.GET_OBJECT 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.STAT_OBJECT 2023-12-03T11:30:23.608 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2023-12-03T11:30:23.609 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2023-12-03T11:30:23.609 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2023-12-03T11:30:23.609 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.WRITEV 2023-12-03T11:30:23.609 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2023-12-03T11:30:23.609 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READV 2023-12-03T11:30:23.609 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READV (0 ms) 2023-12-03T11:30:23.609 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2023-12-03T11:30:23.609 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2023-12-03T11:30:23.609 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2023-12-03T11:30:23.610 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_OBJECT (3 ms) 2023-12-03T11:30:23.610 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2023-12-03T11:30:23.625 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.DELETE_BUCKET (14 ms) 2023-12-03T11:30:23.625 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.CLEANUP 2023-12-03T11:30:23.625 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2023-12-03T11:30:23.625 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.UMOUNT 2023-12-03T11:30:23.625 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2023-12-03T11:30:23.625 INFO:tasks.workunit.client.0.smithi131.stdout:[ RUN ] LibRGW.SHUTDOWN 2023-12-03T11:30:23.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:23.623+0000 7f2b135228c0 -1 shutting down 2023-12-03T11:30:23.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:30:23.625+0000 7f2aec552640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 98486, si_uid : 1000, si_addr0x3e8000180b6, si_status0 2023-12-03T11:30:23.667 INFO:tasks.workunit.client.0.smithi131.stdout:[ OK ] LibRGW.SHUTDOWN (42 ms) 2023-12-03T11:30:23.667 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] 19 tests from LibRGW (228 ms total) 2023-12-03T11:30:23.667 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:30:23.667 INFO:tasks.workunit.client.0.smithi131.stdout:[----------] Global test environment tear-down 2023-12-03T11:30:23.667 INFO:tasks.workunit.client.0.smithi131.stdout:[==========] 19 tests from 1 test suite ran. (229 ms total) 2023-12-03T11:30:23.667 INFO:tasks.workunit.client.0.smithi131.stdout:[ PASSED ] 19 tests. 2023-12-03T11:30:23.673 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:30:23.673 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:30:23.701 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh'] on client.0... 2023-12-03T11:30:23.701 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:30:24.000 DEBUG:teuthology.parallel:result is None 2023-12-03T11:30:24.001 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:30:24.027 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:30:24.028 DEBUG:teuthology.orchestra.run.smithi131:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:30:24.083 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:30:24.083 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:30:37.955 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:30:37.956 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:30:37.956 DEBUG:teuthology.orchestra.run.smithi131:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:30:37.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:30:37.974 INFO:teuthology.orchestra.run.smithi131.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:30:37.974 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:30:38.031 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:30:38.032 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:30:38.089 INFO:tasks.workunit:timeout=3h 2023-12-03T11:30:38.089 INFO:tasks.workunit:cleanup=True 2023-12-03T11:30:38.089 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:30:38.147 INFO:tasks.workunit.client.0.smithi131.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:31:48.411 INFO:tasks.workunit.client.0.smithi131.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:31:48.412 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:31:48.412 INFO:tasks.workunit.client.0.smithi131.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:31:48.412 INFO:tasks.workunit.client.0.smithi131.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:31:48.412 INFO:tasks.workunit.client.0.smithi131.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:31:48.412 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:31:48.412 INFO:tasks.workunit.client.0.smithi131.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:31:48.412 INFO:tasks.workunit.client.0.smithi131.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:31:48.412 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:31:48.412 INFO:tasks.workunit.client.0.smithi131.stderr: git switch -c 2023-12-03T11:31:48.412 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:31:48.413 INFO:tasks.workunit.client.0.smithi131.stderr:Or undo this operation with: 2023-12-03T11:31:48.413 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:31:48.413 INFO:tasks.workunit.client.0.smithi131.stderr: git switch - 2023-12-03T11:31:48.413 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:31:48.413 INFO:tasks.workunit.client.0.smithi131.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:31:48.413 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:31:48.413 INFO:tasks.workunit.client.0.smithi131.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:31:48.414 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:31:48.469 INFO:tasks.workunit.client.0.smithi131.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:31:48.471 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:31:48.471 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:31:48.534 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:31:48.584 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:31:48.622 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:31:48.624 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:31:48.624 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:31:48.662 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:31:48.665 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:31:48.665 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:31:48.722 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2023-12-03T11:31:48.723 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2023-12-03T11:31:48.723 DEBUG:teuthology.orchestra.run.smithi131:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2023-12-03T11:31:48.785 INFO:tasks.workunit.client.0.smithi131.stdout:INFO: fully qualified domain name: smithi131.front.sepia.ceph.com 2023-12-03T11:31:48.785 INFO:tasks.workunit.client.0.smithi131.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2023-12-03T11:31:48.785 INFO:tasks.workunit.client.0.smithi131.stdout:== TESTING VERSIONED BUCKET == 2023-12-03T11:31:51.413 INFO:tasks.workunit.client.0.smithi131.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-12-03T11:31:52.582 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting pip 2023-12-03T11:31:52.588 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached pip-23.3.1-py3-none-any.whl (2.1 MB) 2023-12-03T11:31:52.636 INFO:tasks.workunit.client.0.smithi131.stdout:Installing collected packages: pip 2023-12-03T11:31:52.636 INFO:tasks.workunit.client.0.smithi131.stdout: Attempting uninstall: pip 2023-12-03T11:31:52.636 INFO:tasks.workunit.client.0.smithi131.stdout: Found existing installation: pip 21.2.3 2023-12-03T11:31:52.783 INFO:tasks.workunit.client.0.smithi131.stdout: Uninstalling pip-21.2.3: 2023-12-03T11:31:52.788 INFO:tasks.workunit.client.0.smithi131.stdout: Successfully uninstalled pip-21.2.3 2023-12-03T11:31:53.964 INFO:tasks.workunit.client.0.smithi131.stdout:Successfully installed pip-23.3.1 2023-12-03T11:31:55.450 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting boto3 2023-12-03T11:31:55.451 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached boto3-1.33.6-py3-none-any.whl.metadata (6.7 kB) 2023-12-03T11:31:56.240 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting botocore<1.34.0,>=1.33.6 (from boto3) 2023-12-03T11:31:56.242 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached botocore-1.33.6-py3-none-any.whl.metadata (6.1 kB) 2023-12-03T11:31:56.506 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-12-03T11:31:56.507 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-12-03T11:31:56.760 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting s3transfer<0.9.0,>=0.8.2 (from boto3) 2023-12-03T11:31:56.762 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached s3transfer-0.8.2-py3-none-any.whl.metadata (1.8 kB) 2023-12-03T11:31:57.021 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:31:57.022 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-12-03T11:31:57.301 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:31:57.302 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2023-12-03T11:31:57.749 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:31:57.751 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:31:57.773 INFO:tasks.workunit.client.0.smithi131.stdout:Using cached boto3-1.33.6-py3-none-any.whl (139 kB) 2023-12-03T11:31:57.775 INFO:tasks.workunit.client.0.smithi131.stdout:Using cached botocore-1.33.6-py3-none-any.whl (11.8 MB) 2023-12-03T11:31:57.795 INFO:tasks.workunit.client.0.smithi131.stdout:Using cached s3transfer-0.8.2-py3-none-any.whl (82 kB) 2023-12-03T11:31:57.797 INFO:tasks.workunit.client.0.smithi131.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2023-12-03T11:31:57.895 INFO:tasks.workunit.client.0.smithi131.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-12-03T11:31:58.948 INFO:tasks.workunit.client.0.smithi131.stdout:Successfully installed boto3-1.33.6 botocore-1.33.6 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.8.2 six-1.16.0 urllib3-1.26.18 2023-12-03T11:31:59.370 INFO:tasks.workunit.client.0.smithi131.stdout:INFO: creating user 2023-12-03T11:31:59.461 INFO:tasks.workunit.client.0.smithi131.stdout:{ 2023-12-03T11:31:59.461 INFO:tasks.workunit.client.0.smithi131.stdout: "user_id": "testid", 2023-12-03T11:31:59.461 INFO:tasks.workunit.client.0.smithi131.stdout: "display_name": "M. Tester", 2023-12-03T11:31:59.461 INFO:tasks.workunit.client.0.smithi131.stdout: "email": "tester@ceph.com", 2023-12-03T11:31:59.461 INFO:tasks.workunit.client.0.smithi131.stdout: "suspended": 0, 2023-12-03T11:31:59.461 INFO:tasks.workunit.client.0.smithi131.stdout: "max_buckets": 1000, 2023-12-03T11:31:59.461 INFO:tasks.workunit.client.0.smithi131.stdout: "subusers": [], 2023-12-03T11:31:59.461 INFO:tasks.workunit.client.0.smithi131.stdout: "keys": [ 2023-12-03T11:31:59.461 INFO:tasks.workunit.client.0.smithi131.stdout: { 2023-12-03T11:31:59.461 INFO:tasks.workunit.client.0.smithi131.stdout: "user": "testid", 2023-12-03T11:31:59.461 INFO:tasks.workunit.client.0.smithi131.stdout: "access_key": "0555b35654ad1656d804", 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==" 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: } 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: ], 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "swift_keys": [], 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "caps": [], 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "op_mask": "read, write, delete", 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "default_placement": "", 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "default_storage_class": "", 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "placement_tags": [], 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "bucket_quota": { 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "enabled": false, 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "max_size": -1, 2023-12-03T11:31:59.462 INFO:tasks.workunit.client.0.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: "max_objects": -1 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: "user_quota": { 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: "enabled": false, 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: "max_size": -1, 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: "max_objects": -1 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: }, 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: "temp_url_keys": [], 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: "type": "rgw", 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: "mfa_ids": [] 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout:} 2023-12-03T11:31:59.463 INFO:tasks.workunit.client.0.smithi131.stdout: 2023-12-03T11:31:59.705 INFO:tasks.workunit.client.0.smithi131.stderr:5+0 records in 2023-12-03T11:31:59.705 INFO:tasks.workunit.client.0.smithi131.stderr:5+0 records out 2023-12-03T11:31:59.705 INFO:tasks.workunit.client.0.smithi131.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0145125 s, 361 MB/s 2023-12-03T11:32:02.433 INFO:tasks.workunit.client.0.smithi131.stdout:bucket nams is reupload-bkt-126052 2023-12-03T11:32:02.433 INFO:tasks.workunit.client.0.smithi131.stdout:endpoint is http://smithi131.front.sepia.ceph.com:80 2023-12-03T11:32:02.433 INFO:tasks.workunit.client.0.smithi131.stdout:start UploadId=2~96ER3QgmFTuYyo7BkZHBmZD-tfYWRTF 2023-12-03T11:32:02.433 INFO:tasks.workunit.client.0.smithi131.stdout:phase 1 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.433 INFO:tasks.workunit.client.0.smithi131.stdout:phase 1 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 2} 2023-12-03T11:32:02.434 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.434 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.434 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.434 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.434 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.434 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.435 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.435 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.435 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.435 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.435 INFO:tasks.workunit.client.0.smithi131.stdout:phase 2 uploaded part {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1} 2023-12-03T11:32:02.435 INFO:tasks.workunit.client.0.smithi131.stdout:completing multipart upload, parts=[{'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 1}, {'ETag': '"ef5a71c547422d5a2c7ce8b9c2b61503"', 'PartNumber': 2}] 2023-12-03T11:32:02.907 INFO:tasks.workunit.client.0.smithi131.stdout:radosgw-admin bucket radoslist: 2023-12-03T11:32:02.907 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2__:MGnRiyPKkSN1beYqMGzepI5JJVC0alq_mpu_test4 2023-12-03T11:32:02.907 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2_mpu_test4 2023-12-03T11:32:02.907 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2__multipart_mpu_test4.2~96ER3QgmFTuYyo7BkZHBmZD-tfYWRTF.2 2023-12-03T11:32:02.908 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2__multipart_mpu_test4.floAUCTy62bpeKLVYDtb_T0ktQi4f4Ii.1 2023-12-03T11:32:02.908 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2__shadow_mpu_test4.2~96ER3QgmFTuYyo7BkZHBmZD-tfYWRTF.2_1 2023-12-03T11:32:02.908 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2__shadow_mpu_test4.floAUCTy62bpeKLVYDtb_T0ktQi4f4Ii.1_1 2023-12-03T11:32:02.963 INFO:tasks.workunit.client.0.smithi131.stdout:rados ls: 2023-12-03T11:32:02.963 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2__:MGnRiyPKkSN1beYqMGzepI5JJVC0alq_mpu_test4 2023-12-03T11:32:02.963 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2_mpu_test4 2023-12-03T11:32:02.963 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2__multipart_mpu_test4.2~96ER3QgmFTuYyo7BkZHBmZD-tfYWRTF.2 2023-12-03T11:32:02.963 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2__multipart_mpu_test4.floAUCTy62bpeKLVYDtb_T0ktQi4f4Ii.1 2023-12-03T11:32:02.963 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2__shadow_mpu_test4.2~96ER3QgmFTuYyo7BkZHBmZD-tfYWRTF.2_1 2023-12-03T11:32:02.963 INFO:tasks.workunit.client.0.smithi131.stdout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.2__shadow_mpu_test4.floAUCTy62bpeKLVYDtb_T0ktQi4f4Ii.1_1 2023-12-03T11:32:03.051 INFO:tasks.workunit.client.0.smithi131.stdout:== PASSED == 2023-12-03T11:32:03.052 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:32:03.052 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:32:03.119 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2023-12-03T11:32:03.119 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:32:03.450 DEBUG:teuthology.parallel:result is None 2023-12-03T11:32:03.450 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:32:03.477 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:32:03.477 DEBUG:teuthology.orchestra.run.smithi131:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:32:03.532 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:32:03.532 INFO:teuthology.run_tasks:Running task ragweed... 2023-12-03T11:32:03.546 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2023-12-03T11:32:03.546 INFO:tasks.ragweed:Downloading ragweed... 2023-12-03T11:32:03.546 INFO:tasks.ragweed:Using branch 'wip-alimasa-multi-pubsub-etag' for ragweed 2023-12-03T11:32:03.546 DEBUG:teuthology.orchestra.run.smithi131:> git clone -b wip-alimasa-multi-pubsub-etag https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:32:03.586 INFO:teuthology.orchestra.run.smithi131.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2023-12-03T11:32:03.630 INFO:teuthology.orchestra.run.smithi131.stderr:fatal: Remote branch wip-alimasa-multi-pubsub-etag not found in upstream origin 2023-12-03T11:32:03.630 DEBUG:teuthology.orchestra.run:got remote process result: 128 2023-12-03T11:32:03.631 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2023-12-03T11:32:03.632 DEBUG:teuthology.orchestra.run.smithi131:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:32:03.687 INFO:teuthology.orchestra.run.smithi131.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2023-12-03T11:32:03.841 INFO:tasks.ragweed:Creating rgw users... 2023-12-03T11:32:03.842 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2023-12-03T11:32:03.842 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key VLJDZJWEKAZDQTHOEEFG --secret WIsexgx3eUIMQSCNcr9wXOqzClAT+lB5F/zgHTmmxnGYTm5cLau6Bg== --email ragweed.client.0+test@test.test --system false 2023-12-03T11:32:03.932 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:32:03.932 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:32:03.943 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.941+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.943+0000 7f02dde8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:03.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.943+0000 7f02dde8c800 20 realm 2023-12-03T11:32:03.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.943+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.943+0000 7f02dde8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:03.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.943+0000 7f02dde8c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:32:03.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.943+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.944+0000 7f02dde8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:03.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.944+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.945+0000 7f02dde8c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:32:03.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.945+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.945+0000 7f02dde8c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:32:03.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.945+0000 7f02dde8c800 20 searching for the correct realm 2023-12-03T11:32:03.958 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.957+0000 7f02dc18d640 0 -- 172.21.15.131:0/1920890089 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f02c4059790 msgr2=0x7f02c40619d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:32:03.958 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.957+0000 7f02dde8c800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:32:03.958 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.957+0000 7f02dde8c800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:32:03.958 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.957+0000 7f02dde8c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:32:03.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.957+0000 7f02dde8c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:32:03.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.957+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.957+0000 7f02dde8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:03.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.957+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.957+0000 7f02dde8c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:32:03.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.957+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.961 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:32:03.961 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 20 zone default found 2023-12-03T11:32:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 4 Realm: () 2023-12-03T11:32:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:32:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:32:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:32:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 20 zonegroup default 2023-12-03T11:32:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:03.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:03.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 20 started sync module instance, tier type = 2023-12-03T11:32:03.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.958+0000 7f02dde8c800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:32:03.968 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.967+0000 7f02db18b640 0 -- 172.21.15.131:0/1920890089 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x564d966fd540 msgr2=0x564d966ff930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:32:03.968 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.967+0000 7f02dde8c800 20 add_watcher() i=0 2023-12-03T11:32:03.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.967+0000 7f02dde8c800 20 add_watcher() i=1 2023-12-03T11:32:03.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.967+0000 7f02dde8c800 20 add_watcher() i=2 2023-12-03T11:32:03.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.967+0000 7f02dde8c800 20 add_watcher() i=3 2023-12-03T11:32:03.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.967+0000 7f02dde8c800 20 add_watcher() i=4 2023-12-03T11:32:03.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.967+0000 7f02dde8c800 20 add_watcher() i=5 2023-12-03T11:32:03.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.967+0000 7f02dde8c800 20 add_watcher() i=6 2023-12-03T11:32:03.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.968+0000 7f02dde8c800 20 add_watcher() i=7 2023-12-03T11:32:03.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.968+0000 7f02dde8c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:32:03.971 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.970+0000 7f02a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:32:03.971 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.970+0000 7f02dde8c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:32:03.972 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.970+0000 7f02dde8c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:32:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.975+0000 7f02dde8c800 5 note: GC not initialized 2023-12-03T11:32:03.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.975+0000 7f0218ff9640 20 reqs_thread_entry: start 2023-12-03T11:32:03.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.975+0000 7f02dde8c800 20 init_complete bucket index max shards: 1 2023-12-03T11:32:03.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.975+0000 7f02dde8c800 20 Filter name: none 2023-12-03T11:32:03.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.975+0000 7f020e7fc640 20 reqs_thread_entry: start 2023-12-03T11:32:03.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.975+0000 7f02dde8c800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2023-12-03T11:32:03.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.975+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:03.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2023-12-03T11:32:03.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:32:03.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2023-12-03T11:32:03.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:03.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2023-12-03T11:32:03.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-12-03T11:32:03.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 10 cache get: name=default.rgw.meta+users.keys+VLJDZJWEKAZDQTHOEEFG : miss 2023-12-03T11:32:03.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 20 rados->read ofs=0 len=0 2023-12-03T11:32:03.979 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:03.979 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 10 cache put: name=default.rgw.meta+users.keys+VLJDZJWEKAZDQTHOEEFG info.flags=0x0 2023-12-03T11:32:03.979 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 10 adding default.rgw.meta+users.keys+VLJDZJWEKAZDQTHOEEFG to cache LRU end 2023-12-03T11:32:03.979 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 10 cache get: name=default.rgw.meta+users.keys+VLJDZJWEKAZDQTHOEEFG : hit (negative entry) 2023-12-03T11:32:03.979 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.976+0000 7f02dde8c800 10 cache get: name=default.rgw.meta+users.keys+VLJDZJWEKAZDQTHOEEFG : hit (negative entry) 2023-12-03T11:32:03.980 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.978+0000 7f02dde8c800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2023-12-03T11:32:03.980 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.978+0000 7f02dde8c800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:32:03.980 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.978+0000 7f02dde8c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2023-12-03T11:32:03.980 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.978+0000 7f02d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987557 cookie 94891236413536 notifier 5988 bl.length()=641 2023-12-03T11:32:03.980 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.978+0000 7f02d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2023-12-03T11:32:03.980 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.978+0000 7f02d27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:32:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.980+0000 7f02dde8c800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2023-12-03T11:32:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.980+0000 7f02dde8c800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-12-03T11:32:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.980+0000 7f02dde8c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2023-12-03T11:32:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.980+0000 7f02d27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987527 cookie 94891236404672 notifier 5988 bl.length()=202 2023-12-03T11:32:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.980+0000 7f02d27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2023-12-03T11:32:03.982 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.980+0000 7f02d27fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2023-12-03T11:32:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.982+0000 7f02dde8c800 10 cache put: name=default.rgw.meta+users.keys+VLJDZJWEKAZDQTHOEEFG info.flags=0x7 2023-12-03T11:32:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.982+0000 7f02dde8c800 10 moving default.rgw.meta+users.keys+VLJDZJWEKAZDQTHOEEFG to cache LRU end 2023-12-03T11:32:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.982+0000 7f02dde8c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:VLJDZJWEKAZDQTHOEEFG, ofs0, ns] 2023-12-03T11:32:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.982+0000 7f02d1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987587 cookie 94891236416240 notifier 5988 bl.length()=190 2023-12-03T11:32:03.983 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.982+0000 7f02d1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VLJDZJWEKAZDQTHOEEFG info.flags=0x7 2023-12-03T11:32:03.984 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.982+0000 7f02d1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VLJDZJWEKAZDQTHOEEFG to cache LRU end 2023-12-03T11:32:03.984 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-12-03T11:32:03.984 INFO:teuthology.orchestra.run.smithi131.stdout: "user_id": "ragweed.client.0", 2023-12-03T11:32:03.984 INFO:teuthology.orchestra.run.smithi131.stdout: "display_name": "Mr. ragweed.client.0", 2023-12-03T11:32:03.984 INFO:teuthology.orchestra.run.smithi131.stdout: "email": "ragweed.client.0+test@test.test", 2023-12-03T11:32:03.984 INFO:teuthology.orchestra.run.smithi131.stdout: "suspended": 0, 2023-12-03T11:32:03.984 INFO:teuthology.orchestra.run.smithi131.stdout: "max_buckets": 1000, 2023-12-03T11:32:03.984 INFO:teuthology.orchestra.run.smithi131.stdout: "subusers": [], 2023-12-03T11:32:03.984 INFO:teuthology.orchestra.run.smithi131.stdout: "keys": [ 2023-12-03T11:32:03.984 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: "user": "ragweed.client.0", 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: "access_key": "VLJDZJWEKAZDQTHOEEFG", 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: "secret_key": "WIsexgx3eUIMQSCNcr9wXOqzClAT+lB5F/zgHTmmxnGYTm5cLau6Bg==" 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: "swift_keys": [], 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": [], 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: "op_mask": "read, write, delete", 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: "default_placement": "", 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: "default_storage_class": "", 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: "placement_tags": [], 2023-12-03T11:32:03.985 INFO:teuthology.orchestra.run.smithi131.stdout: "bucket_quota": { 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "user_quota": { 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:32:03.986 INFO:teuthology.orchestra.run.smithi131.stdout: "temp_url_keys": [], 2023-12-03T11:32:03.987 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "rgw", 2023-12-03T11:32:03.987 INFO:teuthology.orchestra.run.smithi131.stdout: "mfa_ids": [] 2023-12-03T11:32:03.987 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-12-03T11:32:03.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:32:03.987 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.983+0000 7f02a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:32:03.988 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.985+0000 7f02dde8c800 20 remove_watcher() i=0 2023-12-03T11:32:03.988 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.985+0000 7f02dde8c800 2 removed watcher, disabling cache 2023-12-03T11:32:03.988 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.987+0000 7f02dde8c800 20 remove_watcher() i=1 2023-12-03T11:32:03.989 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.988+0000 7f02dde8c800 20 remove_watcher() i=2 2023-12-03T11:32:03.990 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.989+0000 7f02dde8c800 20 remove_watcher() i=3 2023-12-03T11:32:03.991 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.990+0000 7f02dde8c800 20 remove_watcher() i=4 2023-12-03T11:32:03.992 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.991+0000 7f02dde8c800 20 remove_watcher() i=5 2023-12-03T11:32:03.993 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.992+0000 7f02dde8c800 20 remove_watcher() i=6 2023-12-03T11:32:03.994 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:03.993+0000 7f02dde8c800 20 remove_watcher() i=7 2023-12-03T11:32:03.999 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2023-12-03T11:32:03.999 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ZCQGZUFAGJXMMWLQIIDZ --secret T/gbCnQ2RjxBF6+tUUdsigVnj80yt8J59PLlO47QIzY9ZoNKjhWa2w== --email sysuser.client.0+test@test.test --system true 2023-12-03T11:32:04.050 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:32:04.050 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:32:04.061 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.060+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.061+0000 7f5f24f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:04.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.061+0000 7f5f24f21800 20 realm 2023-12-03T11:32:04.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.061+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.061+0000 7f5f24f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:04.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.061+0000 7f5f24f21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:32:04.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.061+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.061+0000 7f5f24f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:04.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.061+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.062+0000 7f5f24f21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:32:04.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.062+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.063+0000 7f5f24f21800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:32:04.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.063+0000 7f5f24f21800 20 searching for the correct realm 2023-12-03T11:32:04.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.073+0000 7f5f20cb8640 0 -- 172.21.15.131:0/2955337040 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55a8eebb55d0 msgr2=0x55a8eebb7a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:32:04.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.074+0000 7f5f24f21800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:32:04.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.074+0000 7f5f24f21800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:32:04.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.074+0000 7f5f24f21800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:32:04.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.074+0000 7f5f24f21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:32:04.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.074+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.074+0000 7f5f24f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:04.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:32:04.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 20 zone default found 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 4 Realm: () 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 20 zonegroup default 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.075+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.076+0000 7f5f24f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.076+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.076+0000 7f5f24f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:04.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.076+0000 7f5f24f21800 20 started sync module instance, tier type = 2023-12-03T11:32:04.079 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.076+0000 7f5f24f21800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:32:04.084 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.083+0000 7f5f214b9640 0 -- 172.21.15.131:0/2955337040 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f5f140561b0 msgr2=0x7f5f14086250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:32:04.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.085+0000 7f5f24f21800 20 add_watcher() i=0 2023-12-03T11:32:04.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.085+0000 7f5f24f21800 20 add_watcher() i=1 2023-12-03T11:32:04.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.085+0000 7f5f24f21800 20 add_watcher() i=2 2023-12-03T11:32:04.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.085+0000 7f5f24f21800 20 add_watcher() i=3 2023-12-03T11:32:04.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.085+0000 7f5f24f21800 20 add_watcher() i=4 2023-12-03T11:32:04.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.085+0000 7f5f24f21800 20 add_watcher() i=5 2023-12-03T11:32:04.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.085+0000 7f5f24f21800 20 add_watcher() i=6 2023-12-03T11:32:04.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.086+0000 7f5f24f21800 20 add_watcher() i=7 2023-12-03T11:32:04.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.086+0000 7f5f24f21800 2 all 8 watchers are set, enabling cache 2023-12-03T11:32:04.089 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.088+0000 7f5ee6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:32:04.089 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.088+0000 7f5f24f21800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:32:04.089 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.088+0000 7f5f24f21800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:32:04.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.092+0000 7f5f24f21800 5 note: GC not initialized 2023-12-03T11:32:04.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.092+0000 7f5e55ffb640 20 reqs_thread_entry: start 2023-12-03T11:32:04.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 20 init_complete bucket index max shards: 1 2023-12-03T11:32:04.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 20 Filter name: none 2023-12-03T11:32:04.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5e477fe640 20 reqs_thread_entry: start 2023-12-03T11:32:04.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2023-12-03T11:32:04.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:04.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2023-12-03T11:32:04.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:32:04.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2023-12-03T11:32:04.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:04.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2023-12-03T11:32:04.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-12-03T11:32:04.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 10 cache get: name=default.rgw.meta+users.keys+ZCQGZUFAGJXMMWLQIIDZ : miss 2023-12-03T11:32:04.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.093+0000 7f5f24f21800 20 rados->read ofs=0 len=0 2023-12-03T11:32:04.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.094+0000 7f5f24f21800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:04.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.094+0000 7f5f24f21800 10 cache put: name=default.rgw.meta+users.keys+ZCQGZUFAGJXMMWLQIIDZ info.flags=0x0 2023-12-03T11:32:04.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.094+0000 7f5f24f21800 10 adding default.rgw.meta+users.keys+ZCQGZUFAGJXMMWLQIIDZ to cache LRU end 2023-12-03T11:32:04.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.094+0000 7f5f24f21800 10 cache get: name=default.rgw.meta+users.keys+ZCQGZUFAGJXMMWLQIIDZ : hit (negative entry) 2023-12-03T11:32:04.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.094+0000 7f5f24f21800 10 cache get: name=default.rgw.meta+users.keys+ZCQGZUFAGJXMMWLQIIDZ : hit (negative entry) 2023-12-03T11:32:04.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.095+0000 7f5f24f21800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2023-12-03T11:32:04.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.095+0000 7f5f24f21800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:32:04.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.095+0000 7f5f24f21800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2023-12-03T11:32:04.098 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.095+0000 7f5f077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987528 cookie 94184048157424 notifier 6009 bl.length()=641 2023-12-03T11:32:04.098 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.095+0000 7f5f077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2023-12-03T11:32:04.098 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.095+0000 7f5f077fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:32:04.098 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.097+0000 7f5f24f21800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2023-12-03T11:32:04.098 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.097+0000 7f5f24f21800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-12-03T11:32:04.098 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.097+0000 7f5f24f21800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2023-12-03T11:32:04.099 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.097+0000 7f5f06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987558 cookie 94184048165808 notifier 6009 bl.length()=202 2023-12-03T11:32:04.099 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.098+0000 7f5f06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2023-12-03T11:32:04.099 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.098+0000 7f5f06ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2023-12-03T11:32:04.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.099+0000 7f5f24f21800 10 cache put: name=default.rgw.meta+users.keys+ZCQGZUFAGJXMMWLQIIDZ info.flags=0x7 2023-12-03T11:32:04.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.099+0000 7f5f24f21800 10 moving default.rgw.meta+users.keys+ZCQGZUFAGJXMMWLQIIDZ to cache LRU end 2023-12-03T11:32:04.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.099+0000 7f5f24f21800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:ZCQGZUFAGJXMMWLQIIDZ, ofs0, ns] 2023-12-03T11:32:04.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.100+0000 7f5f06ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1052266987588 cookie 94184048168064 notifier 6009 bl.length()=190 2023-12-03T11:32:04.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.100+0000 7f5f06ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZCQGZUFAGJXMMWLQIIDZ info.flags=0x7 2023-12-03T11:32:04.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.100+0000 7f5f06ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZCQGZUFAGJXMMWLQIIDZ to cache LRU end 2023-12-03T11:32:04.101 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-12-03T11:32:04.101 INFO:teuthology.orchestra.run.smithi131.stdout: "user_id": "sysuser.client.0", 2023-12-03T11:32:04.101 INFO:teuthology.orchestra.run.smithi131.stdout: "display_name": "Mr. sysuser.client.0", 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: "email": "sysuser.client.0+test@test.test", 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: "suspended": 0, 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: "max_buckets": 1000, 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: "subusers": [], 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: "keys": [ 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: "user": "sysuser.client.0", 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: "access_key": "ZCQGZUFAGJXMMWLQIIDZ", 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: "secret_key": "T/gbCnQ2RjxBF6+tUUdsigVnj80yt8J59PLlO47QIzY9ZoNKjhWa2w==" 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: "swift_keys": [], 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": [], 2023-12-03T11:32:04.102 INFO:teuthology.orchestra.run.smithi131.stdout: "op_mask": "read, write, delete", 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "system": true, 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "default_placement": "", 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "default_storage_class": "", 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "placement_tags": [], 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "bucket_quota": { 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "user_quota": { 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:32:04.103 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:32:04.104 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:32:04.104 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:32:04.104 INFO:teuthology.orchestra.run.smithi131.stdout: "temp_url_keys": [], 2023-12-03T11:32:04.104 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "rgw", 2023-12-03T11:32:04.104 INFO:teuthology.orchestra.run.smithi131.stdout: "mfa_ids": [] 2023-12-03T11:32:04.104 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-12-03T11:32:04.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:32:04.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.101+0000 7f5ee6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:32:04.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.103+0000 7f5f24f21800 20 remove_watcher() i=0 2023-12-03T11:32:04.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.103+0000 7f5f24f21800 2 removed watcher, disabling cache 2023-12-03T11:32:04.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.104+0000 7f5f24f21800 20 remove_watcher() i=1 2023-12-03T11:32:04.106 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.105+0000 7f5f24f21800 20 remove_watcher() i=2 2023-12-03T11:32:04.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.106+0000 7f5f24f21800 20 remove_watcher() i=3 2023-12-03T11:32:04.108 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.107+0000 7f5f24f21800 20 remove_watcher() i=4 2023-12-03T11:32:04.109 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.108+0000 7f5f24f21800 20 remove_watcher() i=5 2023-12-03T11:32:04.110 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.109+0000 7f5f24f21800 20 remove_watcher() i=6 2023-12-03T11:32:04.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:04.110+0000 7f5f24f21800 20 remove_watcher() i=7 2023-12-03T11:32:04.116 INFO:tasks.ragweed:Configuring ragweed... 2023-12-03T11:32:04.116 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:32:04.116 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2023-12-03T11:32:04.130 INFO:tasks.ragweed:Configuring boto... 2023-12-03T11:32:04.130 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:32:04.131 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/boto.cfg 2023-12-03T11:32:04.185 DEBUG:teuthology.orchestra.run.smithi131:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2023-12-03T11:32:04.344 INFO:teuthology.orchestra.run.smithi131.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2023-12-03T11:32:04.512 INFO:teuthology.orchestra.run.smithi131.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2023-12-03T11:32:04.974 INFO:teuthology.orchestra.run.smithi131.stdout:py installdeps: -rrequirements.txt 2023-12-03T11:32:18.563 INFO:teuthology.orchestra.run.smithi131.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2023-12-03T11:32:21.862 INFO:teuthology.orchestra.run.smithi131.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2021.10.8,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-299/tmp/wheel/cockpit-299-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.0,execnet==2.0.2,file-magic==0.4.0,gevent==23.9.1,google-auth==2.23.4,gpg==1.15.1,greenlet==3.0.1,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==23.2,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.3.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,PyJWT==2.4.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==7.4.3,python-dateutil==2.8.1,python-linux-procfs==0.7.0,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=4a671f59125c55308d40f09b2b7393a01f768e0da5c6bf11052d166ebba6052c,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.3.0,scipy==1.6.2,selinux==3.5,sepolicy==3.5,setools==4.4.3,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,sos==4.3,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.4.0,urllib3==1.26.5,WebOb==1.8.7,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==6.1 2023-12-03T11:32:21.862 INFO:teuthology.orchestra.run.smithi131.stdout:py run-test-pre: PYTHONHASHSEED='2390790137' 2023-12-03T11:32:21.862 INFO:teuthology.orchestra.run.smithi131.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2023-12-03T11:32:22.068 INFO:teuthology.orchestra.run.smithi131.stdout:============================= test session starts ============================== 2023-12-03T11:32:22.068 INFO:teuthology.orchestra.run.smithi131.stdout:platform linux -- Python 3.9.17, pytest-7.4.3, pluggy-1.3.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2023-12-03T11:32:22.068 INFO:teuthology.orchestra.run.smithi131.stdout:cachedir: .tox/py/.pytest_cache 2023-12-03T11:32:22.068 INFO:teuthology.orchestra.run.smithi131.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:32:22.068 INFO:teuthology.orchestra.run.smithi131.stdout:configfile: pytest.ini 2023-12-03T11:32:22.168 INFO:teuthology.orchestra.run.smithi131.stdout:collecting ... collected 9 items 2023-12-03T11:32:22.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:32:22.605 INFO:teuthology.orchestra.run.smithi131.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2023-12-03T11:32:23.091 INFO:teuthology.orchestra.run.smithi131.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2023-12-03T11:32:23.523 INFO:teuthology.orchestra.run.smithi131.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2023-12-03T11:32:24.118 INFO:teuthology.orchestra.run.smithi131.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2023-12-03T11:32:24.724 INFO:teuthology.orchestra.run.smithi131.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2023-12-03T11:32:31.140 INFO:teuthology.orchestra.run.smithi131.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2023-12-03T11:32:32.616 INFO:teuthology.orchestra.run.smithi131.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2023-12-03T11:32:33.725 INFO:teuthology.orchestra.run.smithi131.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2023-12-03T11:32:35.852 INFO:teuthology.orchestra.run.smithi131.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2023-12-03T11:32:35.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:32:35.852 INFO:teuthology.orchestra.run.smithi131.stdout:=============================== warnings summary =============================== 2023-12-03T11:32:35.852 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2023-12-03T11:32:35.852 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2023-12-03T11:32:35.852 INFO:teuthology.orchestra.run.smithi131.stdout: import imp 2023-12-03T11:32:35.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:32:35.852 INFO:teuthology.orchestra.run.smithi131.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2023-12-03T11:32:35.852 INFO:teuthology.orchestra.run.smithi131.stdout:======================== 9 passed, 1 warning in 13.78s ========================= 2023-12-03T11:32:35.884 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________________ summary ____________________________________ 2023-12-03T11:32:35.884 INFO:teuthology.orchestra.run.smithi131.stdout: py: commands succeeded 2023-12-03T11:32:35.884 INFO:teuthology.orchestra.run.smithi131.stdout: congratulations :) 2023-12-03T11:32:35.898 INFO:tasks.ragweed:Cleaning up boto... 2023-12-03T11:32:35.899 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /home/ubuntu/cephtest/boto.cfg 2023-12-03T11:32:35.913 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2023-12-03T11:32:35.994 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:32:35.994 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:32:36.005 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.003+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.005+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.005+0000 7f8912325800 20 realm 2023-12-03T11:32:36.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.005+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.005+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.005+0000 7f8912325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:32:36.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.005+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.006+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.006+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.009 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.006+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:32:36.009 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.006+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.009 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.007+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:32:36.009 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.007+0000 7f8912325800 20 searching for the correct realm 2023-12-03T11:32:36.018 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.016+0000 7f890e0e5640 0 -- 172.21.15.131:0/1869507790 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55aba7436740 msgr2=0x55aba7438b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:32:36.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.017+0000 7f8912325800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:32:36.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.017+0000 7f8912325800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:32:36.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.017+0000 7f8912325800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:32:36.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.017+0000 7f8912325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:32:36.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.017+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.017+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.017+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:32:36.021 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 20 zone default found 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 4 Realm: () 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 20 zonegroup default 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.018+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.019+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.019+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.023 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.019+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.023 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.019+0000 7f8912325800 20 started sync module instance, tier type = 2023-12-03T11:32:36.023 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.019+0000 7f8912325800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:32:36.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.025+0000 7f890d8e4640 0 -- 172.21.15.131:0/1869507790 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55aba743b590 msgr2=0x55aba743d980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:32:36.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.028+0000 7f8912325800 20 add_watcher() i=0 2023-12-03T11:32:36.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.028+0000 7f8912325800 20 add_watcher() i=1 2023-12-03T11:32:36.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.028+0000 7f8912325800 20 add_watcher() i=2 2023-12-03T11:32:36.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.028+0000 7f8912325800 20 add_watcher() i=3 2023-12-03T11:32:36.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.028+0000 7f8912325800 20 add_watcher() i=4 2023-12-03T11:32:36.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.028+0000 7f8912325800 20 add_watcher() i=5 2023-12-03T11:32:36.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.028+0000 7f8912325800 20 add_watcher() i=6 2023-12-03T11:32:36.031 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.029+0000 7f8912325800 20 add_watcher() i=7 2023-12-03T11:32:36.031 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.029+0000 7f8912325800 2 all 8 watchers are set, enabling cache 2023-12-03T11:32:36.032 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.030+0000 7f88d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:32:36.033 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.030+0000 7f8912325800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:32:36.033 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.030+0000 7f8912325800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:32:36.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.071+0000 7f8842ffd640 20 reqs_thread_entry: start 2023-12-03T11:32:36.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.071+0000 7f8912325800 20 init_complete bucket index max shards: 1 2023-12-03T11:32:36.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.071+0000 7f8912325800 20 Filter name: none 2023-12-03T11:32:36.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.072+0000 7f8840ff9640 20 reqs_thread_entry: start 2023-12-03T11:32:36.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.072+0000 7f8912325800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2023-12-03T11:32:36.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.072+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.075 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.072+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=452 2023-12-03T11:32:36.075 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.072+0000 7f8912325800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2023-12-03T11:32:36.075 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.072+0000 7f8912325800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2023-12-03T11:32:36.075 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.072+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.075 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.073+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3 : miss 2023-12-03T11:32:36.075 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.073+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.073+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.073+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3 info.flags=0x17 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.073+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3 to cache LRU end 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.073+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.073+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.073+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2023-12-03T11:32:36.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2023-12-03T11:32:36.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2023-12-03T11:32:36.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 20 get_obj_state: octx=0x55aba74abd00 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55aba752c068 s->prefetch_data=0 2023-12-03T11:32:36.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 10 manifest: total_size = 5169 2023-12-03T11:32:36.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.9751762899837586144 2023-12-03T11:32:36.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 20 get_obj_state: octx=0x55aba74abd00 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55aba752c068 s->prefetch_data=0 2023-12-03T11:32:36.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba752c068 2023-12-03T11:32:36.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.074+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3.0 2023-12-03T11:32:36.079 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.077+0000 7f8912325800 20 get_obj_state: octx=0x55aba752cea0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55aba752c068 s->prefetch_data=0 2023-12-03T11:32:36.079 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.077+0000 7f8912325800 10 manifest: total_size = 4902 2023-12-03T11:32:36.079 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.077+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.8781503024376199390 2023-12-03T11:32:36.079 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.077+0000 7f8912325800 20 get_obj_state: octx=0x55aba752cea0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55aba752c068 s->prefetch_data=0 2023-12-03T11:32:36.079 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.077+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba752c068 2023-12-03T11:32:36.079 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.077+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3.0 2023-12-03T11:32:36.080 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.078+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2023-12-03T11:32:36.082 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.079+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.082 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.080+0000 7f8912325800 10 manifest: total_size = 7317 2023-12-03T11:32:36.082 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.080+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.4444825134434099435 2023-12-03T11:32:36.082 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.080+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.082 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.080+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba752bb88 2023-12-03T11:32:36.082 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.080+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3.0 2023-12-03T11:32:36.083 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.080+0000 7f88effff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2023-12-03T11:32:36.084 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.082+0000 7f8912325800 20 get_obj_state: octx=0x7f890809adb0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.084 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.082+0000 7f8912325800 10 manifest: total_size = 4803 2023-12-03T11:32:36.084 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.082+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5154463437920763864 2023-12-03T11:32:36.085 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.082+0000 7f8912325800 20 get_obj_state: octx=0x7f890809adb0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.085 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.082+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba752bb88 2023-12-03T11:32:36.085 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.082+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3.0 2023-12-03T11:32:36.085 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.083+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2023-12-03T11:32:36.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.084+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.085+0000 7f8912325800 10 manifest: total_size = 4880 2023-12-03T11:32:36.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.085+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.2348440335350686530 2023-12-03T11:32:36.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.085+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.085+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba752bb88 2023-12-03T11:32:36.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.085+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3.0 2023-12-03T11:32:36.088 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.086+0000 7f88effff640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2023-12-03T11:32:36.089 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.087+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.090 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.087+0000 7f8912325800 10 manifest: total_size = 4944 2023-12-03T11:32:36.090 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.087+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.18243868834017290153 2023-12-03T11:32:36.090 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.087+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.090 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.087+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba752bb88 2023-12-03T11:32:36.090 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.087+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3.0 2023-12-03T11:32:36.090 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.088+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2023-12-03T11:32:36.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.090+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.090+0000 7f8912325800 10 manifest: total_size = 5077 2023-12-03T11:32:36.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.090+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.3747723914970350712 2023-12-03T11:32:36.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.090+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.090+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba752bb88 2023-12-03T11:32:36.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.090+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3.0 2023-12-03T11:32:36.093 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.091+0000 7f88effff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2023-12-03T11:32:36.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.092+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.092+0000 7f8912325800 10 manifest: total_size = 7647 2023-12-03T11:32:36.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.092+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.15930199924053523725 2023-12-03T11:32:36.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.092+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.092+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba752bb88 2023-12-03T11:32:36.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.092+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3.0 2023-12-03T11:32:36.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.093+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2023-12-03T11:32:36.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.094+0000 7f8912325800 20 get_obj_state: octx=0x55aba74abd00 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.095+0000 7f8912325800 10 manifest: total_size = 37879 2023-12-03T11:32:36.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.095+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.17752158981741965498 2023-12-03T11:32:36.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.095+0000 7f8912325800 20 get_obj_state: octx=0x55aba74abd00 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55aba752bb88 s->prefetch_data=0 2023-12-03T11:32:36.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.095+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba752bb88 2023-12-03T11:32:36.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.095+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3.0 2023-12-03T11:32:36.098 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.096+0000 7f88effff640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2023-12-03T11:32:36.099 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.097+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.099 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.097+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.098+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2023-12-03T11:32:36.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.098+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.098+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.098+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.098+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.098+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.100+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2023-12-03T11:32:36.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.100+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.100+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=204 2023-12-03T11:32:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.100+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2023-12-03T11:32:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.100+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2023-12-03T11:32:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.100+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2023-12-03T11:32:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.100+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2023-12-03T11:32:36.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.101+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791344 cookie 140226454564864 notifier 6042 bl.length()=162 2023-12-03T11:32:36.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.102+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3 from cache 2023-12-03T11:32:36.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.102+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3, ofs0, ns] 2023-12-03T11:32:36.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.103+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791345 cookie 94195734023984 notifier 6042 bl.length()=219 2023-12-03T11:32:36.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.105+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3 : miss 2023-12-03T11:32:36.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.105+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.105+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.105+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3 info.flags=0x0 2023-12-03T11:32:36.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.105+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3 to cache LRU end 2023-12-03T11:32:36.108 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.105+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-conf/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3 from cache 2023-12-03T11:32:36.108 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.105+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-conf/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.3, ofs0, ns] 2023-12-03T11:32:36.108 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.105+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791304 cookie 94195733989872 notifier 6042 bl.length()=216 2023-12-03T11:32:36.109 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.107+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10 : miss 2023-12-03T11:32:36.110 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.107+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.108+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=409 2023-12-03T11:32:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.108+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10 info.flags=0x17 2023-12-03T11:32:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.108+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10 to cache LRU end 2023-12-03T11:32:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.108+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.108+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.108+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10 2023-12-03T11:32:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.109+0000 7f8912325800 10 cls_bucket_list_unordered: got foo 2023-12-03T11:32:36.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.109+0000 7f8912325800 20 get_obj_state: octx=0x7f8904032f00 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55aba74b4968 s->prefetch_data=0 2023-12-03T11:32:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.109+0000 7f8912325800 10 manifest: total_size = 26078 2023-12-03T11:32:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.109+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.17627949303598201122 2023-12-03T11:32:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.109+0000 7f8912325800 20 get_obj_state: octx=0x7f8904032f00 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55aba74b4968 s->prefetch_data=0 2023-12-03T11:32:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.109+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b4968 2023-12-03T11:32:36.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.109+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10.0 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7668 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=7668 rules.size()=4 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7668 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=15340 stripe_ofs=15340 part_ofs=15340 rule->part_size=7671 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4209644 part_ofs=15340 rule->part_size=7671 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=23011 stripe_ofs=23011 part_ofs=23011 rule->part_size=3067 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4217315 part_ofs=23011 rule->part_size=3067 2023-12-03T11:32:36.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=26078 stripe_ofs=26078 part_ofs=26078 rule->part_size=3067 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.17627949303598201122 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10__multipart_foo.2~FMikCYi7PJGeo1V2HYaSLfv0mn14cv9.1 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10__multipart_foo.2~FMikCYi7PJGeo1V2HYaSLfv0mn14cv9.2 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10__multipart_foo.2~FMikCYi7PJGeo1V2HYaSLfv0mn14cv9.3 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10__multipart_foo.2~FMikCYi7PJGeo1V2HYaSLfv0mn14cv9.4 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.111+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.17627949303598201122 2023-12-03T11:32:36.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.112+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo 2023-12-03T11:32:36.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.113+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.113+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.113+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.113+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.113+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.113+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.113+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.115+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2023-12-03T11:32:36.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.115+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.115+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=235 2023-12-03T11:32:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.115+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2023-12-03T11:32:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.115+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2023-12-03T11:32:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.115+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2023-12-03T11:32:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.115+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2023-12-03T11:32:36.118 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.116+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791349 cookie 94195731537744 notifier 6042 bl.length()=191 2023-12-03T11:32:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.117+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10 from cache 2023-12-03T11:32:36.119 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.117+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10, ofs0, ns] 2023-12-03T11:32:36.120 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.118+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791367 cookie 94195734002592 notifier 6042 bl.length()=249 2023-12-03T11:32:36.122 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.120+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10 : miss 2023-12-03T11:32:36.122 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.120+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.123 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.120+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.123 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.120+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10 info.flags=0x0 2023-12-03T11:32:36.123 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.120+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10 to cache LRU end 2023-12-03T11:32:36.123 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.120+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10 from cache 2023-12-03T11:32:36.123 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.120+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10, ofs0, ns] 2023-12-03T11:32:36.123 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.120+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791305 cookie 94195733989872 notifier 6042 bl.length()=246 2023-12-03T11:32:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.123+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11 : miss 2023-12-03T11:32:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.123+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.123+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=416 2023-12-03T11:32:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.123+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11 info.flags=0x17 2023-12-03T11:32:36.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.123+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11 to cache LRU end 2023-12-03T11:32:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.123+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.123+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.123+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11 2023-12-03T11:32:36.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.124+0000 7f8912325800 10 cls_bucket_list_unordered: got foo 2023-12-03T11:32:36.127 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.124+0000 7f8912325800 20 get_obj_state: octx=0x7f89040588f0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55aba74b4798 s->prefetch_data=0 2023-12-03T11:32:36.127 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.124+0000 7f8912325800 10 manifest: total_size = 26079 2023-12-03T11:32:36.127 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.124+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.9094749125019936615 2023-12-03T11:32:36.127 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.124+0000 7f8912325800 20 get_obj_state: octx=0x7f89040588f0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55aba74b4798 s->prefetch_data=0 2023-12-03T11:32:36.127 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.124+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b4798 2023-12-03T11:32:36.127 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.124+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11.0 2023-12-03T11:32:36.128 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2023-12-03T11:32:36.128 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7670 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7670 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=15342 stripe_ofs=15342 part_ofs=15342 rule->part_size=7670 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=3 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4209646 part_ofs=15342 rule->part_size=7670 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=23012 stripe_ofs=23012 part_ofs=23012 rule->part_size=3067 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=3 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4217316 part_ofs=23012 rule->part_size=3067 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=26079 stripe_ofs=26079 part_ofs=26079 rule->part_size=3067 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.9094749125019936615 2023-12-03T11:32:36.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11__multipart_foo.2~ZWkKaTHaD9J2VGmReBja2liialKrjgW.1 2023-12-03T11:32:36.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2023-12-03T11:32:36.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11__multipart_foo.2~ZWkKaTHaD9J2VGmReBja2liialKrjgW.2 2023-12-03T11:32:36.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2023-12-03T11:32:36.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11__multipart_foo.2~ZWkKaTHaD9J2VGmReBja2liialKrjgW.3 2023-12-03T11:32:36.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2023-12-03T11:32:36.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11__multipart_foo.2~ZWkKaTHaD9J2VGmReBja2liialKrjgW.4 2023-12-03T11:32:36.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2023-12-03T11:32:36.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.126+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.9094749125019936615 2023-12-03T11:32:36.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.127+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo 2023-12-03T11:32:36.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.127+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.127+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.128+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.128+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.128+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.128+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.128+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.129+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2023-12-03T11:32:36.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.129+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.129+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=242 2023-12-03T11:32:36.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.129+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2023-12-03T11:32:36.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.129+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2023-12-03T11:32:36.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.129+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2023-12-03T11:32:36.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.129+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2023-12-03T11:32:36.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.130+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791310 cookie 94195734020240 notifier 6042 bl.length()=198 2023-12-03T11:32:36.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.131+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11 from cache 2023-12-03T11:32:36.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.131+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11, ofs0, ns] 2023-12-03T11:32:36.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.131+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791306 cookie 94195733989872 notifier 6042 bl.length()=256 2023-12-03T11:32:36.136 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.134+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11 : miss 2023-12-03T11:32:36.136 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.134+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.134+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.134+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11 info.flags=0x0 2023-12-03T11:32:36.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.134+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11 to cache LRU end 2023-12-03T11:32:36.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.134+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11 from cache 2023-12-03T11:32:36.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.134+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11, ofs0, ns] 2023-12-03T11:32:36.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.135+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791346 cookie 140226454564864 notifier 6042 bl.length()=253 2023-12-03T11:32:36.139 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.137+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9 : miss 2023-12-03T11:32:36.139 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.137+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.138+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=409 2023-12-03T11:32:36.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.138+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9 info.flags=0x17 2023-12-03T11:32:36.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.138+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9 to cache LRU end 2023-12-03T11:32:36.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.138+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.138+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.138+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9 2023-12-03T11:32:36.141 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.138+0000 7f8912325800 10 cls_bucket_list_unordered: got foo[254neoXiL.dF-PVw1fqM2iVFy5iw.Xq] 2023-12-03T11:32:36.141 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.138+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9.0 2023-12-03T11:32:36.141 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.139+0000 7f8912325800 20 get_obj_state: octx=0x55aba74b36d0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55aba74b78d8 s->prefetch_data=0 2023-12-03T11:32:36.141 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.139+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to ij70m2rhfjwaqghb5lzx27x8mwmun6hw 2023-12-03T11:32:36.141 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.139+0000 7f8912325800 20 get_obj_state_impl: setting s->olh_tag to zzn85movlj98v8ym2qp27p3zy00ypjkc 2023-12-03T11:32:36.141 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.139+0000 7f8912325800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zzn85movlj98v8ym2qp27p3zy00ypjkc 2023-12-03T11:32:36.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.140+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9.0 2023-12-03T11:32:36.143 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.141+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9.0 2023-12-03T11:32:36.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.141+0000 7f8912325800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2023-12-03T11:32:36.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.141+0000 7f8912325800 20 olh_log_entry: epoch=3 op=3 key=foo[254neoXiL.dF-PVw1fqM2iVFy5iw.Xq] 2023-12-03T11:32:36.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.141+0000 7f8912325800 20 get_obj_state: octx=0x55aba74b36d0 obj=test-client.0-r-test-multipart-index-versioning.1:_:254neoXiL.dF-PVw1fqM2iVFy5iw.Xq_foo state=0x55aba74c31a8 s->prefetch_data=0 2023-12-03T11:32:36.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.142+0000 7f8912325800 10 manifest: total_size = 1667 2023-12-03T11:32:36.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.142+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.11961548536981559784 2023-12-03T11:32:36.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.142+0000 7f8912325800 20 get_obj_state: octx=0x55aba74b36d0 obj=test-client.0-r-test-multipart-index-versioning.1:_:254neoXiL.dF-PVw1fqM2iVFy5iw.Xq_foo state=0x55aba74c31a8 s->prefetch_data=0 2023-12-03T11:32:36.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.142+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74c31a8 2023-12-03T11:32:36.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.142+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9.0 2023-12-03T11:32:36.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2023-12-03T11:32:36.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2023-12-03T11:32:36.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2023-12-03T11:32:36.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2023-12-03T11:32:36.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2023-12-03T11:32:36.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2023-12-03T11:32:36.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2023-12-03T11:32:36.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2023-12-03T11:32:36.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.11961548536981559784 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9__multipart_foo.2~6byy5mJJVuyLzvcu8WGDvQ9zWvN0GlB.1 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9__multipart_foo.2~6byy5mJJVuyLzvcu8WGDvQ9zWvN0GlB.2 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9__multipart_foo.2~6byy5mJJVuyLzvcu8WGDvQ9zWvN0GlB.3 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9__multipart_foo.2~6byy5mJJVuyLzvcu8WGDvQ9zWvN0GlB.4 2023-12-03T11:32:36.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2023-12-03T11:32:36.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.145+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.11961548536981559784 2023-12-03T11:32:36.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.146+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo[254neoXiL.dF-PVw1fqM2iVFy5iw.Xq] 2023-12-03T11:32:36.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.147+0000 7f8912325800 20 get_obj_state: octx=0x55aba74b36d0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55aba74b78d8 s->prefetch_data=0 2023-12-03T11:32:36.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.148+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9.0 2023-12-03T11:32:36.151 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.149+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9.0 2023-12-03T11:32:36.151 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.149+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.151 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.149+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.151 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.149+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.151 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.149+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.149+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.149+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.149+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.150+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2023-12-03T11:32:36.152 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.150+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.153+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=235 2023-12-03T11:32:36.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.153+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2023-12-03T11:32:36.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.153+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2023-12-03T11:32:36.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.153+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2023-12-03T11:32:36.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.153+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2023-12-03T11:32:36.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.153+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791311 cookie 94195734020240 notifier 6042 bl.length()=193 2023-12-03T11:32:36.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.155+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9 from cache 2023-12-03T11:32:36.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.155+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9, ofs0, ns] 2023-12-03T11:32:36.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.155+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791347 cookie 140226454564864 notifier 6042 bl.length()=250 2023-12-03T11:32:36.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.158+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9 : miss 2023-12-03T11:32:36.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.158+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.159+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.159+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9 info.flags=0x0 2023-12-03T11:32:36.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.159+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9 to cache LRU end 2023-12-03T11:32:36.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.159+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9 from cache 2023-12-03T11:32:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.159+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9, ofs0, ns] 2023-12-03T11:32:36.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.159+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791309 cookie 94195734006560 notifier 6042 bl.length()=247 2023-12-03T11:32:36.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.160+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8 : miss 2023-12-03T11:32:36.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.160+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.161+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=399 2023-12-03T11:32:36.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.161+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8 info.flags=0x17 2023-12-03T11:32:36.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.161+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8 to cache LRU end 2023-12-03T11:32:36.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.161+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.161+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.161+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8 2023-12-03T11:32:36.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.161+0000 7f8912325800 10 cls_bucket_list_unordered: got foo 2023-12-03T11:32:36.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.161+0000 7f8912325800 20 get_obj_state: octx=0x55aba7466a90 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55aba74b78d8 s->prefetch_data=0 2023-12-03T11:32:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.162+0000 7f8912325800 10 manifest: total_size = 1667 2023-12-03T11:32:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.162+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.12047795217514962846 2023-12-03T11:32:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.162+0000 7f8912325800 20 get_obj_state: octx=0x55aba7466a90 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55aba74b78d8 s->prefetch_data=0 2023-12-03T11:32:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.162+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b78d8 2023-12-03T11:32:36.165 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.162+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8.0 2023-12-03T11:32:36.166 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.12047795217514962846 2023-12-03T11:32:36.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8__multipart_foo.2~SiZvIErWT9OEj2-3Foob821-UsW-xEZ.1 2023-12-03T11:32:36.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2023-12-03T11:32:36.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8__multipart_foo.2~SiZvIErWT9OEj2-3Foob821-UsW-xEZ.2 2023-12-03T11:32:36.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2023-12-03T11:32:36.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8__multipart_foo.2~SiZvIErWT9OEj2-3Foob821-UsW-xEZ.3 2023-12-03T11:32:36.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2023-12-03T11:32:36.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8__multipart_foo.2~SiZvIErWT9OEj2-3Foob821-UsW-xEZ.4 2023-12-03T11:32:36.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2023-12-03T11:32:36.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.164+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.12047795217514962846 2023-12-03T11:32:36.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.165+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo 2023-12-03T11:32:36.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.165+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.165+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.166+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.166+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.166+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.166+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.166+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.167+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2023-12-03T11:32:36.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.167+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.168+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=225 2023-12-03T11:32:36.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.168+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2023-12-03T11:32:36.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.168+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2023-12-03T11:32:36.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.168+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2023-12-03T11:32:36.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.168+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2023-12-03T11:32:36.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.168+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791348 cookie 94195734023984 notifier 6042 bl.length()=183 2023-12-03T11:32:36.172 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.170+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8 from cache 2023-12-03T11:32:36.172 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.170+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8, ofs0, ns] 2023-12-03T11:32:36.172 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.170+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791312 cookie 94195734020240 notifier 6042 bl.length()=240 2023-12-03T11:32:36.175 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.172+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8 : miss 2023-12-03T11:32:36.175 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.172+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.175 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.172+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.175 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.172+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8 info.flags=0x0 2023-12-03T11:32:36.175 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.172+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8 to cache LRU end 2023-12-03T11:32:36.175 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.172+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8 from cache 2023-12-03T11:32:36.175 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.172+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-multipart-simple.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8, ofs0, ns] 2023-12-03T11:32:36.175 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.173+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791350 cookie 94195731537744 notifier 6042 bl.length()=237 2023-12-03T11:32:36.177 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.175+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14 : miss 2023-12-03T11:32:36.177 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.175+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.178 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.175+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=407 2023-12-03T11:32:36.178 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.175+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14 info.flags=0x17 2023-12-03T11:32:36.178 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.175+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14 to cache LRU end 2023-12-03T11:32:36.178 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.175+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.178 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.175+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.178 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.175+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14 2023-12-03T11:32:36.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:32:36.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2023-12-03T11:32:36.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2023-12-03T11:32:36.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2023-12-03T11:32:36.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 20 get_obj_state: octx=0x55aba74b6010 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 10 manifest: total_size = 5242880 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5271524334018589573 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 20 get_obj_state: octx=0x55aba74b6010 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b0068 2023-12-03T11:32:36.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.176+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5271524334018589573 2023-12-03T11:32:36.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_0 2023-12-03T11:32:36.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2023-12-03T11:32:36.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_1 2023-12-03T11:32:36.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2023-12-03T11:32:36.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.178+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5271524334018589573 2023-12-03T11:32:36.183 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.179+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:32:36.183 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.180+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.183 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.180+0000 7f8912325800 10 manifest: total_size = 5242880 2023-12-03T11:32:36.183 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.180+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.183 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.180+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.183 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.180+0000 7f8912325800 10 generate_fake_tag new tag=e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_1_e94b7b386bae7e286c521e5a0f5fa0a5 2023-12-03T11:32:36.183 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.180+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_1_e94b7b386bae7e286c521e5a0f5fa0a5 2023-12-03T11:32:36.183 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.180+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.184 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.180+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74ba3b8 2023-12-03T11:32:36.184 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.180+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.184 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_1_e94b7b386bae7e286c521e5a0f5fa0a5 2023-12-03T11:32:36.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_0 2023-12-03T11:32:36.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2023-12-03T11:32:36.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_1 2023-12-03T11:32:36.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2023-12-03T11:32:36.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.182+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_1_e94b7b386bae7e286c521e5a0f5fa0a5 2023-12-03T11:32:36.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.183+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2023-12-03T11:32:36.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.183+0000 7f8912325800 20 get_obj_state: octx=0x7f8900053d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.184+0000 7f8912325800 10 manifest: total_size = 5242880 2023-12-03T11:32:36.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.184+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _QW5Hyxy-YE4TogqiI4atEacuuy4V6us 2023-12-03T11:32:36.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.184+0000 7f8912325800 20 get_obj_state: octx=0x7f8900053d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.184+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74ba3b8 2023-12-03T11:32:36.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.184+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _QW5Hyxy-YE4TogqiI4atEacuuy4V6us 2023-12-03T11:32:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.iRQs5npP1swDaw1MQ-fc447VlXiiBUv_0 2023-12-03T11:32:36.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:32:36.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.iRQs5npP1swDaw1MQ-fc447VlXiiBUv_1 2023-12-03T11:32:36.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2023-12-03T11:32:36.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.186+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _QW5Hyxy-YE4TogqiI4atEacuuy4V6us 2023-12-03T11:32:36.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.187+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2023-12-03T11:32:36.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.187+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.187+0000 7f8912325800 10 manifest: total_size = 5242880 2023-12-03T11:32:36.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.187+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _LNvUxy-yFKSiQlmIXL8s0it1EeVQhnu 2023-12-03T11:32:36.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.187+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.187+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b0068 2023-12-03T11:32:36.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.187+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.190+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.190+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.190+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _LNvUxy-yFKSiQlmIXL8s0it1EeVQhnu 2023-12-03T11:32:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.190+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.190+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.HHR66Du9Rag-ddmjOtIbnk59McZumOh_1 2023-12-03T11:32:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.190+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:32:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.190+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.190+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: _LNvUxy-yFKSiQlmIXL8s0it1EeVQhnu 2023-12-03T11:32:36.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.191+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2023-12-03T11:32:36.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.191+0000 7f8912325800 20 get_obj_state: octx=0x7f89040588f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.192+0000 7f8912325800 10 manifest: total_size = 5242880 2023-12-03T11:32:36.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.192+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.13084760535153956898 2023-12-03T11:32:36.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.192+0000 7f8912325800 20 get_obj_state: octx=0x7f89040588f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.192+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b0068 2023-12-03T11:32:36.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.192+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.13084760535153956898 2023-12-03T11:32:36.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_0 2023-12-03T11:32:36.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2023-12-03T11:32:36.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_1 2023-12-03T11:32:36.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2023-12-03T11:32:36.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.195+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.13084760535153956898 2023-12-03T11:32:36.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.196+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:32:36.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.196+0000 7f8912325800 20 get_obj_state: octx=0x7f89040588f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.196+0000 7f8912325800 10 manifest: total_size = 5242880 2023-12-03T11:32:36.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.196+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _qK2HaIozd7yOcUaU-QTyhGshxi25wGm 2023-12-03T11:32:36.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.196+0000 7f8912325800 20 get_obj_state: octx=0x7f89040588f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.196+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74ba3b8 2023-12-03T11:32:36.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.196+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _qK2HaIozd7yOcUaU-QTyhGshxi25wGm 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.EMVBJovahn52kXvrvMxsqy05taFGSdE_0 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.EMVBJovahn52kXvrvMxsqy05taFGSdE_1 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.197+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _qK2HaIozd7yOcUaU-QTyhGshxi25wGm 2023-12-03T11:32:36.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.199+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2023-12-03T11:32:36.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.199+0000 7f8912325800 20 get_obj_state: octx=0x7f8900053d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.199+0000 7f8912325800 10 manifest: total_size = 5242880 2023-12-03T11:32:36.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.199+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.199+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.199+0000 7f8912325800 10 generate_fake_tag new tag=e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_1_c05f3760774cc0a38df3ccd30f22ae13 2023-12-03T11:32:36.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.199+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_1_c05f3760774cc0a38df3ccd30f22ae13 2023-12-03T11:32:36.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.199+0000 7f8912325800 20 get_obj_state: octx=0x7f8900053d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.199+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74ba3b8 2023-12-03T11:32:36.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.199+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_1_c05f3760774cc0a38df3ccd30f22ae13 2023-12-03T11:32:36.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_0 2023-12-03T11:32:36.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2023-12-03T11:32:36.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_1 2023-12-03T11:32:36.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 637 2023-12-03T11:32:36.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.205 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.201+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_1_c05f3760774cc0a38df3ccd30f22ae13 2023-12-03T11:32:36.205 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.203+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2023-12-03T11:32:36.205 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.204+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55aba74c3498 s->prefetch_data=0 2023-12-03T11:32:36.205 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.204+0000 7f8912325800 10 manifest: total_size = 5242880 2023-12-03T11:32:36.205 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.204+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _kG2CoJ9py5fh7X5M8pDYaKu1A9lqPVq 2023-12-03T11:32:36.206 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.204+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55aba74c3498 s->prefetch_data=0 2023-12-03T11:32:36.206 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.204+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74c3498 2023-12-03T11:32:36.206 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.204+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.208 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.206+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.208 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.206+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.208 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.206+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _kG2CoJ9py5fh7X5M8pDYaKu1A9lqPVq 2023-12-03T11:32:36.208 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.206+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.208 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.206+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XFMqKa2m_eTXdW7IAikO_TlT4Ib2KOM_1 2023-12-03T11:32:36.208 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.206+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:32:36.208 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.206+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.208 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.206+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _kG2CoJ9py5fh7X5M8pDYaKu1A9lqPVq 2023-12-03T11:32:36.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.207+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2023-12-03T11:32:36.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.207+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55aba74c3498 s->prefetch_data=0 2023-12-03T11:32:36.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.207+0000 7f8912325800 10 manifest: total_size = 324647 2023-12-03T11:32:36.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.207+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.4130265068458123312 2023-12-03T11:32:36.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.207+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55aba74c3498 s->prefetch_data=0 2023-12-03T11:32:36.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.207+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74c3498 2023-12-03T11:32:36.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.207+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.209+0000 7f8912325800 20 get_obj_state: octx=0x7f89040588f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55aba74c3498 s->prefetch_data=0 2023-12-03T11:32:36.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.211+0000 7f8912325800 10 manifest: total_size = 324647 2023-12-03T11:32:36.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.211+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _mfIKbIlIj_nYGogsBlqbeYLe0DJWmyn 2023-12-03T11:32:36.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.211+0000 7f8912325800 20 get_obj_state: octx=0x7f89040588f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55aba74c3498 s->prefetch_data=0 2023-12-03T11:32:36.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.211+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74c3498 2023-12-03T11:32:36.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.211+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.213 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.211+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:32:36.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.213+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.213+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.213+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _mfIKbIlIj_nYGogsBlqbeYLe0DJWmyn 2023-12-03T11:32:36.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.213+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.213+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.4fIM7XgaN-wD0Qnmpnz9moXL8DccPUg_0 2023-12-03T11:32:36.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.213+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:32:36.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.213+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.213+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _mfIKbIlIj_nYGogsBlqbeYLe0DJWmyn 2023-12-03T11:32:36.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.214+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2023-12-03T11:32:36.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.214+0000 7f8912325800 20 get_obj_state: octx=0x7f8900053d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55aba74c3498 s->prefetch_data=0 2023-12-03T11:32:36.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.214+0000 7f8912325800 10 manifest: total_size = 324647 2023-12-03T11:32:36.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.214+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _R10iUirduu5aglEXeujFi_ADQJXLkgb 2023-12-03T11:32:36.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.214+0000 7f8912325800 20 get_obj_state: octx=0x7f8900053d60 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55aba74c3498 s->prefetch_data=0 2023-12-03T11:32:36.216 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.214+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74c3498 2023-12-03T11:32:36.216 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.214+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.216+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.216+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.216+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _R10iUirduu5aglEXeujFi_ADQJXLkgb 2023-12-03T11:32:36.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.216+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.216+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.vd4yWGRT-x9rcgbyw28EKVo_NbCs0pw_0 2023-12-03T11:32:36.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.216+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:32:36.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.216+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.216+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _R10iUirduu5aglEXeujFi_ADQJXLkgb 2023-12-03T11:32:36.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.216+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2023-12-03T11:32:36.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.216+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55aba74c3498 s->prefetch_data=0 2023-12-03T11:32:36.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.218+0000 7f8912325800 10 manifest: total_size = 324647 2023-12-03T11:32:36.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.218+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _HbtCuv3_h8rUzMIsBpBcy5mdSnFkC9u 2023-12-03T11:32:36.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.218+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55aba74c3498 s->prefetch_data=0 2023-12-03T11:32:36.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.218+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74c3498 2023-12-03T11:32:36.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.218+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14.0 2023-12-03T11:32:36.221 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.219+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.221 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.219+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.221+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2023-12-03T11:32:36.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.221+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.221+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.221+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.221+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.221+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.223+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2023-12-03T11:32:36.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.223+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.223+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=233 2023-12-03T11:32:36.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.223+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2023-12-03T11:32:36.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.223+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2023-12-03T11:32:36.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.223+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2023-12-03T11:32:36.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.223+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2023-12-03T11:32:36.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.223+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791313 cookie 94195734020240 notifier 6042 bl.length()=189 2023-12-03T11:32:36.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.225+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14 from cache 2023-12-03T11:32:36.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.225+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14, ofs0, ns] 2023-12-03T11:32:36.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.225+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791351 cookie 94195731537744 notifier 6042 bl.length()=247 2023-12-03T11:32:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.228+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14 : miss 2023-12-03T11:32:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.228+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.228+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.228+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14 info.flags=0x0 2023-12-03T11:32:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.228+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14 to cache LRU end 2023-12-03T11:32:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.228+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14 from cache 2023-12-03T11:32:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.228+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14, ofs0, ns] 2023-12-03T11:32:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.228+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791368 cookie 94195734002592 notifier 6042 bl.length()=244 2023-12-03T11:32:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.231+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15 : miss 2023-12-03T11:32:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.231+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.231+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=417 2023-12-03T11:32:36.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.231+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15 info.flags=0x17 2023-12-03T11:32:36.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.231+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15 to cache LRU end 2023-12-03T11:32:36.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.231+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.231+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.231+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15 2023-12-03T11:32:36.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:32:36.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2023-12-03T11:32:36.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2023-12-03T11:32:36.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2023-12-03T11:32:36.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 20 get_obj_state: octx=0x55aba7226a50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55aba74c2428 s->prefetch_data=0 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 10 manifest: total_size = 11534336 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.8298350690821543643 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 20 get_obj_state: octx=0x55aba7226a50 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55aba74c2428 s->prefetch_data=0 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74c2428 2023-12-03T11:32:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.232+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.234+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.234+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.234+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.234+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.234+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.234+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.234+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.234+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.234+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.8298350690821543643 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1_1 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.2 2023-12-03T11:32:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2023-12-03T11:32:36.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.2_1 2023-12-03T11:32:36.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2023-12-03T11:32:36.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.3 2023-12-03T11:32:36.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2023-12-03T11:32:36.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.235+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.8298350690821543643 2023-12-03T11:32:36.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.236+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:32:36.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.236+0000 7f8912325800 20 get_obj_state: octx=0x7f890809adb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55aba74c2428 s->prefetch_data=0 2023-12-03T11:32:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.236+0000 7f8912325800 10 manifest: total_size = 11534336 2023-12-03T11:32:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.236+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.236+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.236+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.236+0000 7f8912325800 10 generate_fake_tag new tag=e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1_1_f171fd454953567d435081b2da6e1aaa 2023-12-03T11:32:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.236+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1_1_f171fd454953567d435081b2da6e1aaa 2023-12-03T11:32:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.236+0000 7f8912325800 20 get_obj_state: octx=0x7f890809adb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55aba74c2428 s->prefetch_data=0 2023-12-03T11:32:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.236+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74c2428 2023-12-03T11:32:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.236+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1_1_f171fd454953567d435081b2da6e1aaa 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1_1 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 705 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.2 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 972 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.2_1 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1237 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.3 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1504 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.238+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1_1_f171fd454953567d435081b2da6e1aaa 2023-12-03T11:32:36.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.239+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2023-12-03T11:32:36.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.239+0000 7f8912325800 20 get_obj_state: octx=0x55aba74b8120 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.240+0000 7f8912325800 10 manifest: total_size = 11534336 2023-12-03T11:32:36.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.240+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _B-0h3ZfAT1Z4JifgnsqVXlSGKD1OOUl 2023-12-03T11:32:36.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.240+0000 7f8912325800 20 get_obj_state: octx=0x55aba74b8120 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.240+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74bb7d8 2023-12-03T11:32:36.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.240+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _B-0h3ZfAT1Z4JifgnsqVXlSGKD1OOUl 2023-12-03T11:32:36.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.yokuwA3Z4Ch5zvDr7aU_Q5FY3b2nV43_0 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.yokuwA3Z4Ch5zvDr7aU_Q5FY3b2nV43_1 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.yokuwA3Z4Ch5zvDr7aU_Q5FY3b2nV43_2 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.241+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: _B-0h3ZfAT1Z4JifgnsqVXlSGKD1OOUl 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.242+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.243+0000 7f8912325800 20 get_obj_state: octx=0x7f890809adb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55aba74c7008 s->prefetch_data=0 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.243+0000 7f8912325800 10 manifest: total_size = 11534336 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.243+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _jXvf-9LIczF_aHjv1OlHJDg77XyedSQ 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.243+0000 7f8912325800 20 get_obj_state: octx=0x7f890809adb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55aba74c7008 s->prefetch_data=0 2023-12-03T11:32:36.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.243+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74c7008 2023-12-03T11:32:36.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.243+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _jXvf-9LIczF_aHjv1OlHJDg77XyedSQ 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.SqT69W-GTPozkPxAOQW8ZAtUOLCYTpa_1 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.SqT69W-GTPozkPxAOQW8ZAtUOLCYTpa_2 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.246+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _jXvf-9LIczF_aHjv1OlHJDg77XyedSQ 2023-12-03T11:32:36.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.248+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2023-12-03T11:32:36.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.248+0000 7f8912325800 20 get_obj_state: octx=0x7f89080ca720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.248+0000 7f8912325800 10 manifest: total_size = 11534336 2023-12-03T11:32:36.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.248+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16800743192974281694 2023-12-03T11:32:36.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.248+0000 7f8912325800 20 get_obj_state: octx=0x7f89080ca720 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.248+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b0068 2023-12-03T11:32:36.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.248+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:32:36.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16800743192974281694 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1_1 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.2 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.2_1 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.3 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.250+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16800743192974281694 2023-12-03T11:32:36.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.251+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:32:36.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.252+0000 7f8912325800 20 get_obj_state: octx=0x7f890005f8a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.252+0000 7f8912325800 10 manifest: total_size = 11534336 2023-12-03T11:32:36.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.252+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _mvmdcI3ia4u_sPbLxfbqeoyMw6vpFFL 2023-12-03T11:32:36.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.252+0000 7f8912325800 20 get_obj_state: octx=0x7f890005f8a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.252+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74bb7d8 2023-12-03T11:32:36.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.252+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _mvmdcI3ia4u_sPbLxfbqeoyMw6vpFFL 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.aeGs4R3I5SvIi90ARLoGVY-FLPqNI-5_0 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.aeGs4R3I5SvIi90ARLoGVY-FLPqNI-5_1 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.aeGs4R3I5SvIi90ARLoGVY-FLPqNI-5_2 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.254+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _mvmdcI3ia4u_sPbLxfbqeoyMw6vpFFL 2023-12-03T11:32:36.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.255+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2023-12-03T11:32:36.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.255+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.256+0000 7f8912325800 10 manifest: total_size = 11534336 2023-12-03T11:32:36.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.256+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.256+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.256+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.256+0000 7f8912325800 10 generate_fake_tag new tag=e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1_1_71792e87a1037cb3cf2314f637fcca07 2023-12-03T11:32:36.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.256+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1_1_71792e87a1037cb3cf2314f637fcca07 2023-12-03T11:32:36.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.256+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.256+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74bb7d8 2023-12-03T11:32:36.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.256+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:32:36.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1_1_71792e87a1037cb3cf2314f637fcca07 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 448 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1_1 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 719 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.2 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 992 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.2_1 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1263 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.3 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1536 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.258+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1_1_71792e87a1037cb3cf2314f637fcca07 2023-12-03T11:32:36.262 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.259+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2023-12-03T11:32:36.262 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.259+0000 7f8912325800 20 get_obj_state: octx=0x55aba74adde0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.262 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.260+0000 7f8912325800 10 manifest: total_size = 11534336 2023-12-03T11:32:36.262 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.260+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _7TVMZLLsLvPYootC8rimez94JbmRr5U 2023-12-03T11:32:36.262 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.260+0000 7f8912325800 20 get_obj_state: octx=0x55aba74adde0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.262 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.260+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74bb7d8 2023-12-03T11:32:36.263 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.260+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _7TVMZLLsLvPYootC8rimez94JbmRr5U 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.iwfMTx2D-FIPkfHZU9CrY0W61shaLPP_1 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.iwfMTx2D-FIPkfHZU9CrY0W61shaLPP_2 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.263+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _7TVMZLLsLvPYootC8rimez94JbmRr5U 2023-12-03T11:32:36.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.264+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2023-12-03T11:32:36.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.265+0000 7f8912325800 20 get_obj_state: octx=0x7f8904055830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.265+0000 7f8912325800 10 manifest: total_size = 541681 2023-12-03T11:32:36.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.265+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16295689000518239563 2023-12-03T11:32:36.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.265+0000 7f8912325800 20 get_obj_state: octx=0x7f8904055830 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.267 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.265+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74bb7d8 2023-12-03T11:32:36.267 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.265+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.268 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-12-03T11:32:36.268 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2023-12-03T11:32:36.268 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16295689000518239563 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.1 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.2 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.3 2023-12-03T11:32:36.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2023-12-03T11:32:36.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.267+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16295689000518239563 2023-12-03T11:32:36.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.268+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:32:36.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.268+0000 7f8912325800 20 get_obj_state: octx=0x7f890005f8a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55aba74c4a98 s->prefetch_data=0 2023-12-03T11:32:36.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.269+0000 7f8912325800 10 manifest: total_size = 541681 2023-12-03T11:32:36.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.269+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _b_YgbPZ-0m4i-sMyD-vE4HYlYUoH8Mn 2023-12-03T11:32:36.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.269+0000 7f8912325800 20 get_obj_state: octx=0x7f890005f8a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55aba74c4a98 s->prefetch_data=0 2023-12-03T11:32:36.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.269+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74c4a98 2023-12-03T11:32:36.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.269+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.270+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.270+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.270+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _b_YgbPZ-0m4i-sMyD-vE4HYlYUoH8Mn 2023-12-03T11:32:36.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.270+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.270+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.P9CPXSErY_RrQhYJ28acLqBplEtZ-wJ_0 2023-12-03T11:32:36.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.270+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2023-12-03T11:32:36.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.270+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.270+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _b_YgbPZ-0m4i-sMyD-vE4HYlYUoH8Mn 2023-12-03T11:32:36.273 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.271+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2023-12-03T11:32:36.273 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.272+0000 7f8912325800 20 get_obj_state: octx=0x7f890005b5f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.273 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.272+0000 7f8912325800 10 manifest: total_size = 541681 2023-12-03T11:32:36.273 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.272+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to _YKZVoPFnUIHvXLHc1yMo8zUL1MrvnZq 2023-12-03T11:32:36.274 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.272+0000 7f8912325800 20 get_obj_state: octx=0x7f890005b5f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.274 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.272+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74bb7d8 2023-12-03T11:32:36.274 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.272+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.275 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.274+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.275 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.274+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.276 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.274+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: _YKZVoPFnUIHvXLHc1yMo8zUL1MrvnZq 2023-12-03T11:32:36.276 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.274+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.276 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.274+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.8rrkmXXUjBBkO0P92Sskt9CriqRroh4_0 2023-12-03T11:32:36.276 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.274+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2023-12-03T11:32:36.276 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.274+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.276 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.274+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _YKZVoPFnUIHvXLHc1yMo8zUL1MrvnZq 2023-12-03T11:32:36.276 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.275+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2023-12-03T11:32:36.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.276+0000 7f8912325800 20 get_obj_state: octx=0x7f890005f8a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.276+0000 7f8912325800 10 manifest: total_size = 541681 2023-12-03T11:32:36.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.276+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-12-03T11:32:36.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.276+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2023-12-03T11:32:36.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.276+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2023-12-03T11:32:36.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.276+0000 7f8912325800 10 generate_fake_tag new tag=e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.2_2d3fffd1c7b44ef64df74495a8668b76 2023-12-03T11:32:36.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.276+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.2_2d3fffd1c7b44ef64df74495a8668b76 2023-12-03T11:32:36.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.276+0000 7f8912325800 20 get_obj_state: octx=0x7f890005f8a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55aba74bb7d8 s->prefetch_data=0 2023-12-03T11:32:36.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.276+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74bb7d8 2023-12-03T11:32:36.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.276+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15.0 2023-12-03T11:32:36.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-12-03T11:32:36.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2023-12-03T11:32:36.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2023-12-03T11:32:36.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2023-12-03T11:32:36.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2023-12-03T11:32:36.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2023-12-03T11:32:36.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=49187 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.2_2d3fffd1c7b44ef64df74495a8668b76 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.1 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.2 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 704 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.3 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 968 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.278+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.2_2d3fffd1c7b44ef64df74495a8668b76 2023-12-03T11:32:36.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.279+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2023-12-03T11:32:36.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.279+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.279+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.279+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.279+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.279+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.279+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.279+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.281+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2023-12-03T11:32:36.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.281+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.281+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=243 2023-12-03T11:32:36.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.281+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2023-12-03T11:32:36.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.281+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2023-12-03T11:32:36.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.281+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2023-12-03T11:32:36.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.281+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2023-12-03T11:32:36.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.281+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791307 cookie 94195733989872 notifier 6042 bl.length()=199 2023-12-03T11:32:36.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.283+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15 from cache 2023-12-03T11:32:36.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.283+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15, ofs0, ns] 2023-12-03T11:32:36.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.283+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791349 cookie 94195734023984 notifier 6042 bl.length()=257 2023-12-03T11:32:36.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.286+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15 : miss 2023-12-03T11:32:36.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.286+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.286+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.286+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15 info.flags=0x0 2023-12-03T11:32:36.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.286+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15 to cache LRU end 2023-12-03T11:32:36.288 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.286+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15 from cache 2023-12-03T11:32:36.288 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.286+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15, ofs0, ns] 2023-12-03T11:32:36.288 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.286+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791352 cookie 94195731537744 notifier 6042 bl.length()=254 2023-12-03T11:32:36.290 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.288+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13 : miss 2023-12-03T11:32:36.290 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.288+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.290 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.289+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=412 2023-12-03T11:32:36.290 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.289+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13 info.flags=0x17 2023-12-03T11:32:36.291 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.289+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13 to cache LRU end 2023-12-03T11:32:36.291 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.289+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.291 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.289+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.291 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.289+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13 2023-12-03T11:32:36.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.290+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:32:36.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.290+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:32:36.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.290+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:32:36.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.290+0000 7f8912325800 20 get_obj_state: octx=0x55aba7466a90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.290+0000 7f8912325800 10 manifest: total_size = 11534336 2023-12-03T11:32:36.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.290+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.13888465163181493438 2023-12-03T11:32:36.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.290+0000 7f8912325800 20 get_obj_state: octx=0x55aba7466a90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.290+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b0068 2023-12-03T11:32:36.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.290+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13.0 2023-12-03T11:32:36.294 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.294 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.294 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.294 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.294 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.294 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.294 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.294 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.13888465163181493438 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-FROZEN.2~XFXtAZImSVaPrP0k0BKqSXaHaRIE1HU.1 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__shadow_foo-FROZEN.2~XFXtAZImSVaPrP0k0BKqSXaHaRIE1HU.1_1 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-FROZEN.2~XFXtAZImSVaPrP0k0BKqSXaHaRIE1HU.2 2023-12-03T11:32:36.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2023-12-03T11:32:36.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__shadow_foo-FROZEN.2~XFXtAZImSVaPrP0k0BKqSXaHaRIE1HU.2_1 2023-12-03T11:32:36.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2023-12-03T11:32:36.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-FROZEN.2~XFXtAZImSVaPrP0k0BKqSXaHaRIE1HU.3 2023-12-03T11:32:36.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2023-12-03T11:32:36.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.292+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.293+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.13888465163181493438 2023-12-03T11:32:36.297 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.294+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:32:36.297 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.294+0000 7f8912325800 20 get_obj_state: octx=0x7f890809adb0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.297 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.294+0000 7f8912325800 10 manifest: total_size = 11534336 2023-12-03T11:32:36.297 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.294+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.6215357874216398019 2023-12-03T11:32:36.297 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.294+0000 7f8912325800 20 get_obj_state: octx=0x7f890809adb0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.297 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.294+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b0068 2023-12-03T11:32:36.297 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.294+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13.0 2023-12-03T11:32:36.298 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.298 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.298 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.298 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.298 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2023-12-03T11:32:36.298 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.298 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.298 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.298 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.6215357874216398019 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-LUKEWARM.2~GMdKrhRmrUDHrxxvAfhZxzy3sKMIV7o.1 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__shadow_foo-LUKEWARM.2~GMdKrhRmrUDHrxxvAfhZxzy3sKMIV7o.1_1 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-LUKEWARM.2~GMdKrhRmrUDHrxxvAfhZxzy3sKMIV7o.2 2023-12-03T11:32:36.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2023-12-03T11:32:36.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__shadow_foo-LUKEWARM.2~GMdKrhRmrUDHrxxvAfhZxzy3sKMIV7o.2_1 2023-12-03T11:32:36.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2023-12-03T11:32:36.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-LUKEWARM.2~GMdKrhRmrUDHrxxvAfhZxzy3sKMIV7o.3 2023-12-03T11:32:36.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2023-12-03T11:32:36.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.296+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.6215357874216398019 2023-12-03T11:32:36.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.297+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:32:36.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.298+0000 7f8912325800 20 get_obj_state: octx=0x55aba74bc210 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.298+0000 7f8912325800 10 manifest: total_size = 16380 2023-12-03T11:32:36.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.298+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.15583795031275657595 2023-12-03T11:32:36.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.298+0000 7f8912325800 20 get_obj_state: octx=0x55aba74bc210 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55aba74b0068 s->prefetch_data=0 2023-12-03T11:32:36.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.298+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b0068 2023-12-03T11:32:36.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.298+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13.0 2023-12-03T11:32:36.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7673 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=3 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7673 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=15345 stripe_ofs=15345 part_ofs=15345 rule->part_size=1035 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 RGWObjManifest::operator++(): stripe_ofs=4209649 part_ofs=15345 rule->part_size=1035 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=16380 rule->part_size=1035 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.15583795031275657595 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-STANDARD.2~wx7JWcQHwtOVvBu9iqVEhjdcfyiiMU0.1 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2023-12-03T11:32:36.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-STANDARD.2~wx7JWcQHwtOVvBu9iqVEhjdcfyiiMU0.2 2023-12-03T11:32:36.303 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2023-12-03T11:32:36.303 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-STANDARD.2~wx7JWcQHwtOVvBu9iqVEhjdcfyiiMU0.3 2023-12-03T11:32:36.303 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2023-12-03T11:32:36.303 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.303 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.300+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.15583795031275657595 2023-12-03T11:32:36.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.301+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:32:36.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.302+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.302+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.302+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.302+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.302+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.302+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.302+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.303+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2023-12-03T11:32:36.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.303+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.305 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.304+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=238 2023-12-03T11:32:36.305 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.304+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2023-12-03T11:32:36.305 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.304+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2023-12-03T11:32:36.305 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.304+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2023-12-03T11:32:36.306 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.304+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2023-12-03T11:32:36.306 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.304+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791369 cookie 94195734030016 notifier 6042 bl.length()=194 2023-12-03T11:32:36.307 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.306+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13 from cache 2023-12-03T11:32:36.307 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.306+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13, ofs0, ns] 2023-12-03T11:32:36.307 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.306+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791350 cookie 94195734023984 notifier 6042 bl.length()=252 2023-12-03T11:32:36.310 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.309+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13 : miss 2023-12-03T11:32:36.310 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.309+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.310 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.309+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.310 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.309+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13 info.flags=0x0 2023-12-03T11:32:36.311 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.309+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13 to cache LRU end 2023-12-03T11:32:36.311 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.309+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13 from cache 2023-12-03T11:32:36.311 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.309+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13, ofs0, ns] 2023-12-03T11:32:36.311 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.309+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791353 cookie 94195731537744 notifier 6042 bl.length()=249 2023-12-03T11:32:36.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.312+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12 : miss 2023-12-03T11:32:36.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.312+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.312+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=402 2023-12-03T11:32:36.314 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.312+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12 info.flags=0x17 2023-12-03T11:32:36.314 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.312+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12 to cache LRU end 2023-12-03T11:32:36.314 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.312+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.314 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.312+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.314 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.312+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12 2023-12-03T11:32:36.314 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.313+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-FROZEN 2023-12-03T11:32:36.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.313+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2023-12-03T11:32:36.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.313+0000 7f8912325800 10 cls_bucket_list_unordered: got foo-STANDARD 2023-12-03T11:32:36.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.313+0000 7f8912325800 20 get_obj_state: octx=0x55aba74b7e20 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.313+0000 7f8912325800 10 manifest: total_size = 10485760 2023-12-03T11:32:36.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.313+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5481443708059950296 2023-12-03T11:32:36.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.313+0000 7f8912325800 20 get_obj_state: octx=0x55aba74b7e20 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.313+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74ba3b8 2023-12-03T11:32:36.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.313+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12.0 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5481443708059950296 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XeE5WFBAQkADrRWsF8erLonb7W2u1r7_0 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XeE5WFBAQkADrRWsF8erLonb7W2u1r7_1 2023-12-03T11:32:36.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2023-12-03T11:32:36.318 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XeE5WFBAQkADrRWsF8erLonb7W2u1r7_2 2023-12-03T11:32:36.318 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 811 2023-12-03T11:32:36.318 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.318 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.315+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5481443708059950296 2023-12-03T11:32:36.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.316+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2023-12-03T11:32:36.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.317+0000 7f8912325800 20 get_obj_state: octx=0x7f89080b9bc0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.317+0000 7f8912325800 10 manifest: total_size = 10485760 2023-12-03T11:32:36.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.317+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.4267961975020246425 2023-12-03T11:32:36.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.317+0000 7f8912325800 20 get_obj_state: octx=0x7f89080b9bc0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.317+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74ba3b8 2023-12-03T11:32:36.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.317+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12.0 2023-12-03T11:32:36.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.4267961975020246425 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XrklsKNTvgo-C5t6Fs-IpIm713fY-kj_0 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XrklsKNTvgo-C5t6Fs-IpIm713fY-kj_1 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XrklsKNTvgo-C5t6Fs-IpIm713fY-kj_2 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2023-12-03T11:32:36.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2023-12-03T11:32:36.329 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.326+0000 7f8912325800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.4267961975020246425 2023-12-03T11:32:36.329 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.327+0000 7f88effff640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2023-12-03T11:32:36.330 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.328+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.330 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.328+0000 7f8912325800 10 manifest: total_size = 53505 2023-12-03T11:32:36.330 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.328+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.12869398890301751600 2023-12-03T11:32:36.330 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.328+0000 7f8912325800 20 get_obj_state: octx=0x7f890005fbd0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55aba74ba3b8 s->prefetch_data=0 2023-12-03T11:32:36.330 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.328+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74ba3b8 2023-12-03T11:32:36.330 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.328+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12.0 2023-12-03T11:32:36.331 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.330+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.332 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.330+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.332 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.331+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2023-12-03T11:32:36.333 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.332+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.333 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.332+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.333 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.332+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.333 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.332+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.333 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.332+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.333+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2023-12-03T11:32:36.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.333+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.333+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=228 2023-12-03T11:32:36.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.333+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2023-12-03T11:32:36.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.333+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2023-12-03T11:32:36.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.333+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2023-12-03T11:32:36.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.333+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2023-12-03T11:32:36.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.334+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791314 cookie 94195734020240 notifier 6042 bl.length()=184 2023-12-03T11:32:36.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.335+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12 from cache 2023-12-03T11:32:36.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.335+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12, ofs0, ns] 2023-12-03T11:32:36.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.335+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791308 cookie 94195733989872 notifier 6042 bl.length()=242 2023-12-03T11:32:36.339 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.338+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12 : miss 2023-12-03T11:32:36.340 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.338+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.340 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.338+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.340 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.338+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12 info.flags=0x0 2023-12-03T11:32:36.340 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.338+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12 to cache LRU end 2023-12-03T11:32:36.340 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.338+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12 from cache 2023-12-03T11:32:36.340 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.338+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-obj-storage-class.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12, ofs0, ns] 2023-12-03T11:32:36.340 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.339+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791351 cookie 140226454564864 notifier 6042 bl.length()=239 2023-12-03T11:32:36.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.341+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5 : miss 2023-12-03T11:32:36.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.341+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=397 2023-12-03T11:32:36.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5 info.flags=0x17 2023-12-03T11:32:36.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5 to cache LRU end 2023-12-03T11:32:36.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5 2023-12-03T11:32:36.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 10 cls_bucket_list_unordered: got __ 2023-12-03T11:32:36.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 10 cls_bucket_list_unordered: got __ _ 2023-12-03T11:32:36.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 10 cls_bucket_list_unordered: got ___ 2023-12-03T11:32:36.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 10 cls_bucket_list_unordered: got obj 2023-12-03T11:32:36.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 20 get_obj_state: octx=0x55aba74bc140 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 10 manifest: total_size = 0 2023-12-03T11:32:36.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.12441283523000131811 2023-12-03T11:32:36.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 20 get_obj_state: octx=0x55aba74bc140 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b20d8 2023-12-03T11:32:36.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.342+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5.0 2023-12-03T11:32:36.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.344+0000 7f8912325800 20 get_obj_state: octx=0x7f890005f8a0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.345+0000 7f8912325800 10 manifest: total_size = 0 2023-12-03T11:32:36.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.345+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.15645965991886479250 2023-12-03T11:32:36.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.345+0000 7f8912325800 20 get_obj_state: octx=0x7f890005f8a0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.345+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b20d8 2023-12-03T11:32:36.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.345+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5.0 2023-12-03T11:32:36.347 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.346+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=__ 2023-12-03T11:32:36.348 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.347+0000 7f8912325800 20 get_obj_state: octx=0x7f8908066f30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.349 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.347+0000 7f8912325800 10 manifest: total_size = 0 2023-12-03T11:32:36.349 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.347+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.14456596765452133483 2023-12-03T11:32:36.349 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.347+0000 7f8912325800 20 get_obj_state: octx=0x7f8908066f30 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.349 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.347+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b20d8 2023-12-03T11:32:36.349 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.347+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5.0 2023-12-03T11:32:36.349 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.348+0000 7f88effff640 20 handle_completion(): completion ok for obj=__ _ 2023-12-03T11:32:36.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.350+0000 7f8912325800 20 get_obj_state: octx=0x7f8900053d60 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.350+0000 7f8912325800 10 manifest: total_size = 0 2023-12-03T11:32:36.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.350+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.9602063349100367654 2023-12-03T11:32:36.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.350+0000 7f8912325800 20 get_obj_state: octx=0x7f8900053d60 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.350+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b20d8 2023-12-03T11:32:36.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.350+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5.0 2023-12-03T11:32:36.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.351+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=___ 2023-12-03T11:32:36.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.352+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.352+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.354 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.353+0000 7f88effff640 20 handle_completion(): completion ok for obj=obj 2023-12-03T11:32:36.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.353+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.353+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.353+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.353+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.353+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.355+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2023-12-03T11:32:36.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.355+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.355+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=223 2023-12-03T11:32:36.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.355+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2023-12-03T11:32:36.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.355+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2023-12-03T11:32:36.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.355+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2023-12-03T11:32:36.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.355+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2023-12-03T11:32:36.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.356+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791354 cookie 94195731537744 notifier 6042 bl.length()=181 2023-12-03T11:32:36.358 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.357+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5 from cache 2023-12-03T11:32:36.358 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.357+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5, ofs0, ns] 2023-12-03T11:32:36.358 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.357+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791310 cookie 94195734006560 notifier 6042 bl.length()=238 2023-12-03T11:32:36.361 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.360+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5 : miss 2023-12-03T11:32:36.361 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.360+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.361 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.360+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.361 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.360+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5 info.flags=0x0 2023-12-03T11:32:36.361 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.360+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5 to cache LRU end 2023-12-03T11:32:36.361 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.360+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5 from cache 2023-12-03T11:32:36.361 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.360+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.1/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.5, ofs0, ns] 2023-12-03T11:32:36.362 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.360+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791370 cookie 94195734002592 notifier 6042 bl.length()=235 2023-12-03T11:32:36.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.363+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6 : miss 2023-12-03T11:32:36.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.363+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.363+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=397 2023-12-03T11:32:36.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.363+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6 info.flags=0x17 2023-12-03T11:32:36.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.363+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6 to cache LRU end 2023-12-03T11:32:36.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.363+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.363+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.363+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6 2023-12-03T11:32:36.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.364+0000 7f8912325800 10 cls_bucket_list_unordered: got __ 2023-12-03T11:32:36.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.364+0000 7f8912325800 10 cls_bucket_list_unordered: got __ _ 2023-12-03T11:32:36.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.364+0000 7f8912325800 10 cls_bucket_list_unordered: got ___ 2023-12-03T11:32:36.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.364+0000 7f8912325800 10 cls_bucket_list_unordered: got obj 2023-12-03T11:32:36.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.364+0000 7f8912325800 20 get_obj_state: octx=0x55aba74bc210 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.364+0000 7f8912325800 10 manifest: total_size = 2078 2023-12-03T11:32:36.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.364+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.10424295479304758658 2023-12-03T11:32:36.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.364+0000 7f8912325800 20 get_obj_state: octx=0x55aba74bc210 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.364+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b20d8 2023-12-03T11:32:36.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.364+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6.0 2023-12-03T11:32:36.367 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.366+0000 7f8912325800 20 get_obj_state: octx=0x55aba74bc210 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.368 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.367+0000 7f8912325800 10 manifest: total_size = 527 2023-12-03T11:32:36.368 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.367+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.3055040930726349484 2023-12-03T11:32:36.368 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.367+0000 7f8912325800 20 get_obj_state: octx=0x55aba74bc210 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.368 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.367+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b20d8 2023-12-03T11:32:36.368 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.367+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6.0 2023-12-03T11:32:36.368 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.367+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=__ 2023-12-03T11:32:36.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.369+0000 7f8912325800 20 get_obj_state: octx=0x7f890809adb0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.369+0000 7f8912325800 10 manifest: total_size = 2078 2023-12-03T11:32:36.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.369+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.8796955475556725582 2023-12-03T11:32:36.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.369+0000 7f8912325800 20 get_obj_state: octx=0x7f890809adb0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.369+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b20d8 2023-12-03T11:32:36.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.369+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6.0 2023-12-03T11:32:36.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.370+0000 7f88effff640 20 handle_completion(): completion ok for obj=__ _ 2023-12-03T11:32:36.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.371+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.372+0000 7f8912325800 10 manifest: total_size = 2078 2023-12-03T11:32:36.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.372+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.196680899190491594 2023-12-03T11:32:36.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.372+0000 7f8912325800 20 get_obj_state: octx=0x7f890809b020 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.372+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b20d8 2023-12-03T11:32:36.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.372+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6.0 2023-12-03T11:32:36.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.373+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=___ 2023-12-03T11:32:36.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.374+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.374+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.376 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.375+0000 7f88effff640 20 handle_completion(): completion ok for obj=obj 2023-12-03T11:32:36.376 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.375+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.376 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.375+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.377 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.375+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.377 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.375+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.377 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.375+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.377 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.376+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2023-12-03T11:32:36.378 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.376+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.378 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.377+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=223 2023-12-03T11:32:36.378 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.377+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2023-12-03T11:32:36.378 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.377+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2023-12-03T11:32:36.378 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.377+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2023-12-03T11:32:36.379 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.377+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2023-12-03T11:32:36.379 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.377+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791355 cookie 94195731537744 notifier 6042 bl.length()=181 2023-12-03T11:32:36.380 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.379+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6 from cache 2023-12-03T11:32:36.380 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.379+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6, ofs0, ns] 2023-12-03T11:32:36.380 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.379+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791311 cookie 94195734006560 notifier 6042 bl.length()=238 2023-12-03T11:32:36.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.382+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6 : miss 2023-12-03T11:32:36.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.382+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.382+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.384 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.382+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6 info.flags=0x0 2023-12-03T11:32:36.384 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.382+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6 to cache LRU end 2023-12-03T11:32:36.384 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.382+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6 from cache 2023-12-03T11:32:36.384 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.382+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.2/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.6, ofs0, ns] 2023-12-03T11:32:36.384 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.382+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791371 cookie 94195734002592 notifier 6042 bl.length()=235 2023-12-03T11:32:36.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.385+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7 : miss 2023-12-03T11:32:36.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.385+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.385+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=397 2023-12-03T11:32:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.385+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7 info.flags=0x17 2023-12-03T11:32:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.385+0000 7f8912325800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7 to cache LRU end 2023-12-03T11:32:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.385+0000 7f8912325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.385+0000 7f8912325800 10 updating xattr: name=user.rgw.acl bl.length()=209 2023-12-03T11:32:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.385+0000 7f8912325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7 2023-12-03T11:32:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.386+0000 7f8912325800 10 cls_bucket_list_unordered: got __ 2023-12-03T11:32:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.386+0000 7f8912325800 10 cls_bucket_list_unordered: got __ _ 2023-12-03T11:32:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.386+0000 7f8912325800 10 cls_bucket_list_unordered: got ___ 2023-12-03T11:32:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.386+0000 7f8912325800 10 cls_bucket_list_unordered: got obj 2023-12-03T11:32:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.386+0000 7f8912325800 20 get_obj_state: octx=0x7f89080b9bc0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55aba735a968 s->prefetch_data=0 2023-12-03T11:32:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.387+0000 7f8912325800 10 manifest: total_size = 4134 2023-12-03T11:32:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.387+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16413918177665089909 2023-12-03T11:32:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.387+0000 7f8912325800 20 get_obj_state: octx=0x7f89080b9bc0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55aba735a968 s->prefetch_data=0 2023-12-03T11:32:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.387+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba735a968 2023-12-03T11:32:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.387+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7.0 2023-12-03T11:32:36.390 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.389+0000 7f8912325800 20 get_obj_state: octx=0x7f89080b9bc0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55aba735a968 s->prefetch_data=0 2023-12-03T11:32:36.391 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.389+0000 7f8912325800 10 manifest: total_size = 55 2023-12-03T11:32:36.391 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.390+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.6910778730410585184 2023-12-03T11:32:36.391 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.390+0000 7f8912325800 20 get_obj_state: octx=0x7f89080b9bc0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55aba735a968 s->prefetch_data=0 2023-12-03T11:32:36.391 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.390+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba735a968 2023-12-03T11:32:36.391 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.390+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7.0 2023-12-03T11:32:36.391 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.390+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=__ 2023-12-03T11:32:36.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.392+0000 7f8912325800 20 get_obj_state: octx=0x7f8908066f30 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55aba735a968 s->prefetch_data=0 2023-12-03T11:32:36.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.392+0000 7f8912325800 10 manifest: total_size = 4134 2023-12-03T11:32:36.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.392+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.9143892624174417727 2023-12-03T11:32:36.394 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.392+0000 7f8912325800 20 get_obj_state: octx=0x7f8908066f30 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55aba735a968 s->prefetch_data=0 2023-12-03T11:32:36.394 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.392+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba735a968 2023-12-03T11:32:36.394 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.392+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7.0 2023-12-03T11:32:36.394 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.393+0000 7f88effff640 20 handle_completion(): completion ok for obj=__ _ 2023-12-03T11:32:36.395 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.394+0000 7f8912325800 20 get_obj_state: octx=0x7f8904001e30 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.395+0000 7f8912325800 10 manifest: total_size = 55 2023-12-03T11:32:36.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.395+0000 7f8912325800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.2545433135359488197 2023-12-03T11:32:36.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.395+0000 7f8912325800 20 get_obj_state: octx=0x7f8904001e30 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55aba74b20d8 s->prefetch_data=0 2023-12-03T11:32:36.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.395+0000 7f8912325800 20 prepare_atomic_modification: state is not atomic. state=0x55aba74b20d8 2023-12-03T11:32:36.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.395+0000 7f8912325800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7.0 2023-12-03T11:32:36.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.395+0000 7f88fcff9640 20 handle_completion(): completion ok for obj=___ 2023-12-03T11:32:36.398 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.397+0000 7f8912325800 20 list_objects_ordered: starting attempt 1 2023-12-03T11:32:36.398 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.397+0000 7f8912325800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2023-12-03T11:32:36.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.398+0000 7f88effff640 20 handle_completion(): completion ok for obj=obj 2023-12-03T11:32:36.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.398+0000 7f8912325800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2023-12-03T11:32:36.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.398+0000 7f8912325800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2023-12-03T11:32:36.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.398+0000 7f8912325800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2023-12-03T11:32:36.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.398+0000 7f8912325800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2023-12-03T11:32:36.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.398+0000 7f8912325800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7])"; uploads.size()=0; is_truncated=0 2023-12-03T11:32:36.400 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.399+0000 7f8912325800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2023-12-03T11:32:36.400 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.399+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.401 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.400+0000 7f8912325800 20 rados_obj.operate() r=0 bl.length=223 2023-12-03T11:32:36.401 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.400+0000 7f8912325800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2023-12-03T11:32:36.401 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.400+0000 7f8912325800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2023-12-03T11:32:36.401 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.400+0000 7f8912325800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2023-12-03T11:32:36.401 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.400+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2023-12-03T11:32:36.402 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.400+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791356 cookie 94195731537744 notifier 6042 bl.length()=181 2023-12-03T11:32:36.402 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.401+0000 7f8912325800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7 from cache 2023-12-03T11:32:36.403 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.401+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7, ofs0, ns] 2023-12-03T11:32:36.403 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.402+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791312 cookie 94195734006560 notifier 6042 bl.length()=238 2023-12-03T11:32:36.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.404+0000 7f8912325800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7 : miss 2023-12-03T11:32:36.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.404+0000 7f8912325800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.404+0000 7f8912325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.404+0000 7f8912325800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7 info.flags=0x0 2023-12-03T11:32:36.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.404+0000 7f8912325800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7 to cache LRU end 2023-12-03T11:32:36.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.404+0000 7f8912325800 10 removing default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7 from cache 2023-12-03T11:32:36.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.404+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.test-client.0-r-test-small-obj-data.3/e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.7, ofs0, ns] 2023-12-03T11:32:36.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.405+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791372 cookie 94195734002592 notifier 6042 bl.length()=235 2023-12-03T11:32:36.408 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.407+0000 7f8912325800 10 removing key index: VLJDZJWEKAZDQTHOEEFG 2023-12-03T11:32:36.408 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.407+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:VLJDZJWEKAZDQTHOEEFG, ofs0, ns] 2023-12-03T11:32:36.408 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.407+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791373 cookie 94195734030016 notifier 6042 bl.length()=170 2023-12-03T11:32:36.410 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.409+0000 7f8912325800 10 removing email index: ragweed.client.0+test@test.test 2023-12-03T11:32:36.410 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.409+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2023-12-03T11:32:36.410 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.409+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791315 cookie 94195734020240 notifier 6042 bl.length()=182 2023-12-03T11:32:36.412 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.410+0000 7f8912325800 10 removing user buckets index 2023-12-03T11:32:36.412 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.410+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2023-12-03T11:32:36.412 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.411+0000 7f88fcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791374 cookie 94195734030016 notifier 6042 bl.length()=173 2023-12-03T11:32:36.413 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.412+0000 7f8912325800 10 removing user index: ragweed.client.0 2023-12-03T11:32:36.413 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.412+0000 7f8912325800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2023-12-03T11:32:36.413 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.412+0000 7f8912325800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2023-12-03T11:32:36.414 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.412+0000 7f88effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791352 cookie 94195734023984 notifier 6042 bl.length()=165 2023-12-03T11:32:36.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.415+0000 7f88d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:32:36.418 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.417+0000 7f8912325800 20 remove_watcher() i=0 2023-12-03T11:32:36.418 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.417+0000 7f8912325800 2 removed watcher, disabling cache 2023-12-03T11:32:36.419 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.418+0000 7f8912325800 20 remove_watcher() i=1 2023-12-03T11:32:36.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.419+0000 7f8912325800 20 remove_watcher() i=2 2023-12-03T11:32:36.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.420+0000 7f8912325800 20 remove_watcher() i=3 2023-12-03T11:32:36.422 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.421+0000 7f8912325800 20 remove_watcher() i=4 2023-12-03T11:32:36.423 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.421+0000 7f8912325800 20 remove_watcher() i=5 2023-12-03T11:32:36.423 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.422+0000 7f8912325800 20 remove_watcher() i=6 2023-12-03T11:32:36.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.423+0000 7f8912325800 20 remove_watcher() i=7 2023-12-03T11:32:36.430 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2023-12-03T11:32:36.513 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:32:36.513 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:32:36.524 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.523+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.525 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.524+0000 7fe21e720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.526 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.524+0000 7fe21e720800 20 realm 2023-12-03T11:32:36.526 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.524+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.526 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.524+0000 7fe21e720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.526 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.524+0000 7fe21e720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:32:36.526 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.524+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.526 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.525+0000 7fe21e720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.526 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.525+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.527 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.525+0000 7fe21e720800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:32:36.527 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.525+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.527 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.526+0000 7fe21e720800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:32:36.527 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.526+0000 7fe21e720800 20 searching for the correct realm 2023-12-03T11:32:36.536 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.535+0000 7fe21a3ed640 0 -- 172.21.15.131:0/52352077 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x564d802c9ec0 msgr2=0x564d802cc310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:32:36.538 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.537+0000 7fe21e720800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:32:36.538 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.537+0000 7fe21e720800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:32:36.538 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.537+0000 7fe21e720800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:32:36.538 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.537+0000 7fe21e720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:32:36.538 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.537+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.539 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.537+0000 7fe21e720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.539 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.537+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.539 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:32:36.539 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.540 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:32:36.540 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 20 zone default found 2023-12-03T11:32:36.540 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 4 Realm: () 2023-12-03T11:32:36.540 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:32:36.540 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:32:36.540 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:32:36.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 20 zonegroup default 2023-12-03T11:32:36.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.538+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.539+0000 7fe21e720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.539+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.539+0000 7fe21e720800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:32:36.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.539+0000 7fe21e720800 20 started sync module instance, tier type = 2023-12-03T11:32:36.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.539+0000 7fe21e720800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:32:36.545 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.544+0000 7fe219bec640 0 -- 172.21.15.131:0/52352077 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x564d802cefa0 msgr2=0x564d802d1390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:32:36.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.548+0000 7fe21e720800 20 add_watcher() i=0 2023-12-03T11:32:36.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.548+0000 7fe21e720800 20 add_watcher() i=1 2023-12-03T11:32:36.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.548+0000 7fe21e720800 20 add_watcher() i=2 2023-12-03T11:32:36.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.548+0000 7fe21e720800 20 add_watcher() i=3 2023-12-03T11:32:36.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.548+0000 7fe21e720800 20 add_watcher() i=4 2023-12-03T11:32:36.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.548+0000 7fe21e720800 20 add_watcher() i=5 2023-12-03T11:32:36.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.548+0000 7fe21e720800 20 add_watcher() i=6 2023-12-03T11:32:36.549 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.548+0000 7fe21e720800 20 add_watcher() i=7 2023-12-03T11:32:36.550 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.548+0000 7fe21e720800 2 all 8 watchers are set, enabling cache 2023-12-03T11:32:36.551 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.550+0000 7fe1dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:32:36.551 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.550+0000 7fe21e720800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:32:36.551 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.550+0000 7fe21e720800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:32:36.592 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.590+0000 7fe14effd640 20 reqs_thread_entry: start 2023-12-03T11:32:36.592 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.590+0000 7fe21e720800 20 init_complete bucket index max shards: 1 2023-12-03T11:32:36.592 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.590+0000 7fe21e720800 20 Filter name: none 2023-12-03T11:32:36.592 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.590+0000 7fe14cff9640 20 reqs_thread_entry: start 2023-12-03T11:32:36.592 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.590+0000 7fe21e720800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2023-12-03T11:32:36.592 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.590+0000 7fe21e720800 20 rados->read ofs=0 len=0 2023-12-03T11:32:36.593 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.591+0000 7fe21e720800 20 rados_obj.operate() r=0 bl.length=452 2023-12-03T11:32:36.593 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.591+0000 7fe21e720800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2023-12-03T11:32:36.593 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.591+0000 7fe21e720800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2023-12-03T11:32:36.593 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.591+0000 7fe21e720800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:32:36.593 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.592+0000 7fe21e720800 10 removing key index: ZCQGZUFAGJXMMWLQIIDZ 2023-12-03T11:32:36.593 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.592+0000 7fe21e720800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:ZCQGZUFAGJXMMWLQIIDZ, ofs0, ns] 2023-12-03T11:32:36.593 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.592+0000 7fe210ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791375 cookie 94890862914688 notifier 5783 bl.length()=170 2023-12-03T11:32:36.594 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.593+0000 7fe21e720800 10 removing email index: sysuser.client.0+test@test.test 2023-12-03T11:32:36.595 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.593+0000 7fe21e720800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2023-12-03T11:32:36.595 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.594+0000 7fe210ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791353 cookie 94890862920016 notifier 5783 bl.length()=182 2023-12-03T11:32:36.596 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.595+0000 7fe21e720800 10 removing user buckets index 2023-12-03T11:32:36.596 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.595+0000 7fe21e720800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0.buckets, ofs0, ns] 2023-12-03T11:32:36.597 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.595+0000 7fe1fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791309 cookie 94890862917248 notifier 5783 bl.length()=173 2023-12-03T11:32:36.598 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.597+0000 7fe21e720800 10 removing user index: sysuser.client.0 2023-12-03T11:32:36.598 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.597+0000 7fe21e720800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2023-12-03T11:32:36.598 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.597+0000 7fe21e720800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2023-12-03T11:32:36.598 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.597+0000 7fe1fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791316 cookie 94890862885136 notifier 5783 bl.length()=165 2023-12-03T11:32:36.600 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.599+0000 7fe1dffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:32:36.602 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.601+0000 7fe21e720800 20 remove_watcher() i=0 2023-12-03T11:32:36.602 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.601+0000 7fe21e720800 2 removed watcher, disabling cache 2023-12-03T11:32:36.603 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.602+0000 7fe21e720800 20 remove_watcher() i=1 2023-12-03T11:32:36.604 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.603+0000 7fe21e720800 20 remove_watcher() i=2 2023-12-03T11:32:36.605 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.604+0000 7fe21e720800 20 remove_watcher() i=3 2023-12-03T11:32:36.606 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.605+0000 7fe21e720800 20 remove_watcher() i=4 2023-12-03T11:32:36.606 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.606+0000 7fe21e720800 20 remove_watcher() i=5 2023-12-03T11:32:36.607 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.606+0000 7fe21e720800 20 remove_watcher() i=6 2023-12-03T11:32:36.608 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:32:36.607+0000 7fe21e720800 20 remove_watcher() i=7 2023-12-03T11:32:36.614 INFO:tasks.ragweed:Removing ragweed... 2023-12-03T11:32:36.614 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2023-12-03T11:32:36.715 INFO:teuthology.run_tasks:Running task workunit... 2023-12-03T11:32:36.725 INFO:tasks.workunit:Pulling workunits from ref bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:32:36.725 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-03T11:32:36.725 DEBUG:teuthology.orchestra.run.smithi131:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:32:36.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T11:32:36.740 INFO:teuthology.orchestra.run.smithi131.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-03T11:32:36.740 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:32:36.794 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-03T11:32:36.795 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-03T11:32:36.849 INFO:tasks.workunit:timeout=3h 2023-12-03T11:32:36.850 INFO:tasks.workunit:cleanup=True 2023-12-03T11:32:36.850 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bcbf278cf395873c2a482f5a7b2345faf2160319 2023-12-03T11:32:36.905 INFO:tasks.workunit.client.0.smithi131.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-03T11:33:42.199 INFO:tasks.workunit.client.0.smithi131.stderr:Note: switching to 'bcbf278cf395873c2a482f5a7b2345faf2160319'. 2023-12-03T11:33:42.199 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:42.199 INFO:tasks.workunit.client.0.smithi131.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-03T11:33:42.199 INFO:tasks.workunit.client.0.smithi131.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr:state without impacting any branches by switching back to a branch. 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr: git switch -c 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr:Or undo this operation with: 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr: git switch - 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:42.200 INFO:tasks.workunit.client.0.smithi131.stderr:HEAD is now at bcbf278cf39 RGW:pubsub publish commit with etag populated 2023-12-03T11:33:42.202 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-03T11:33:42.257 INFO:tasks.workunit.client.0.smithi131.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-03T11:33:42.259 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:33:42.259 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-03T11:33:42.384 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-03T11:33:42.435 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-03T11:33:42.474 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-03T11:33:42.476 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:33:42.476 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-03T11:33:42.515 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-03T11:33:42.517 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:33:42.518 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-03T11:33:42.573 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2023-12-03T11:33:42.574 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2023-12-03T11:33:42.574 DEBUG:teuthology.orchestra.run.smithi131:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bcbf278cf395873c2a482f5a7b2345faf2160319 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2023-12-03T11:33:42.631 INFO:tasks.workunit.client.0.smithi131.stderr:+ ulimit -c 0 2023-12-03T11:33:42.631 INFO:tasks.workunit.client.0.smithi131.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2023-12-03T11:33:42.632 INFO:tasks.workunit.client.0.smithi131.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:33:42.632 INFO:tasks.workunit.client.0.smithi131.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:33:45.049 INFO:tasks.workunit.client.0.smithi131.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2023-12-03T11:33:45.049 INFO:tasks.workunit.client.0.smithi131.stderr:++ deactivate nondestructive 2023-12-03T11:33:45.049 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n '' ']' 2023-12-03T11:33:45.049 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n '' ']' 2023-12-03T11:33:45.049 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:33:45.049 INFO:tasks.workunit.client.0.smithi131.stderr:++ hash -r 2023-12-03T11:33:45.049 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n '' ']' 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ unset VIRTUAL_ENV 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' '!' nondestructive = nondestructive ']' 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ export VIRTUAL_ENV 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ export PATH 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n '' ']' 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -z '' ']' 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ _OLD_VIRTUAL_PS1= 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ PS1='(rgw) ' 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ export PS1 2023-12-03T11:33:45.050 INFO:tasks.workunit.client.0.smithi131.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:33:45.051 INFO:tasks.workunit.client.0.smithi131.stderr:++ hash -r 2023-12-03T11:33:45.051 INFO:tasks.workunit.client.0.smithi131.stderr:+ pip install pip --upgrade 2023-12-03T11:33:45.284 INFO:tasks.workunit.client.0.smithi131.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.2.3) 2023-12-03T11:33:45.481 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting pip 2023-12-03T11:33:45.487 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached pip-23.3.1-py3-none-any.whl (2.1 MB) 2023-12-03T11:33:45.535 INFO:tasks.workunit.client.0.smithi131.stdout:Installing collected packages: pip 2023-12-03T11:33:45.535 INFO:tasks.workunit.client.0.smithi131.stdout: Attempting uninstall: pip 2023-12-03T11:33:45.535 INFO:tasks.workunit.client.0.smithi131.stdout: Found existing installation: pip 21.2.3 2023-12-03T11:33:45.686 INFO:tasks.workunit.client.0.smithi131.stdout: Uninstalling pip-21.2.3: 2023-12-03T11:33:45.692 INFO:tasks.workunit.client.0.smithi131.stdout: Successfully uninstalled pip-21.2.3 2023-12-03T11:33:46.810 INFO:tasks.workunit.client.0.smithi131.stdout:Successfully installed pip-23.3.1 2023-12-03T11:33:46.859 INFO:tasks.workunit.client.0.smithi131.stderr:+ pip install boto3 2023-12-03T11:33:47.647 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting boto3 2023-12-03T11:33:47.649 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached boto3-1.33.6-py3-none-any.whl.metadata (6.7 kB) 2023-12-03T11:33:48.191 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting botocore<1.34.0,>=1.33.6 (from boto3) 2023-12-03T11:33:48.192 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached botocore-1.33.6-py3-none-any.whl.metadata (6.1 kB) 2023-12-03T11:33:48.252 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2023-12-03T11:33:48.254 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2023-12-03T11:33:48.314 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting s3transfer<0.9.0,>=0.8.2 (from boto3) 2023-12-03T11:33:48.316 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached s3transfer-0.8.2-py3-none-any.whl.metadata (1.8 kB) 2023-12-03T11:33:48.373 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:33:48.374 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB) 2023-12-03T11:33:48.457 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:33:48.458 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached urllib3-1.26.18-py2.py3-none-any.whl.metadata (48 kB) 2023-12-03T11:33:48.705 INFO:tasks.workunit.client.0.smithi131.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.34.0,>=1.33.6->boto3) 2023-12-03T11:33:48.706 INFO:tasks.workunit.client.0.smithi131.stdout: Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2023-12-03T11:33:48.729 INFO:tasks.workunit.client.0.smithi131.stdout:Using cached boto3-1.33.6-py3-none-any.whl (139 kB) 2023-12-03T11:33:48.730 INFO:tasks.workunit.client.0.smithi131.stdout:Using cached botocore-1.33.6-py3-none-any.whl (11.8 MB) 2023-12-03T11:33:48.750 INFO:tasks.workunit.client.0.smithi131.stdout:Using cached s3transfer-0.8.2-py3-none-any.whl (82 kB) 2023-12-03T11:33:48.751 INFO:tasks.workunit.client.0.smithi131.stdout:Using cached urllib3-1.26.18-py2.py3-none-any.whl (143 kB) 2023-12-03T11:33:48.850 INFO:tasks.workunit.client.0.smithi131.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2023-12-03T11:33:49.874 INFO:tasks.workunit.client.0.smithi131.stdout:Successfully installed boto3-1.33.6 botocore-1.33.6 jmespath-1.0.1 python-dateutil-2.8.2 s3transfer-0.8.2 six-1.16.0 urllib3-1.26.18 2023-12-03T11:33:50.000 INFO:tasks.workunit.client.0.smithi131.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2023-12-03T11:33:50.125 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2023-12-03T11:33:50.158 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:50.159 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:50.173 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.172+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.174+0000 7fc934f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.174+0000 7fc934f20800 20 realm 2023-12-03T11:33:50.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.174+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.174+0000 7fc934f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.174+0000 7fc934f20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:50.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.174+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.174+0000 7fc934f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.176 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.174+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.177 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.175+0000 7fc934f20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:50.177 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.175+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.177 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.176+0000 7fc934f20800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:50.177 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.176+0000 7fc934f20800 20 searching for the correct realm 2023-12-03T11:33:50.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.183+0000 7fc9313ee640 0 -- 172.21.15.131:0/109696566 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7fc918058010 msgr2=0x7fc91805d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:50.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.187+0000 7fc934f20800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:50.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.187+0000 7fc934f20800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:50.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.187+0000 7fc934f20800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:50.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.187+0000 7fc934f20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:50.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.187+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.189 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.187+0000 7fc934f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.189 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.187+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:50.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:50.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc9313ee640 0 -- 172.21.15.131:0/109696566 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7fc91c0030b0 msgr2=0x7fc918019950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:50.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 20 zone default found 2023-12-03T11:33:50.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 4 Realm: () 2023-12-03T11:33:50.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:50.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:50.190 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:50.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 20 zonegroup default 2023-12-03T11:33:50.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.188+0000 7fc934f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.189+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.189+0000 7fc934f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.189+0000 7fc934f20800 20 started sync module instance, tier type = 2023-12-03T11:33:50.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.189+0000 7fc934f20800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:50.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.198+0000 7fc934f20800 20 add_watcher() i=0 2023-12-03T11:33:50.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.198+0000 7fc934f20800 20 add_watcher() i=1 2023-12-03T11:33:50.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.198+0000 7fc934f20800 20 add_watcher() i=2 2023-12-03T11:33:50.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.198+0000 7fc934f20800 20 add_watcher() i=3 2023-12-03T11:33:50.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.198+0000 7fc934f20800 20 add_watcher() i=4 2023-12-03T11:33:50.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.198+0000 7fc934f20800 20 add_watcher() i=5 2023-12-03T11:33:50.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.198+0000 7fc934f20800 20 add_watcher() i=6 2023-12-03T11:33:50.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.199+0000 7fc934f20800 20 add_watcher() i=7 2023-12-03T11:33:50.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.199+0000 7fc934f20800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:50.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.200+0000 7fc8f77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:50.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.201+0000 7fc934f20800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:50.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.201+0000 7fc934f20800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc934f20800 5 note: GC not initialized 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc8667fc640 20 reqs_thread_entry: start 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc934f20800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc934f20800 20 Filter name: none 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc857fff640 20 reqs_thread_entry: start 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc934f20800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc934f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc934f20800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc934f20800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc934f20800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2023-12-03T11:33:50.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.207+0000 7fc934f20800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.208+0000 7fc934f20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.208+0000 7fc934f20800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2023-12-03T11:33:50.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.208+0000 7fc934f20800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-03T11:33:50.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.208+0000 7fc934f20800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2023-12-03T11:33:50.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.208+0000 7fc934f20800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2023-12-03T11:33:50.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.209+0000 7fc934f20800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2023-12-03T11:33:50.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.209+0000 7fc934f20800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2023-12-03T11:33:50.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.209+0000 7fc934f20800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2023-12-03T11:33:50.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.209+0000 7fc9273ea640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791376 cookie 94160181188848 notifier 5801 bl.length()=535 2023-12-03T11:33:50.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.209+0000 7fc9273ea640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2023-12-03T11:33:50.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.209+0000 7fc9273ea640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2023-12-03T11:33:50.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.211+0000 7fc934f20800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-12-03T11:33:50.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.211+0000 7fc934f20800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-03T11:33:50.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.211+0000 7fc934f20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2023-12-03T11:33:50.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.211+0000 7fc926be9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791377 cookie 94160181186256 notifier 5801 bl.length()=180 2023-12-03T11:33:50.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.211+0000 7fc926be9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2023-12-03T11:33:50.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.211+0000 7fc926be9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2023-12-03T11:33:50.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.212+0000 7fc8f77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:50.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.215+0000 7fc934f20800 20 remove_watcher() i=0 2023-12-03T11:33:50.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.215+0000 7fc934f20800 2 removed watcher, disabling cache 2023-12-03T11:33:50.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.216+0000 7fc934f20800 20 remove_watcher() i=1 2023-12-03T11:33:50.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.217+0000 7fc934f20800 20 remove_watcher() i=2 2023-12-03T11:33:50.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.218+0000 7fc934f20800 20 remove_watcher() i=3 2023-12-03T11:33:50.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.219+0000 7fc934f20800 20 remove_watcher() i=4 2023-12-03T11:33:50.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.220+0000 7fc934f20800 20 remove_watcher() i=5 2023-12-03T11:33:50.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.221+0000 7fc934f20800 20 remove_watcher() i=6 2023-12-03T11:33:50.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.222+0000 7fc934f20800 20 remove_watcher() i=7 2023-12-03T11:33:50.442 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard add 2023-12-03T11:33:50.443 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:50.444 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:33:50.471 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:50.471 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:50.484 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.483+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.485+0000 7fca5a012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.485+0000 7fca5a012800 20 realm 2023-12-03T11:33:50.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.485+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.485+0000 7fca5a012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.485+0000 7fca5a012800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:50.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.485+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.485+0000 7fca5a012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.485+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.486+0000 7fca5a012800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:50.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.486+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.486+0000 7fca5a012800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:50.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.486+0000 7fca5a012800 20 searching for the correct realm 2023-12-03T11:33:50.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.497+0000 7fca55650640 0 -- 172.21.15.131:0/4252817986 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x560755849a80 msgr2=0x56075584be70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:50.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.498+0000 7fca5a012800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:50.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.498+0000 7fca5a012800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:50.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.498+0000 7fca5a012800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:50.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.498+0000 7fca5a012800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:50.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.498+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.498+0000 7fca5a012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.498+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:50.500 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:50.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 20 zone default found 2023-12-03T11:33:50.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 4 Realm: () 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 20 zonegroup default 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.499+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.500+0000 7fca5a012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.500+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.500+0000 7fca5a012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.500+0000 7fca5a012800 20 started sync module instance, tier type = 2023-12-03T11:33:50.502 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.500+0000 7fca5a012800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:50.508 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.507+0000 7fca4ce4f640 0 -- 172.21.15.131:0/4252817986 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x56075584ea90 msgr2=0x560755850e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:50.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.510+0000 7fca5a012800 20 add_watcher() i=0 2023-12-03T11:33:50.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.510+0000 7fca5a012800 20 add_watcher() i=1 2023-12-03T11:33:50.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.510+0000 7fca5a012800 20 add_watcher() i=2 2023-12-03T11:33:50.511 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.510+0000 7fca5a012800 20 add_watcher() i=3 2023-12-03T11:33:50.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.510+0000 7fca5a012800 20 add_watcher() i=4 2023-12-03T11:33:50.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.510+0000 7fca5a012800 20 add_watcher() i=5 2023-12-03T11:33:50.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.510+0000 7fca5a012800 20 add_watcher() i=6 2023-12-03T11:33:50.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.511+0000 7fca5a012800 20 add_watcher() i=7 2023-12-03T11:33:50.512 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.511+0000 7fca5a012800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:50.513 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.512+0000 7fca1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:50.514 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.513+0000 7fca5a012800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:50.514 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.513+0000 7fca5a012800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:50.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.519+0000 7fca5a012800 5 note: GC not initialized 2023-12-03T11:33:50.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.519+0000 7fc989ffb640 20 reqs_thread_entry: start 2023-12-03T11:33:50.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.519+0000 7fca5a012800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:50.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.519+0000 7fca5a012800 20 Filter name: none 2023-12-03T11:33:50.520 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.519+0000 7fc97b7fe640 20 reqs_thread_entry: start 2023-12-03T11:33:50.521 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.519+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.521 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.520+0000 7fca5a012800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:50.521 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.520+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.520+0000 7fca5a012800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:50.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.520+0000 7fca5a012800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:50.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.520+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.521+0000 7fca5a012800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:50.522 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.521+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.523 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.521+0000 7fca5a012800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:50.523 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.521+0000 7fca5a012800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:50.523 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.521+0000 7fca5a012800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.523 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.522+0000 7fca5a012800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.523 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.522+0000 7fca1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:50.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.525+0000 7fca5a012800 20 remove_watcher() i=0 2023-12-03T11:33:50.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.525+0000 7fca5a012800 2 removed watcher, disabling cache 2023-12-03T11:33:50.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.525+0000 7fca5a012800 20 remove_watcher() i=1 2023-12-03T11:33:50.528 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.526+0000 7fca5a012800 20 remove_watcher() i=2 2023-12-03T11:33:50.529 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.528+0000 7fca5a012800 20 remove_watcher() i=3 2023-12-03T11:33:50.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.529+0000 7fca5a012800 20 remove_watcher() i=4 2023-12-03T11:33:50.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.530+0000 7fca5a012800 20 remove_watcher() i=5 2023-12-03T11:33:50.532 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.531+0000 7fca5a012800 20 remove_watcher() i=6 2023-12-03T11:33:50.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.532+0000 7fca5a012800 20 remove_watcher() i=7 2023-12-03T11:33:50.537 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:50.537 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:33:50.538 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: a-bucket id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 num_objects: 0 size_kb: 0 num_shards: 1 2023-12-03T11:33:50.538 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:50.539 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2023-12-03T11:33:50.568 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:50.568 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:50.582 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.581+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.583+0000 7f6444f24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.583+0000 7f6444f24800 20 realm 2023-12-03T11:33:50.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.583+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.583+0000 7f6444f24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.583+0000 7f6444f24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:50.584 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.583+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.583+0000 7f6444f24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.583+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.584+0000 7f6444f24800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:50.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.584+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.584+0000 7f6444f24800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:50.585 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.584+0000 7f6444f24800 20 searching for the correct realm 2023-12-03T11:33:50.595 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.594+0000 7f6440b1c640 0 -- 172.21.15.131:0/2922337278 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55ec82caeb30 msgr2=0x55ec82cb0f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:50.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.595+0000 7f6444f24800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:50.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.595+0000 7f6444f24800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:50.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.595+0000 7f6444f24800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:50.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.595+0000 7f6444f24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:50.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.595+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:50.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 20 zone default found 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 4 Realm: () 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 20 zonegroup default 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.596+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.597+0000 7f6444f24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.597+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.597+0000 7f6444f24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.597+0000 7f6444f24800 20 started sync module instance, tier type = 2023-12-03T11:33:50.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.597+0000 7f6444f24800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:50.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.603+0000 7f644131d640 0 -- 172.21.15.131:0/2922337278 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f642c008070 msgr2=0x7f642c07a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:50.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.606+0000 7f6444f24800 20 add_watcher() i=0 2023-12-03T11:33:50.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.606+0000 7f6444f24800 20 add_watcher() i=1 2023-12-03T11:33:50.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.606+0000 7f6444f24800 20 add_watcher() i=2 2023-12-03T11:33:50.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.606+0000 7f6444f24800 20 add_watcher() i=3 2023-12-03T11:33:50.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.606+0000 7f6444f24800 20 add_watcher() i=4 2023-12-03T11:33:50.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.606+0000 7f6444f24800 20 add_watcher() i=5 2023-12-03T11:33:50.607 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.606+0000 7f6444f24800 20 add_watcher() i=6 2023-12-03T11:33:50.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.607+0000 7f6444f24800 20 add_watcher() i=7 2023-12-03T11:33:50.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.607+0000 7f6444f24800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:50.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.608+0000 7f64067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:50.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.609+0000 7f6444f24800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:50.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.609+0000 7f6444f24800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:50.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.614+0000 7f6444f24800 5 note: GC not initialized 2023-12-03T11:33:50.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.615+0000 7f63757fa640 20 reqs_thread_entry: start 2023-12-03T11:33:50.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.615+0000 7f6444f24800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:50.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.615+0000 7f6444f24800 20 Filter name: none 2023-12-03T11:33:50.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.615+0000 7f636effd640 20 reqs_thread_entry: start 2023-12-03T11:33:50.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.615+0000 7f6444f24800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:33:50.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.615+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.615+0000 7f6444f24800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:50.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.615+0000 7f6444f24800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-12-03T11:33:50.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.615+0000 7f6444f24800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:33:50.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.615+0000 7f6444f24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 : miss 2023-12-03T11:33:50.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.615+0000 7f6444f24800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.616+0000 7f6444f24800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:50.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.616+0000 7f6444f24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:50.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.616+0000 7f6444f24800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:50.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.616+0000 7f6444f24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:33:50.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.616+0000 7f6444f24800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:50.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.616+0000 7f6444f24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 2023-12-03T11:33:50.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.618+0000 7f64067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:50.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.620+0000 7f6444f24800 20 remove_watcher() i=0 2023-12-03T11:33:50.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.620+0000 7f6444f24800 2 removed watcher, disabling cache 2023-12-03T11:33:50.622 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.621+0000 7f6444f24800 20 remove_watcher() i=1 2023-12-03T11:33:50.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.622+0000 7f6444f24800 20 remove_watcher() i=2 2023-12-03T11:33:50.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.623+0000 7f6444f24800 20 remove_watcher() i=3 2023-12-03T11:33:50.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.624+0000 7f6444f24800 20 remove_watcher() i=4 2023-12-03T11:33:50.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.625+0000 7f6444f24800 20 remove_watcher() i=5 2023-12-03T11:33:50.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.626+0000 7f6444f24800 20 remove_watcher() i=6 2023-12-03T11:33:50.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.627+0000 7f6444f24800 20 remove_watcher() i=7 2023-12-03T11:33:50.634 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin reshard list 2023-12-03T11:33:50.659 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:50.659 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:50.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.672+0000 7f7afb722800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.673+0000 7f7afb722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.673+0000 7f7afb722800 20 realm 2023-12-03T11:33:50.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.673+0000 7f7afb722800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.674+0000 7f7afb722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.674+0000 7f7afb722800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:50.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.674+0000 7f7afb722800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.674+0000 7f7afb722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.675 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.674+0000 7f7afb722800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.676 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.675+0000 7f7afb722800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:50.676 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.675+0000 7f7afb722800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.676 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.675+0000 7f7afb722800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:50.676 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.675+0000 7f7afb722800 20 searching for the correct realm 2023-12-03T11:33:50.685 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.684+0000 7f7aeeba5640 0 -- 172.21.15.131:0/3870797994 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x56201acf6650 msgr2=0x56201acf8a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:50.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.685+0000 7f7afb722800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:50.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.685+0000 7f7afb722800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:50.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.685+0000 7f7afb722800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:50.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.685+0000 7f7afb722800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:50.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.685+0000 7f7afb722800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.687 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:50.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:50.688 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 20 zone default found 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 4 Realm: () 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 20 zonegroup default 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.686+0000 7f7afb722800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.687+0000 7f7afb722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.687+0000 7f7afb722800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.687+0000 7f7afb722800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.687+0000 7f7afb722800 20 started sync module instance, tier type = 2023-12-03T11:33:50.689 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.687+0000 7f7afb722800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:50.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.692+0000 7f7af73a6640 0 -- 172.21.15.131:0/3870797994 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f7af0031040 msgr2=0x7f7af0014980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:50.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.697+0000 7f7afb722800 20 add_watcher() i=0 2023-12-03T11:33:50.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.697+0000 7f7afb722800 20 add_watcher() i=1 2023-12-03T11:33:50.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.697+0000 7f7afb722800 20 add_watcher() i=2 2023-12-03T11:33:50.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.697+0000 7f7afb722800 20 add_watcher() i=3 2023-12-03T11:33:50.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.697+0000 7f7afb722800 20 add_watcher() i=4 2023-12-03T11:33:50.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.697+0000 7f7afb722800 20 add_watcher() i=5 2023-12-03T11:33:50.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.697+0000 7f7afb722800 20 add_watcher() i=6 2023-12-03T11:33:50.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.698+0000 7f7afb722800 20 add_watcher() i=7 2023-12-03T11:33:50.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.698+0000 7f7afb722800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:50.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.699+0000 7f7abd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:50.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.699+0000 7f7afb722800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:50.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.699+0000 7f7afb722800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:50.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.705+0000 7f7afb722800 5 note: GC not initialized 2023-12-03T11:33:50.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.706+0000 7f7a2bfff640 20 reqs_thread_entry: start 2023-12-03T11:33:50.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.706+0000 7f7afb722800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:50.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.706+0000 7f7afb722800 20 Filter name: none 2023-12-03T11:33:50.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.706+0000 7f7a29ffb640 20 reqs_thread_entry: start 2023-12-03T11:33:50.714 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.713+0000 7f7abd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:50.716 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.715+0000 7f7afb722800 20 remove_watcher() i=0 2023-12-03T11:33:50.717 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.715+0000 7f7afb722800 2 removed watcher, disabling cache 2023-12-03T11:33:50.717 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.716+0000 7f7afb722800 20 remove_watcher() i=1 2023-12-03T11:33:50.719 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.717+0000 7f7afb722800 20 remove_watcher() i=2 2023-12-03T11:33:50.719 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.718+0000 7f7afb722800 20 remove_watcher() i=3 2023-12-03T11:33:50.720 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.719+0000 7f7afb722800 20 remove_watcher() i=4 2023-12-03T11:33:50.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.720+0000 7f7afb722800 20 remove_watcher() i=5 2023-12-03T11:33:50.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.721+0000 7f7afb722800 20 remove_watcher() i=6 2023-12-03T11:33:50.723 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.722+0000 7f7afb722800 20 remove_watcher() i=7 2023-12-03T11:33:50.728 INFO:tasks.workunit.client.0.smithi131.stderr:bucket name a-bucket 2023-12-03T11:33:50.728 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard process 2023-12-03T11:33:50.729 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:50.730 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin reshard process 2023-12-03T11:33:50.755 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:50.755 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:50.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.768+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.769+0000 7f4dbc02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.769+0000 7f4dbc02f800 20 realm 2023-12-03T11:33:50.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.769+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.770+0000 7f4dbc02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.770+0000 7f4dbc02f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:50.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.770+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.770+0000 7f4dbc02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.770+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.771+0000 7f4dbc02f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:50.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.771+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.771+0000 7f4dbc02f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:50.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.771+0000 7f4dbc02f800 20 searching for the correct realm 2023-12-03T11:33:50.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.778+0000 7f4db721a640 0 -- 172.21.15.131:0/2612313251 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55f761943b40 msgr2=0x55f761945f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:50.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.781+0000 7f4dbc02f800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:50.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.781+0000 7f4dbc02f800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:50.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.781+0000 7f4dbc02f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:50.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.781+0000 7f4dbc02f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:50.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.781+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.781+0000 7f4dbc02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.781+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.781+0000 7f4dbc02f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:50.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:50.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 20 zone default found 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 4 Realm: () 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 20 zonegroup default 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.782+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.783+0000 7f4dbc02f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.783+0000 7f4dbc02f800 20 started sync module instance, tier type = 2023-12-03T11:33:50.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.783+0000 7f4dbc02f800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:50.786 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.785+0000 7f4db7a1b640 0 -- 172.21.15.131:0/2612313251 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f4da0058b00 msgr2=0x7f4da005c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:50.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.792+0000 7f4dbc02f800 20 add_watcher() i=0 2023-12-03T11:33:50.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.792+0000 7f4dbc02f800 20 add_watcher() i=1 2023-12-03T11:33:50.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.792+0000 7f4dbc02f800 20 add_watcher() i=2 2023-12-03T11:33:50.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.792+0000 7f4dbc02f800 20 add_watcher() i=3 2023-12-03T11:33:50.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.792+0000 7f4dbc02f800 20 add_watcher() i=4 2023-12-03T11:33:50.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.792+0000 7f4dbc02f800 20 add_watcher() i=5 2023-12-03T11:33:50.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.792+0000 7f4dbc02f800 20 add_watcher() i=6 2023-12-03T11:33:50.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.792+0000 7f4dbc02f800 20 add_watcher() i=7 2023-12-03T11:33:50.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.792+0000 7f4dbc02f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:50.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.794+0000 7f4d7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:50.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.794+0000 7f4dbc02f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:50.796 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.794+0000 7f4dbc02f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:50.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.800+0000 7f4dbc02f800 5 note: GC not initialized 2023-12-03T11:33:50.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.800+0000 7f4cebfff640 20 reqs_thread_entry: start 2023-12-03T11:33:50.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.800+0000 7f4dbc02f800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:50.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.800+0000 7f4dbc02f800 20 Filter name: none 2023-12-03T11:33:50.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.800+0000 7f4ce9ffb640 20 reqs_thread_entry: start 2023-12-03T11:33:50.802 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.800+0000 7f4dbc02f800 20 processing logshard = reshard.0000000000 2023-12-03T11:33:50.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.803+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000000 , ret = 0 2023-12-03T11:33:50.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.803+0000 7f4dbc02f800 20 processing logshard = reshard.0000000001 2023-12-03T11:33:50.807 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.806+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000001 , ret = 0 2023-12-03T11:33:50.807 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.806+0000 7f4dbc02f800 20 processing logshard = reshard.0000000002 2023-12-03T11:33:50.810 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.809+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000002 , ret = 0 2023-12-03T11:33:50.810 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.809+0000 7f4dbc02f800 20 processing logshard = reshard.0000000003 2023-12-03T11:33:50.812 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.811+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000003 , ret = 0 2023-12-03T11:33:50.812 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.811+0000 7f4dbc02f800 20 processing logshard = reshard.0000000004 2023-12-03T11:33:50.815 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.814+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000004 , ret = 0 2023-12-03T11:33:50.815 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.814+0000 7f4dbc02f800 20 processing logshard = reshard.0000000005 2023-12-03T11:33:50.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.817+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000005 , ret = 0 2023-12-03T11:33:50.818 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.817+0000 7f4dbc02f800 20 processing logshard = reshard.0000000006 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 20 process_entry resharding a-bucket 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 : miss 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:33:50.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:50.822 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.819+0000 7f4dbc02f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 2023-12-03T11:33:50.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.825+0000 7f4dbc02f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:50.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.825+0000 7f4dbc02f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:50.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.825+0000 7f4dbc02f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:50.826 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.825+0000 7f4dbc02f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16, ofs0, ns] 2023-12-03T11:33:50.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.825+0000 7f4dada17640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791379 cookie 94520982439744 notifier 5882 bl.length()=789 2023-12-03T11:33:50.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.825+0000 7f4dada17640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:50.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.825+0000 7f4dada17640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:50.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.825+0000 7f4dada17640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:50.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.826+0000 7f4dbc02f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_sources= new_sources= 2023-12-03T11:33:50.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.826+0000 7f4dbc02f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential sources added=[] removed=[] 2023-12-03T11:33:50.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.826+0000 7f4dbc02f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_dests= new_dests= 2023-12-03T11:33:50.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.826+0000 7f4dbc02f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential dests added=[] removed=[] 2023-12-03T11:33:50.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.827+0000 7f4dbc02f800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.1.0 2023-12-03T11:33:50.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.827+0000 7f4dbc02f800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.1.0 2023-12-03T11:33:50.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.827+0000 7f4dbc02f800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.1.1 2023-12-03T11:33:50.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.827+0000 7f4dbc02f800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.1.1 2023-12-03T11:33:50.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.827+0000 7f4dbc02f800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.0 2023-12-03T11:33:50.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.827+0000 7f4dbc02f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 : hit (requested=0x17, cached=0x17) 2023-12-03T11:33:50.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.827+0000 7f4dbc02f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 2023-12-03T11:33:50.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.828+0000 7f4dbc02f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:50.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.828+0000 7f4dbc02f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:50.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.828+0000 7f4dbc02f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:50.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.828+0000 7f4dbc02f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16, ofs0, ns] 2023-12-03T11:33:50.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.828+0000 7f4dad216640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791380 cookie 94520982439744 notifier 5882 bl.length()=757 2023-12-03T11:33:50.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.828+0000 7f4dad216640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:50.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.828+0000 7f4dad216640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:50.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.828+0000 7f4dad216640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:50.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.829+0000 7f4dbc02f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_sources= new_sources= 2023-12-03T11:33:50.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.829+0000 7f4dbc02f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential sources added=[] removed=[] 2023-12-03T11:33:50.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.829+0000 7f4dbc02f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_dests= new_dests= 2023-12-03T11:33:50.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.829+0000 7f4dbc02f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential dests added=[] removed=[] 2023-12-03T11:33:50.831 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.830+0000 7f4dbc02f800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-12-03T11:33:50.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.831+0000 7f4dbc02f800 20 process_entry removing reshard queue entry for bucket a-bucket 2023-12-03T11:33:50.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.832+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000006 , ret = 0 2023-12-03T11:33:50.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.833+0000 7f4dbc02f800 20 processing logshard = reshard.0000000007 2023-12-03T11:33:50.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.835+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000007 , ret = 0 2023-12-03T11:33:50.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.835+0000 7f4dbc02f800 20 processing logshard = reshard.0000000008 2023-12-03T11:33:50.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.837+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000008 , ret = 0 2023-12-03T11:33:50.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.837+0000 7f4dbc02f800 20 processing logshard = reshard.0000000009 2023-12-03T11:33:50.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.839+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000009 , ret = 0 2023-12-03T11:33:50.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.839+0000 7f4dbc02f800 20 processing logshard = reshard.0000000010 2023-12-03T11:33:50.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.841+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000010 , ret = 0 2023-12-03T11:33:50.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.841+0000 7f4dbc02f800 20 processing logshard = reshard.0000000011 2023-12-03T11:33:50.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.844+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000011 , ret = 0 2023-12-03T11:33:50.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.844+0000 7f4dbc02f800 20 processing logshard = reshard.0000000012 2023-12-03T11:33:50.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.846+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000012 , ret = 0 2023-12-03T11:33:50.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.846+0000 7f4dbc02f800 20 processing logshard = reshard.0000000013 2023-12-03T11:33:50.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.849+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000013 , ret = 0 2023-12-03T11:33:50.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.849+0000 7f4dbc02f800 20 processing logshard = reshard.0000000014 2023-12-03T11:33:50.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.851+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000014 , ret = 0 2023-12-03T11:33:50.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.851+0000 7f4dbc02f800 20 processing logshard = reshard.0000000015 2023-12-03T11:33:50.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.853+0000 7f4dbc02f800 20 finish processing logshard = reshard.0000000015 , ret = 0 2023-12-03T11:33:50.855 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.854+0000 7f4d7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:50.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.856+0000 7f4dbc02f800 20 remove_watcher() i=0 2023-12-03T11:33:50.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.856+0000 7f4dbc02f800 2 removed watcher, disabling cache 2023-12-03T11:33:50.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.857+0000 7f4dbc02f800 20 remove_watcher() i=1 2023-12-03T11:33:50.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.858+0000 7f4dbc02f800 20 remove_watcher() i=2 2023-12-03T11:33:50.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.859+0000 7f4dbc02f800 20 remove_watcher() i=3 2023-12-03T11:33:50.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.860+0000 7f4dbc02f800 20 remove_watcher() i=4 2023-12-03T11:33:50.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.861+0000 7f4dbc02f800 20 remove_watcher() i=5 2023-12-03T11:33:50.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.862+0000 7f4dbc02f800 20 remove_watcher() i=6 2023-12-03T11:33:50.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:50.863+0000 7f4dbc02f800 20 remove_watcher() i=7 2023-12-03T11:33:55.876 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:33:55.907 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:55.907 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:55.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.922+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.924+0000 7f1159131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:55.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.924+0000 7f1159131800 20 realm 2023-12-03T11:33:55.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.924+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.924+0000 7f1159131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:55.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.924+0000 7f1159131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:55.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.924+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.925+0000 7f1159131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:55.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.925+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.926+0000 7f1159131800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:55.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.926+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.926+0000 7f1159131800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:55.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.926+0000 7f1159131800 20 searching for the correct realm 2023-12-03T11:33:55.936 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.935+0000 7f115557f640 0 -- 172.21.15.131:0/3606415566 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7f113c02a040 msgr2=0x7f113c01a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:55.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.938+0000 7f1159131800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:55.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.938+0000 7f1159131800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:55.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.938+0000 7f1159131800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:55.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.938+0000 7f1159131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:55.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.938+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.938+0000 7f1159131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:55.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:55.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:55.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 20 zone default found 2023-12-03T11:33:55.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 4 Realm: () 2023-12-03T11:33:55.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:55.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:55.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:55.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 20 zonegroup default 2023-12-03T11:33:55.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.939+0000 7f1159131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:55.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.940+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.940+0000 7f114c57d640 0 -- 172.21.15.131:0/3606415566 >> [v2:172.21.15.148:6800/4184359357,v1:172.21.15.148:6801/4184359357] conn(0x7f114406f040 msgr2=0x7f1144070430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:55.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.940+0000 7f1159131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:55.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.940+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.940+0000 7f1159131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:55.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.940+0000 7f1159131800 20 started sync module instance, tier type = 2023-12-03T11:33:55.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.940+0000 7f1159131800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:55.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.950+0000 7f1159131800 20 add_watcher() i=0 2023-12-03T11:33:55.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.950+0000 7f1159131800 20 add_watcher() i=1 2023-12-03T11:33:55.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.950+0000 7f1159131800 20 add_watcher() i=2 2023-12-03T11:33:55.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.950+0000 7f1159131800 20 add_watcher() i=3 2023-12-03T11:33:55.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.950+0000 7f1159131800 20 add_watcher() i=4 2023-12-03T11:33:55.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.950+0000 7f1159131800 20 add_watcher() i=5 2023-12-03T11:33:55.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.950+0000 7f1159131800 20 add_watcher() i=6 2023-12-03T11:33:55.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.951+0000 7f1159131800 20 add_watcher() i=7 2023-12-03T11:33:55.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.951+0000 7f1159131800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:55.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.953+0000 7f111b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:55.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.953+0000 7f1159131800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:55.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.953+0000 7f1159131800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:55.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.959+0000 7f1159131800 5 note: GC not initialized 2023-12-03T11:33:55.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.959+0000 7f108a7fc640 20 reqs_thread_entry: start 2023-12-03T11:33:55.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.959+0000 7f1159131800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:55.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.959+0000 7f1159131800 20 Filter name: none 2023-12-03T11:33:55.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.960+0000 7f107bfff640 20 reqs_thread_entry: start 2023-12-03T11:33:55.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.960+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.960+0000 7f1159131800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:55.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.960+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.961+0000 7f1159131800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:55.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.961+0000 7f1159131800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:55.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.961+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.961+0000 7f1159131800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:55.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.961+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.961+0000 7f1159131800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:55.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.961+0000 7f1159131800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:55.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.962+0000 7f1159131800 20 rados->read ofs=0 len=0 2023-12-03T11:33:55.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.962+0000 7f1159131800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:55.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.963+0000 7f111b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:55.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.965+0000 7f1159131800 20 remove_watcher() i=0 2023-12-03T11:33:55.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.965+0000 7f1159131800 2 removed watcher, disabling cache 2023-12-03T11:33:55.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.966+0000 7f1159131800 20 remove_watcher() i=1 2023-12-03T11:33:55.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.968+0000 7f1159131800 20 remove_watcher() i=2 2023-12-03T11:33:55.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.969+0000 7f1159131800 20 remove_watcher() i=3 2023-12-03T11:33:55.971 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.970+0000 7f1159131800 20 remove_watcher() i=4 2023-12-03T11:33:55.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.971+0000 7f1159131800 20 remove_watcher() i=5 2023-12-03T11:33:55.973 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.972+0000 7f1159131800 20 remove_watcher() i=6 2023-12-03T11:33:55.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:55.973+0000 7f1159131800 20 remove_watcher() i=7 2023-12-03T11:33:55.979 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:55.979 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:33:55.979 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: a-bucket id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 num_objects: 0 size_kb: 0 num_shards: 2 2023-12-03T11:33:55.979 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:55.979 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard add non empty bucket 2023-12-03T11:33:55.980 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:56.033 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:33:56.060 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:56.060 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:56.073 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.072+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.074+0000 7f72e132b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.074+0000 7f72e132b800 20 realm 2023-12-03T11:33:56.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.074+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.074+0000 7f72e132b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.074+0000 7f72e132b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:56.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.074+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.074+0000 7f72e132b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.074+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.075+0000 7f72e132b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.075+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.075+0000 7f72e132b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:56.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.075+0000 7f72e132b800 20 searching for the correct realm 2023-12-03T11:33:56.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.085+0000 7f72dd833640 0 -- 172.21.15.131:0/267118162 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f72c8057160 msgr2=0x7f72c8014890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:33:56.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.086+0000 7f72e132b800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:56.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.086+0000 7f72e132b800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:56.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.086+0000 7f72e132b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:56.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.086+0000 7f72e132b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:56.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.086+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.086+0000 7f72e132b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.086+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 20 zone default found 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 4 Realm: () 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 20 zonegroup default 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.087+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.088+0000 7f72e132b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.088+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.088+0000 7f72e132b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.088+0000 7f72e132b800 20 started sync module instance, tier type = 2023-12-03T11:33:56.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.088+0000 7f72e132b800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:56.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.095+0000 7f72d7fff640 0 -- 172.21.15.131:0/267118162 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x561a74b0e010 msgr2=0x561a74b10440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:56.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.097+0000 7f72e132b800 20 add_watcher() i=0 2023-12-03T11:33:56.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.097+0000 7f72e132b800 20 add_watcher() i=1 2023-12-03T11:33:56.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.097+0000 7f72e132b800 20 add_watcher() i=2 2023-12-03T11:33:56.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.097+0000 7f72e132b800 20 add_watcher() i=3 2023-12-03T11:33:56.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.097+0000 7f72e132b800 20 add_watcher() i=4 2023-12-03T11:33:56.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.097+0000 7f72e132b800 20 add_watcher() i=5 2023-12-03T11:33:56.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.097+0000 7f72e132b800 20 add_watcher() i=6 2023-12-03T11:33:56.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.098+0000 7f72e132b800 20 add_watcher() i=7 2023-12-03T11:33:56.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.098+0000 7f72e132b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:56.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.099+0000 7f72a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:56.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.100+0000 7f72e132b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:56.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.100+0000 7f72e132b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:56.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.105+0000 7f72e132b800 5 note: GC not initialized 2023-12-03T11:33:56.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.105+0000 7f7211ffb640 20 reqs_thread_entry: start 2023-12-03T11:33:56.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.105+0000 7f72e132b800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:56.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.105+0000 7f72e132b800 20 Filter name: none 2023-12-03T11:33:56.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.106+0000 7f72037fe640 20 reqs_thread_entry: start 2023-12-03T11:33:56.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.106+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.106+0000 7f72e132b800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:56.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.106+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.106+0000 7f72e132b800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:56.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.106+0000 7f72e132b800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:56.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.106+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.107+0000 7f72e132b800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:56.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.107+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.107+0000 7f72e132b800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:56.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.107+0000 7f72e132b800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:56.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.108+0000 7f72e132b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.108+0000 7f72e132b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.109+0000 7f72a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:56.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.111+0000 7f72e132b800 20 remove_watcher() i=0 2023-12-03T11:33:56.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.111+0000 7f72e132b800 2 removed watcher, disabling cache 2023-12-03T11:33:56.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.112+0000 7f72e132b800 20 remove_watcher() i=1 2023-12-03T11:33:56.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.113+0000 7f72e132b800 20 remove_watcher() i=2 2023-12-03T11:33:56.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.114+0000 7f72e132b800 20 remove_watcher() i=3 2023-12-03T11:33:56.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.115+0000 7f72e132b800 20 remove_watcher() i=4 2023-12-03T11:33:56.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.116+0000 7f72e132b800 20 remove_watcher() i=5 2023-12-03T11:33:56.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.117+0000 7f72e132b800 20 remove_watcher() i=6 2023-12-03T11:33:56.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.118+0000 7f72e132b800 20 remove_watcher() i=7 2023-12-03T11:33:56.123 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:56.124 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:33:56.124 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: a-bucket id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 num_objects: 8 size_kb: 1 num_shards: 2 2023-12-03T11:33:56.124 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:56.125 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2023-12-03T11:33:56.153 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:56.154 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:56.167 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.166+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.168+0000 7fa6d8211800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.168+0000 7fa6d8211800 20 realm 2023-12-03T11:33:56.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.168+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.168+0000 7fa6d8211800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.168+0000 7fa6d8211800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:56.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.168+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.168+0000 7fa6d8211800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.168+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.169+0000 7fa6d8211800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.169+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.169+0000 7fa6d8211800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:56.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.169+0000 7fa6d8211800 20 searching for the correct realm 2023-12-03T11:33:56.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.179+0000 7fa6d5d11640 0 -- 172.21.15.131:0/402211352 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x557a1b8ee2b0 msgr2=0x557a1b8f06a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:56.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.380+0000 7fa6d8211800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:56.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.380+0000 7fa6d8211800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:56.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.380+0000 7fa6d8211800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:56.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.380+0000 7fa6d8211800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:56.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.380+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.381+0000 7fa6d8211800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.381+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.381+0000 7fa6d8211800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.381+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:56.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 20 zone default found 2023-12-03T11:33:56.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 4 Realm: () 2023-12-03T11:33:56.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:56.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:56.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:56.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 20 zonegroup default 2023-12-03T11:33:56.384 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.382+0000 7fa6d8211800 20 started sync module instance, tier type = 2023-12-03T11:33:56.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.383+0000 7fa6d8211800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:56.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.388+0000 7fa6d6512640 0 -- 172.21.15.131:0/402211352 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7fa6cc058e80 msgr2=0x7fa6cc06c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:56.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.392+0000 7fa6d8211800 20 add_watcher() i=0 2023-12-03T11:33:56.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.392+0000 7fa6d8211800 20 add_watcher() i=1 2023-12-03T11:33:56.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.392+0000 7fa6d8211800 20 add_watcher() i=2 2023-12-03T11:33:56.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.392+0000 7fa6d8211800 20 add_watcher() i=3 2023-12-03T11:33:56.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.392+0000 7fa6d8211800 20 add_watcher() i=4 2023-12-03T11:33:56.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.392+0000 7fa6d8211800 20 add_watcher() i=5 2023-12-03T11:33:56.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.392+0000 7fa6d8211800 20 add_watcher() i=6 2023-12-03T11:33:56.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.393+0000 7fa6d8211800 20 add_watcher() i=7 2023-12-03T11:33:56.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.393+0000 7fa6d8211800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:56.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.394+0000 7fa69b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:56.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.395+0000 7fa6d8211800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:56.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.395+0000 7fa6d8211800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa6d8211800 5 note: GC not initialized 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa60a7fc640 20 reqs_thread_entry: start 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa6d8211800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa6d8211800 20 Filter name: none 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa5fbfff640 20 reqs_thread_entry: start 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa6d8211800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa6d8211800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa6d8211800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa6d8211800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa6d8211800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 : miss 2023-12-03T11:33:56.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.401+0000 7fa6d8211800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.402+0000 7fa6d8211800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:56.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.402+0000 7fa6d8211800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:56.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.402+0000 7fa6d8211800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:56.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.402+0000 7fa6d8211800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:33:56.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.402+0000 7fa6d8211800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:56.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.402+0000 7fa6d8211800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 2023-12-03T11:33:56.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.404+0000 7fa69b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:56.407 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.406+0000 7fa6d8211800 20 remove_watcher() i=0 2023-12-03T11:33:56.407 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.406+0000 7fa6d8211800 2 removed watcher, disabling cache 2023-12-03T11:33:56.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.407+0000 7fa6d8211800 20 remove_watcher() i=1 2023-12-03T11:33:56.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.408+0000 7fa6d8211800 20 remove_watcher() i=2 2023-12-03T11:33:56.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.409+0000 7fa6d8211800 20 remove_watcher() i=3 2023-12-03T11:33:56.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.410+0000 7fa6d8211800 20 remove_watcher() i=4 2023-12-03T11:33:56.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.411+0000 7fa6d8211800 20 remove_watcher() i=5 2023-12-03T11:33:56.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.412+0000 7fa6d8211800 20 remove_watcher() i=6 2023-12-03T11:33:56.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.413+0000 7fa6d8211800 20 remove_watcher() i=7 2023-12-03T11:33:56.420 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin reshard list 2023-12-03T11:33:56.446 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:56.446 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:56.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.459+0000 7ff12872e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.460+0000 7ff12872e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.460+0000 7ff12872e800 20 realm 2023-12-03T11:33:56.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.460+0000 7ff12872e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.460+0000 7ff12872e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.460+0000 7ff12872e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:56.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.460+0000 7ff12872e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.461+0000 7ff12872e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.461+0000 7ff12872e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.461+0000 7ff12872e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.461+0000 7ff12872e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.462+0000 7ff12872e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:56.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.462+0000 7ff12872e800 20 searching for the correct realm 2023-12-03T11:33:56.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.471+0000 7ff1244c6640 0 -- 172.21.15.131:0/2778679121 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55f0f528d610 msgr2=0x55f0f528fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:56.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.473+0000 7ff12872e800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:56.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.473+0000 7ff12872e800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:56.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.473+0000 7ff12872e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:56.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.473+0000 7ff12872e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:56.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.473+0000 7ff12872e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.473+0000 7ff12872e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.473+0000 7ff12872e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.473+0000 7ff12872e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.473+0000 7ff12872e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:56.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 20 zone default found 2023-12-03T11:33:56.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 4 Realm: () 2023-12-03T11:33:56.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:56.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:56.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:56.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 20 zonegroup default 2023-12-03T11:33:56.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 20 started sync module instance, tier type = 2023-12-03T11:33:56.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.474+0000 7ff12872e800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:56.481 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.480+0000 7ff124cc7640 0 -- 172.21.15.131:0/2778679121 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7ff11805c470 msgr2=0x7ff118085720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:33:56.484 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.483+0000 7ff12872e800 20 add_watcher() i=0 2023-12-03T11:33:56.484 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.483+0000 7ff12872e800 20 add_watcher() i=1 2023-12-03T11:33:56.484 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.483+0000 7ff12872e800 20 add_watcher() i=2 2023-12-03T11:33:56.484 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.483+0000 7ff12872e800 20 add_watcher() i=3 2023-12-03T11:33:56.484 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.483+0000 7ff12872e800 20 add_watcher() i=4 2023-12-03T11:33:56.485 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.483+0000 7ff12872e800 20 add_watcher() i=5 2023-12-03T11:33:56.485 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.483+0000 7ff12872e800 20 add_watcher() i=6 2023-12-03T11:33:56.485 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.484+0000 7ff12872e800 20 add_watcher() i=7 2023-12-03T11:33:56.485 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.484+0000 7ff12872e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:56.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.485+0000 7ff0ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:56.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.486+0000 7ff12872e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:56.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.486+0000 7ff12872e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:56.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.491+0000 7ff12872e800 5 note: GC not initialized 2023-12-03T11:33:56.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.491+0000 7ff0597fa640 20 reqs_thread_entry: start 2023-12-03T11:33:56.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.492+0000 7ff12872e800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:56.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.492+0000 7ff12872e800 20 Filter name: none 2023-12-03T11:33:56.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.492+0000 7ff052ffd640 20 reqs_thread_entry: start 2023-12-03T11:33:56.501 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.500+0000 7ff0ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:56.503 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.502+0000 7ff12872e800 20 remove_watcher() i=0 2023-12-03T11:33:56.503 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.502+0000 7ff12872e800 2 removed watcher, disabling cache 2023-12-03T11:33:56.504 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.503+0000 7ff12872e800 20 remove_watcher() i=1 2023-12-03T11:33:56.505 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.504+0000 7ff12872e800 20 remove_watcher() i=2 2023-12-03T11:33:56.506 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.505+0000 7ff12872e800 20 remove_watcher() i=3 2023-12-03T11:33:56.507 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.506+0000 7ff12872e800 20 remove_watcher() i=4 2023-12-03T11:33:56.508 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.507+0000 7ff12872e800 20 remove_watcher() i=5 2023-12-03T11:33:56.509 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.508+0000 7ff12872e800 20 remove_watcher() i=6 2023-12-03T11:33:56.510 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.509+0000 7ff12872e800 20 remove_watcher() i=7 2023-12-03T11:33:56.515 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard process non empty bucket 2023-12-03T11:33:56.515 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:56.516 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin reshard process 2023-12-03T11:33:56.541 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:56.541 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:56.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.554+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.556+0000 7f670571f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.556+0000 7f670571f800 20 realm 2023-12-03T11:33:56.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.556+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.556+0000 7f670571f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.556+0000 7f670571f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:56.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.556+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.556+0000 7f670571f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.556+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.557+0000 7f670571f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.557+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.557+0000 7f670571f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:56.559 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.557+0000 7f670571f800 20 searching for the correct realm 2023-12-03T11:33:56.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.567+0000 7f6701b55640 0 -- 172.21.15.131:0/295711319 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f66ec03e910 msgr2=0x7f66ec0203e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:56.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.567+0000 7f670571f800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:56.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.567+0000 7f670571f800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:56.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.567+0000 7f670571f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:56.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.567+0000 7f670571f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:56.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.567+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.567+0000 7f670571f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.567+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.567+0000 7f670571f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 20 zone default found 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 4 Realm: () 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 20 zonegroup default 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.568+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.569+0000 7f670571f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.569+0000 7f670571f800 20 started sync module instance, tier type = 2023-12-03T11:33:56.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.569+0000 7f670571f800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:56.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.577+0000 7f66fbfff640 0 -- 172.21.15.131:0/295711319 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55af52d2c250 msgr2=0x55af52d2e640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:56.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.577+0000 7f670571f800 20 add_watcher() i=0 2023-12-03T11:33:56.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.577+0000 7f670571f800 20 add_watcher() i=1 2023-12-03T11:33:56.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.577+0000 7f670571f800 20 add_watcher() i=2 2023-12-03T11:33:56.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.577+0000 7f670571f800 20 add_watcher() i=3 2023-12-03T11:33:56.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.577+0000 7f670571f800 20 add_watcher() i=4 2023-12-03T11:33:56.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.577+0000 7f670571f800 20 add_watcher() i=5 2023-12-03T11:33:56.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.577+0000 7f670571f800 20 add_watcher() i=6 2023-12-03T11:33:56.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.578+0000 7f670571f800 20 add_watcher() i=7 2023-12-03T11:33:56.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.578+0000 7f670571f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:56.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.580+0000 7f66c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:56.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.580+0000 7f670571f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:56.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.580+0000 7f670571f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:56.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.586+0000 7f670571f800 5 note: GC not initialized 2023-12-03T11:33:56.587 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.586+0000 7f6635ffb640 20 reqs_thread_entry: start 2023-12-03T11:33:56.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.586+0000 7f670571f800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:56.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.586+0000 7f670571f800 20 Filter name: none 2023-12-03T11:33:56.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.586+0000 7f66277fe640 20 reqs_thread_entry: start 2023-12-03T11:33:56.588 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.586+0000 7f670571f800 20 processing logshard = reshard.0000000000 2023-12-03T11:33:56.590 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.589+0000 7f670571f800 20 finish processing logshard = reshard.0000000000 , ret = 0 2023-12-03T11:33:56.590 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.589+0000 7f670571f800 20 processing logshard = reshard.0000000001 2023-12-03T11:33:56.592 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.591+0000 7f670571f800 20 finish processing logshard = reshard.0000000001 , ret = 0 2023-12-03T11:33:56.592 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.591+0000 7f670571f800 20 processing logshard = reshard.0000000002 2023-12-03T11:33:56.595 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.594+0000 7f670571f800 20 finish processing logshard = reshard.0000000002 , ret = 0 2023-12-03T11:33:56.595 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.594+0000 7f670571f800 20 processing logshard = reshard.0000000003 2023-12-03T11:33:56.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.596+0000 7f670571f800 20 finish processing logshard = reshard.0000000003 , ret = 0 2023-12-03T11:33:56.597 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.596+0000 7f670571f800 20 processing logshard = reshard.0000000004 2023-12-03T11:33:56.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.599+0000 7f670571f800 20 finish processing logshard = reshard.0000000004 , ret = 0 2023-12-03T11:33:56.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.599+0000 7f670571f800 20 processing logshard = reshard.0000000005 2023-12-03T11:33:56.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.601+0000 7f670571f800 20 finish processing logshard = reshard.0000000005 , ret = 0 2023-12-03T11:33:56.602 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.601+0000 7f670571f800 20 processing logshard = reshard.0000000006 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 20 process_entry resharding a-bucket 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 : miss 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:33:56.605 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:56.606 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.603+0000 7f670571f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 2023-12-03T11:33:56.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.608+0000 7f670571f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:56.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.608+0000 7f670571f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:56.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.608+0000 7f670571f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:56.609 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.608+0000 7f670571f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16, ofs0, ns] 2023-12-03T11:33:56.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.608+0000 7f66e37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791381 cookie 94211497206208 notifier 6270 bl.length()=789 2023-12-03T11:33:56.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.608+0000 7f66e37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:56.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.608+0000 7f66e37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:56.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.608+0000 7f66e37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:56.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.609+0000 7f670571f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_sources= new_sources= 2023-12-03T11:33:56.610 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.609+0000 7f670571f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential sources added=[] removed=[] 2023-12-03T11:33:56.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.609+0000 7f670571f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_dests= new_dests= 2023-12-03T11:33:56.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.609+0000 7f670571f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential dests added=[] removed=[] 2023-12-03T11:33:56.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.610+0000 7f670571f800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.0 2023-12-03T11:33:56.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.610+0000 7f670571f800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.0 2023-12-03T11:33:56.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.610+0000 7f670571f800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.1 2023-12-03T11:33:56.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.610+0000 7f670571f800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.1 2023-12-03T11:33:56.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.610+0000 7f670571f800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.2 2023-12-03T11:33:56.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.610+0000 7f670571f800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.2 2023-12-03T11:33:56.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.610+0000 7f670571f800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.1.0 2023-12-03T11:33:56.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.610+0000 7f670571f800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.1.0 2023-12-03T11:33:56.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.610+0000 7f670571f800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.1.1 2023-12-03T11:33:56.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.610+0000 7f670571f800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.1.1 2023-12-03T11:33:56.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.612+0000 7f670571f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 : hit (requested=0x17, cached=0x17) 2023-12-03T11:33:56.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.612+0000 7f670571f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 2023-12-03T11:33:56.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.613+0000 7f670571f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:56.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.613+0000 7f670571f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:56.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.613+0000 7f670571f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:56.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.613+0000 7f670571f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16, ofs0, ns] 2023-12-03T11:33:56.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.614+0000 7f66e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791382 cookie 94211497206208 notifier 6270 bl.length()=757 2023-12-03T11:33:56.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.614+0000 7f66e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:33:56.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.614+0000 7f66e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:33:56.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.614+0000 7f66e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:33:56.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.614+0000 7f670571f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_sources= new_sources= 2023-12-03T11:33:56.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.614+0000 7f670571f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential sources added=[] removed=[] 2023-12-03T11:33:56.615 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.614+0000 7f670571f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_dests= new_dests= 2023-12-03T11:33:56.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.614+0000 7f670571f800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential dests added=[] removed=[] 2023-12-03T11:33:56.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.615+0000 7f670571f800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-12-03T11:33:56.619 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.618+0000 7f670571f800 20 process_entry removing reshard queue entry for bucket a-bucket 2023-12-03T11:33:56.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.620+0000 7f670571f800 20 finish processing logshard = reshard.0000000006 , ret = 0 2023-12-03T11:33:56.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.620+0000 7f670571f800 20 processing logshard = reshard.0000000007 2023-12-03T11:33:56.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.622+0000 7f670571f800 20 finish processing logshard = reshard.0000000007 , ret = 0 2023-12-03T11:33:56.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.622+0000 7f670571f800 20 processing logshard = reshard.0000000008 2023-12-03T11:33:56.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.625+0000 7f670571f800 20 finish processing logshard = reshard.0000000008 , ret = 0 2023-12-03T11:33:56.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.625+0000 7f670571f800 20 processing logshard = reshard.0000000009 2023-12-03T11:33:56.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.627+0000 7f670571f800 20 finish processing logshard = reshard.0000000009 , ret = 0 2023-12-03T11:33:56.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.627+0000 7f670571f800 20 processing logshard = reshard.0000000010 2023-12-03T11:33:56.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.629+0000 7f670571f800 20 finish processing logshard = reshard.0000000010 , ret = 0 2023-12-03T11:33:56.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.629+0000 7f670571f800 20 processing logshard = reshard.0000000011 2023-12-03T11:33:56.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.631+0000 7f670571f800 20 finish processing logshard = reshard.0000000011 , ret = 0 2023-12-03T11:33:56.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.631+0000 7f670571f800 20 processing logshard = reshard.0000000012 2023-12-03T11:33:56.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.633+0000 7f670571f800 20 finish processing logshard = reshard.0000000012 , ret = 0 2023-12-03T11:33:56.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.633+0000 7f670571f800 20 processing logshard = reshard.0000000013 2023-12-03T11:33:56.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.635+0000 7f670571f800 20 finish processing logshard = reshard.0000000013 , ret = 0 2023-12-03T11:33:56.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.635+0000 7f670571f800 20 processing logshard = reshard.0000000014 2023-12-03T11:33:56.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.637+0000 7f670571f800 20 finish processing logshard = reshard.0000000014 , ret = 0 2023-12-03T11:33:56.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.637+0000 7f670571f800 20 processing logshard = reshard.0000000015 2023-12-03T11:33:56.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.640+0000 7f670571f800 20 finish processing logshard = reshard.0000000015 , ret = 0 2023-12-03T11:33:56.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.641+0000 7f66c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:56.644 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.642+0000 7f670571f800 20 remove_watcher() i=0 2023-12-03T11:33:56.644 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.642+0000 7f670571f800 2 removed watcher, disabling cache 2023-12-03T11:33:56.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.644+0000 7f670571f800 20 remove_watcher() i=1 2023-12-03T11:33:56.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.644+0000 7f670571f800 20 remove_watcher() i=2 2023-12-03T11:33:56.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.645+0000 7f670571f800 20 remove_watcher() i=3 2023-12-03T11:33:56.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.646+0000 7f670571f800 20 remove_watcher() i=4 2023-12-03T11:33:56.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.647+0000 7f670571f800 20 remove_watcher() i=5 2023-12-03T11:33:56.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.648+0000 7f670571f800 20 remove_watcher() i=6 2023-12-03T11:33:56.650 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.649+0000 7f670571f800 20 remove_watcher() i=7 2023-12-03T11:33:56.656 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:33:56.683 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:56.683 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:56.697 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.696+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.697+0000 7fd464c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.697+0000 7fd464c11800 20 realm 2023-12-03T11:33:56.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.697+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.698+0000 7fd464c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.698+0000 7fd464c11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:56.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.698+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.698+0000 7fd464c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.699 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.698+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.699+0000 7fd464c11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.699+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.699+0000 7fd464c11800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:56.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.699+0000 7fd464c11800 20 searching for the correct realm 2023-12-03T11:33:56.709 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.708+0000 7fd46021a640 0 -- 172.21.15.131:0/2424234857 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x561d0174e670 msgr2=0x561d01750a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:56.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.709+0000 7fd464c11800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:56.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.709+0000 7fd464c11800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:56.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.709+0000 7fd464c11800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:56.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.709+0000 7fd464c11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:56.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.709+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:56.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 20 zone default found 2023-12-03T11:33:56.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 4 Realm: () 2023-12-03T11:33:56.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:56.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:56.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:56.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 20 zonegroup default 2023-12-03T11:33:56.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.710+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.711+0000 7fd464c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.711+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.711+0000 7fd464c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.711+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.711+0000 7fd464c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.711+0000 7fd464c11800 20 started sync module instance, tier type = 2023-12-03T11:33:56.714 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.711+0000 7fd464c11800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:56.719 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.718+0000 7fd460a1b640 0 -- 172.21.15.131:0/2424234857 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7fd454057df0 msgr2=0x7fd4540890b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:56.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.720+0000 7fd464c11800 20 add_watcher() i=0 2023-12-03T11:33:56.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.720+0000 7fd464c11800 20 add_watcher() i=1 2023-12-03T11:33:56.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.720+0000 7fd464c11800 20 add_watcher() i=2 2023-12-03T11:33:56.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.720+0000 7fd464c11800 20 add_watcher() i=3 2023-12-03T11:33:56.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.720+0000 7fd464c11800 20 add_watcher() i=4 2023-12-03T11:33:56.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.720+0000 7fd464c11800 20 add_watcher() i=5 2023-12-03T11:33:56.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.720+0000 7fd464c11800 20 add_watcher() i=6 2023-12-03T11:33:56.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.721+0000 7fd464c11800 20 add_watcher() i=7 2023-12-03T11:33:56.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.721+0000 7fd464c11800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:56.724 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.723+0000 7fd4267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:56.724 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.723+0000 7fd464c11800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:56.724 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.723+0000 7fd464c11800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:56.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.729+0000 7fd464c11800 5 note: GC not initialized 2023-12-03T11:33:56.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.729+0000 7fd3957fa640 20 reqs_thread_entry: start 2023-12-03T11:33:56.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.729+0000 7fd464c11800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:56.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.729+0000 7fd464c11800 20 Filter name: none 2023-12-03T11:33:56.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.729+0000 7fd38effd640 20 reqs_thread_entry: start 2023-12-03T11:33:56.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.729+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.730+0000 7fd464c11800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:56.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.730+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.730+0000 7fd464c11800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:56.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.730+0000 7fd464c11800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:56.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.730+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.731+0000 7fd464c11800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:33:56.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.731+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.731+0000 7fd464c11800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:33:56.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.731+0000 7fd464c11800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:56.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.731+0000 7fd464c11800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.732+0000 7fd464c11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.732+0000 7fd4267e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:56.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.734+0000 7fd464c11800 20 remove_watcher() i=0 2023-12-03T11:33:56.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.734+0000 7fd464c11800 2 removed watcher, disabling cache 2023-12-03T11:33:56.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.735+0000 7fd464c11800 20 remove_watcher() i=1 2023-12-03T11:33:56.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.736+0000 7fd464c11800 20 remove_watcher() i=2 2023-12-03T11:33:56.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.737+0000 7fd464c11800 20 remove_watcher() i=3 2023-12-03T11:33:56.739 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.738+0000 7fd464c11800 20 remove_watcher() i=4 2023-12-03T11:33:56.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.739+0000 7fd464c11800 20 remove_watcher() i=5 2023-12-03T11:33:56.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.740+0000 7fd464c11800 20 remove_watcher() i=6 2023-12-03T11:33:56.742 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.741+0000 7fd464c11800 20 remove_watcher() i=7 2023-12-03T11:33:56.747 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:56.747 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:33:56.747 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: a-bucket id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 num_objects: 8 size_kb: 1 num_shards: 3 2023-12-03T11:33:56.747 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:56.747 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2023-12-03T11:33:56.748 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:56.936 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:33:56.963 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:56.963 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:56.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.975+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.977+0000 7fa72553a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.977+0000 7fa72553a800 20 realm 2023-12-03T11:33:56.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.977+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.978+0000 7fa72553a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.978+0000 7fa72553a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:56.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.978+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.978+0000 7fa72553a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.978+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.978+0000 7fa72553a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.978+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.979+0000 7fa72553a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:56.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.979+0000 7fa72553a800 20 searching for the correct realm 2023-12-03T11:33:56.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.988+0000 7fa72120d640 0 -- 172.21.15.131:0/1833462461 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x561b54755ba0 msgr2=0x561b54757f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:56.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:56.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:56.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:56.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:56.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:56.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:56.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 zone default found 2023-12-03T11:33:56.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 4 Realm: () 2023-12-03T11:33:56.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:56.993 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:56.993 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:56.993 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 zonegroup default 2023-12-03T11:33:56.994 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.989+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.994 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.990+0000 7fa72553a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.990+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.990+0000 7fa72553a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.990+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:56.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.990+0000 7fa72553a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:56.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.990+0000 7fa72553a800 20 started sync module instance, tier type = 2023-12-03T11:33:56.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.990+0000 7fa72553a800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:56.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.996+0000 7fa718a0c640 0 -- 172.21.15.131:0/1833462461 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x561b5475a9f0 msgr2=0x561b5475cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:57.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.999+0000 7fa72553a800 20 add_watcher() i=0 2023-12-03T11:33:57.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.999+0000 7fa72553a800 20 add_watcher() i=1 2023-12-03T11:33:57.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.999+0000 7fa72553a800 20 add_watcher() i=2 2023-12-03T11:33:57.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.999+0000 7fa72553a800 20 add_watcher() i=3 2023-12-03T11:33:57.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.999+0000 7fa72553a800 20 add_watcher() i=4 2023-12-03T11:33:57.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.999+0000 7fa72553a800 20 add_watcher() i=5 2023-12-03T11:33:57.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:56.999+0000 7fa72553a800 20 add_watcher() i=6 2023-12-03T11:33:57.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.000+0000 7fa72553a800 20 add_watcher() i=7 2023-12-03T11:33:57.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.000+0000 7fa72553a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:57.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.002+0000 7fa6e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.002+0000 7fa72553a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:57.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.002+0000 7fa72553a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:57.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.007+0000 7fa72553a800 5 note: GC not initialized 2023-12-03T11:33:57.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.008+0000 7fa655ffb640 20 reqs_thread_entry: start 2023-12-03T11:33:57.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.008+0000 7fa72553a800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:57.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.008+0000 7fa72553a800 20 Filter name: none 2023-12-03T11:33:57.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.008+0000 7fa6477fe640 20 reqs_thread_entry: start 2023-12-03T11:33:57.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.008+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.009+0000 7fa72553a800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.009+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.009+0000 7fa72553a800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.009+0000 7fa72553a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:57.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.009+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.009+0000 7fa72553a800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.009+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.010+0000 7fa72553a800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.010+0000 7fa72553a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:57.012 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.010+0000 7fa72553a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.012 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.010+0000 7fa72553a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.012 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.011+0000 7fa6e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.014 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.013+0000 7fa72553a800 20 remove_watcher() i=0 2023-12-03T11:33:57.014 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.013+0000 7fa72553a800 2 removed watcher, disabling cache 2023-12-03T11:33:57.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.014+0000 7fa72553a800 20 remove_watcher() i=1 2023-12-03T11:33:57.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.015+0000 7fa72553a800 20 remove_watcher() i=2 2023-12-03T11:33:57.017 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.016+0000 7fa72553a800 20 remove_watcher() i=3 2023-12-03T11:33:57.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.018+0000 7fa72553a800 20 remove_watcher() i=4 2023-12-03T11:33:57.020 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.019+0000 7fa72553a800 20 remove_watcher() i=5 2023-12-03T11:33:57.021 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.020+0000 7fa72553a800 20 remove_watcher() i=6 2023-12-03T11:33:57.022 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.020+0000 7fa72553a800 20 remove_watcher() i=7 2023-12-03T11:33:57.026 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:57.026 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:33:57.026 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-set-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:33:57.026 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:57.028 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2023-12-03T11:33:57.060 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:57.060 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:57.073 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.072+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.074+0000 7f8d38925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.074+0000 7f8d38925800 20 realm 2023-12-03T11:33:57.075 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.074+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.074+0000 7f8d38925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.074+0000 7f8d38925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:57.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.074+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.074+0000 7f8d38925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.074+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.075+0000 7f8d38925800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.075+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.075+0000 7f8d38925800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:57.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.075+0000 7f8d38925800 20 searching for the correct realm 2023-12-03T11:33:57.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.084+0000 7f8d346e5640 0 -- 172.21.15.131:0/1764346097 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55aced7bdc10 msgr2=0x55aced7c0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:57.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.085+0000 7f8d38925800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:57.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.085+0000 7f8d38925800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:57.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.085+0000 7f8d38925800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:57.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.085+0000 7f8d38925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:57.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.085+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.088 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.088 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 20 zone default found 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 4 Realm: () 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 20 zonegroup default 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.086+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.087+0000 7f8d38925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.087+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.087+0000 7f8d38925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.087+0000 7f8d38925800 20 started sync module instance, tier type = 2023-12-03T11:33:57.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.087+0000 7f8d38925800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:57.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.093+0000 7f8d33ee4640 0 -- 172.21.15.131:0/1764346097 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55aced7c2a60 msgr2=0x55aced7c4e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:57.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.095+0000 7f8d38925800 20 add_watcher() i=0 2023-12-03T11:33:57.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.095+0000 7f8d38925800 20 add_watcher() i=1 2023-12-03T11:33:57.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.095+0000 7f8d38925800 20 add_watcher() i=2 2023-12-03T11:33:57.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.095+0000 7f8d38925800 20 add_watcher() i=3 2023-12-03T11:33:57.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.095+0000 7f8d38925800 20 add_watcher() i=4 2023-12-03T11:33:57.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.095+0000 7f8d38925800 20 add_watcher() i=5 2023-12-03T11:33:57.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.095+0000 7f8d38925800 20 add_watcher() i=6 2023-12-03T11:33:57.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.096+0000 7f8d38925800 20 add_watcher() i=7 2023-12-03T11:33:57.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.096+0000 7f8d38925800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:57.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.098+0000 7f8cfa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.098+0000 7f8d38925800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:57.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.098+0000 7f8d38925800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:57.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.104+0000 7f8d38925800 5 note: GC not initialized 2023-12-03T11:33:57.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.104+0000 7f8c697fa640 20 reqs_thread_entry: start 2023-12-03T11:33:57.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.104+0000 7f8d38925800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:57.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.104+0000 7f8d38925800 20 Filter name: none 2023-12-03T11:33:57.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.104+0000 7f8c62ffd640 20 reqs_thread_entry: start 2023-12-03T11:33:57.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.104+0000 7f8d38925800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-12-03T11:33:57.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.104+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.105+0000 7f8d38925800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.105+0000 7f8d38925800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-12-03T11:33:57.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.105+0000 7f8d38925800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-12-03T11:33:57.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.105+0000 7f8d38925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 : miss 2023-12-03T11:33:57.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.105+0000 7f8d38925800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.105+0000 7f8d38925800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.105+0000 7f8d38925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 info.flags=0x17 2023-12-03T11:33:57.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.105+0000 7f8d38925800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 to cache LRU end 2023-12-03T11:33:57.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.105+0000 7f8d38925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:33:57.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.105+0000 7f8d38925800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.105+0000 7f8d38925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 2023-12-03T11:33:57.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.108+0000 7f8d38925800 -1 Injecting error=-5 at location=set_target_layout 2023-12-03T11:33:57.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.108+0000 7f8d38925800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2023-12-03T11:33:57.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.111+0000 7f8cfa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.113+0000 7f8d38925800 20 remove_watcher() i=0 2023-12-03T11:33:57.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.113+0000 7f8d38925800 2 removed watcher, disabling cache 2023-12-03T11:33:57.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.114+0000 7f8d38925800 20 remove_watcher() i=1 2023-12-03T11:33:57.116 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.115+0000 7f8d38925800 20 remove_watcher() i=2 2023-12-03T11:33:57.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.116+0000 7f8d38925800 20 remove_watcher() i=3 2023-12-03T11:33:57.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.117+0000 7f8d38925800 20 remove_watcher() i=4 2023-12-03T11:33:57.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.118+0000 7f8d38925800 20 remove_watcher() i=5 2023-12-03T11:33:57.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.119+0000 7f8d38925800 20 remove_watcher() i=6 2023-12-03T11:33:57.121 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.120+0000 7f8d38925800 20 remove_watcher() i=7 2023-12-03T11:33:57.127 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:33:57.154 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:57.155 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:57.168 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.167+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.168+0000 7f37b6d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.168+0000 7f37b6d1e800 20 realm 2023-12-03T11:33:57.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.168+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.169+0000 7f37b6d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.169+0000 7f37b6d1e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:57.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.169+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.169+0000 7f37b6d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.169+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.170+0000 7f37b6d1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.170+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.170+0000 7f37b6d1e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:57.171 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.170+0000 7f37b6d1e800 20 searching for the correct realm 2023-12-03T11:33:57.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.179+0000 7f37b4825640 0 -- 172.21.15.131:0/2483868998 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55c69b492110 msgr2=0x55c69b494500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:33:57.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.180+0000 7f37b6d1e800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:57.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.180+0000 7f37b6d1e800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:57.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.180+0000 7f37b6d1e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:57.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.180+0000 7f37b6d1e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:57.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.180+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.180+0000 7f37b6d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 20 zone default found 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 4 Realm: () 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 20 zonegroup default 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.181+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.182+0000 7f37b6d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.182+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.182+0000 7f37b6d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.182+0000 7f37b6d1e800 20 started sync module instance, tier type = 2023-12-03T11:33:57.186 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.182+0000 7f37b6d1e800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:57.188 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.187+0000 7f37b4825640 0 -- 172.21.15.131:0/2483868998 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f37b0080060 msgr2=0x7f37b00a4420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:57.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.191+0000 7f37b6d1e800 20 add_watcher() i=0 2023-12-03T11:33:57.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.191+0000 7f37b6d1e800 20 add_watcher() i=1 2023-12-03T11:33:57.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.191+0000 7f37b6d1e800 20 add_watcher() i=2 2023-12-03T11:33:57.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.191+0000 7f37b6d1e800 20 add_watcher() i=3 2023-12-03T11:33:57.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.191+0000 7f37b6d1e800 20 add_watcher() i=4 2023-12-03T11:33:57.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.191+0000 7f37b6d1e800 20 add_watcher() i=5 2023-12-03T11:33:57.192 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.191+0000 7f37b6d1e800 20 add_watcher() i=6 2023-12-03T11:33:57.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.191+0000 7f37b6d1e800 20 add_watcher() i=7 2023-12-03T11:33:57.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.191+0000 7f37b6d1e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:57.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.193+0000 7f377afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.193+0000 7f37b6d1e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:57.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.193+0000 7f37b6d1e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:57.200 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.199+0000 7f37b6d1e800 5 note: GC not initialized 2023-12-03T11:33:57.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.199+0000 7f36e9ffb640 20 reqs_thread_entry: start 2023-12-03T11:33:57.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.199+0000 7f37b6d1e800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:57.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.199+0000 7f37b6d1e800 20 Filter name: none 2023-12-03T11:33:57.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.199+0000 7f36db7fe640 20 reqs_thread_entry: start 2023-12-03T11:33:57.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.199+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.200+0000 7f37b6d1e800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.200+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.200+0000 7f37b6d1e800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.200+0000 7f37b6d1e800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:57.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.200+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.201+0000 7f37b6d1e800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.202 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.201+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.201+0000 7f37b6d1e800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.201+0000 7f37b6d1e800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:57.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.201+0000 7f37b6d1e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.202+0000 7f37b6d1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.202+0000 7f377afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.205+0000 7f37b6d1e800 20 remove_watcher() i=0 2023-12-03T11:33:57.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.205+0000 7f37b6d1e800 2 removed watcher, disabling cache 2023-12-03T11:33:57.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.206+0000 7f37b6d1e800 20 remove_watcher() i=1 2023-12-03T11:33:57.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.207+0000 7f37b6d1e800 20 remove_watcher() i=2 2023-12-03T11:33:57.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.208+0000 7f37b6d1e800 20 remove_watcher() i=3 2023-12-03T11:33:57.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.209+0000 7f37b6d1e800 20 remove_watcher() i=4 2023-12-03T11:33:57.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.210+0000 7f37b6d1e800 20 remove_watcher() i=5 2023-12-03T11:33:57.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.211+0000 7f37b6d1e800 20 remove_watcher() i=6 2023-12-03T11:33:57.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.212+0000 7f37b6d1e800 20 remove_watcher() i=7 2023-12-03T11:33:57.218 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:57.218 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:33:57.218 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-set-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:33:57.218 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:57.269 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:33:57.302 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:57.302 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:57.316 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.315+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.316+0000 7f18fb93b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.316+0000 7f18fb93b800 20 realm 2023-12-03T11:33:57.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.316+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.316+0000 7f18fb93b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.316+0000 7f18fb93b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:57.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.316+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.316+0000 7f18fb93b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.316+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.317+0000 7f18fb93b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.317+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.318+0000 7f18fb93b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:57.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.318+0000 7f18fb93b800 20 searching for the correct realm 2023-12-03T11:33:57.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.327+0000 7f18f7640640 0 -- 172.21.15.131:0/2283128997 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55fd065907a0 msgr2=0x55fd06592bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:57.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.329+0000 7f18fb93b800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:57.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.329+0000 7f18fb93b800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:57.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.329+0000 7f18fb93b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:57.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.329+0000 7f18fb93b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:57.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.329+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.329+0000 7f18fb93b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.329+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.329+0000 7f18fb93b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.329+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 20 zone default found 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 4 Realm: () 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 20 zonegroup default 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.333 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.330+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.333 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.331+0000 7f18fb93b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.333 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.331+0000 7f18fb93b800 20 started sync module instance, tier type = 2023-12-03T11:33:57.333 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.331+0000 7f18fb93b800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:57.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.336+0000 7f18f6e3f640 0 -- 172.21.15.131:0/2283128997 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55fd065957c0 msgr2=0x55fd06597bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:33:57.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.339+0000 7f18fb93b800 20 add_watcher() i=0 2023-12-03T11:33:57.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.339+0000 7f18fb93b800 20 add_watcher() i=1 2023-12-03T11:33:57.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.339+0000 7f18fb93b800 20 add_watcher() i=2 2023-12-03T11:33:57.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.339+0000 7f18fb93b800 20 add_watcher() i=3 2023-12-03T11:33:57.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.339+0000 7f18fb93b800 20 add_watcher() i=4 2023-12-03T11:33:57.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.339+0000 7f18fb93b800 20 add_watcher() i=5 2023-12-03T11:33:57.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.340+0000 7f18fb93b800 20 add_watcher() i=6 2023-12-03T11:33:57.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.340+0000 7f18fb93b800 20 add_watcher() i=7 2023-12-03T11:33:57.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.340+0000 7f18fb93b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:57.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.342+0000 7f18bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.342+0000 7f18fb93b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:57.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.342+0000 7f18fb93b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:57.349 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.348+0000 7f18fb93b800 5 note: GC not initialized 2023-12-03T11:33:57.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.348+0000 7f182bfff640 20 reqs_thread_entry: start 2023-12-03T11:33:57.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.348+0000 7f18fb93b800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:57.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.348+0000 7f18fb93b800 20 Filter name: none 2023-12-03T11:33:57.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.348+0000 7f1829ffb640 20 reqs_thread_entry: start 2023-12-03T11:33:57.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.348+0000 7f18fb93b800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-12-03T11:33:57.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.348+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.349+0000 7f18fb93b800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.349+0000 7f18fb93b800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-12-03T11:33:57.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.349+0000 7f18fb93b800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-12-03T11:33:57.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.349+0000 7f18fb93b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 : miss 2023-12-03T11:33:57.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.349+0000 7f18fb93b800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.349+0000 7f18fb93b800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.349+0000 7f18fb93b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 info.flags=0x17 2023-12-03T11:33:57.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.349+0000 7f18fb93b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 to cache LRU end 2023-12-03T11:33:57.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.349+0000 7f18fb93b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:33:57.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.349+0000 7f18fb93b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.349+0000 7f18fb93b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 2023-12-03T11:33:57.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.353+0000 7f18fb93b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 info.flags=0x17 2023-12-03T11:33:57.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.353+0000 7f18fb93b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 to cache LRU end 2023-12-03T11:33:57.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.353+0000 7f18fb93b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.353+0000 7f18fb93b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18, ofs0, ns] 2023-12-03T11:33:57.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.353+0000 7f18ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791384 cookie 94545221606304 notifier 6378 bl.length()=887 2023-12-03T11:33:57.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.353+0000 7f18ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 info.flags=0x17 2023-12-03T11:33:57.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.353+0000 7f18ddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 to cache LRU end 2023-12-03T11:33:57.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.353+0000 7f18ddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.354+0000 7f18fb93b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18]): orig_sources= new_sources= 2023-12-03T11:33:57.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.354+0000 7f18fb93b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18]): potential sources added=[] removed=[] 2023-12-03T11:33:57.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.354+0000 7f18fb93b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18]): orig_dests= new_dests= 2023-12-03T11:33:57.356 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.354+0000 7f18fb93b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18]): potential dests added=[] removed=[] 2023-12-03T11:33:57.356 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.355+0000 7f18fb93b800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18.1.0 2023-12-03T11:33:57.356 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.355+0000 7f18fb93b800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18.1.0 2023-12-03T11:33:57.356 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.355+0000 7f18fb93b800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18.1.1 2023-12-03T11:33:57.356 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.355+0000 7f18fb93b800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18.1.1 2023-12-03T11:33:57.356 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.355+0000 7f18fb93b800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18.0 2023-12-03T11:33:57.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.357+0000 7f18fb93b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 : hit (requested=0x17, cached=0x17) 2023-12-03T11:33:57.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.357+0000 7f18fb93b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 2023-12-03T11:33:57.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.358+0000 7f18fb93b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 info.flags=0x17 2023-12-03T11:33:57.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.358+0000 7f18fb93b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 to cache LRU end 2023-12-03T11:33:57.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.358+0000 7f18fb93b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.358+0000 7f18fb93b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18, ofs0, ns] 2023-12-03T11:33:57.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.359+0000 7f18dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791385 cookie 94545221606304 notifier 6378 bl.length()=855 2023-12-03T11:33:57.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.359+0000 7f18dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 info.flags=0x17 2023-12-03T11:33:57.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.359+0000 7f18dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 to cache LRU end 2023-12-03T11:33:57.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.359+0000 7f18dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.359+0000 7f18fb93b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18]): orig_sources= new_sources= 2023-12-03T11:33:57.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.359+0000 7f18fb93b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18]): potential sources added=[] removed=[] 2023-12-03T11:33:57.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.359+0000 7f18fb93b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18]): orig_dests= new_dests= 2023-12-03T11:33:57.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.359+0000 7f18fb93b800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18]): potential dests added=[] removed=[] 2023-12-03T11:33:57.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.360+0000 7f18fb93b800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2023-12-03T11:33:57.363 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.362+0000 7f18bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.364+0000 7f18fb93b800 20 remove_watcher() i=0 2023-12-03T11:33:57.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.364+0000 7f18fb93b800 2 removed watcher, disabling cache 2023-12-03T11:33:57.366 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.365+0000 7f18fb93b800 20 remove_watcher() i=1 2023-12-03T11:33:57.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.366+0000 7f18fb93b800 20 remove_watcher() i=2 2023-12-03T11:33:57.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.367+0000 7f18fb93b800 20 remove_watcher() i=3 2023-12-03T11:33:57.369 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.368+0000 7f18fb93b800 20 remove_watcher() i=4 2023-12-03T11:33:57.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.369+0000 7f18fb93b800 20 remove_watcher() i=5 2023-12-03T11:33:57.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.370+0000 7f18fb93b800 20 remove_watcher() i=6 2023-12-03T11:33:57.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.371+0000 7f18fb93b800 20 remove_watcher() i=7 2023-12-03T11:33:57.379 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:33:57.406 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:57.406 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:57.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.419+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.421+0000 7f172f13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.421+0000 7f172f13a800 20 realm 2023-12-03T11:33:57.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.421+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.421+0000 7f172f13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.421+0000 7f172f13a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:57.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.421+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.421+0000 7f172f13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.421+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.422+0000 7f172f13a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.422+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.422+0000 7f172f13a800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:57.424 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.423+0000 7f172f13a800 20 searching for the correct realm 2023-12-03T11:33:57.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.433+0000 7f172b607640 0 -- 172.21.15.131:0/896474249 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f1714056ac0 msgr2=0x7f1714058850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:57.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.433+0000 7f172f13a800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:57.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.433+0000 7f172f13a800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:57.434 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.433+0000 7f172f13a800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:57.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.433+0000 7f172f13a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:57.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.433+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.433+0000 7f172f13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.433+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.433+0000 7f172f13a800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.435 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.433+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:57.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 20 zone default found 2023-12-03T11:33:57.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 4 Realm: () 2023-12-03T11:33:57.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:57.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:57.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:57.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 20 zonegroup default 2023-12-03T11:33:57.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 20 started sync module instance, tier type = 2023-12-03T11:33:57.437 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.434+0000 7f172f13a800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:57.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.442+0000 7f1722605640 0 -- 172.21.15.131:0/896474249 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x562b494b8c50 msgr2=0x562b494bb0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:57.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.442+0000 7f172f13a800 20 add_watcher() i=0 2023-12-03T11:33:57.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.442+0000 7f172f13a800 20 add_watcher() i=1 2023-12-03T11:33:57.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.442+0000 7f172f13a800 20 add_watcher() i=2 2023-12-03T11:33:57.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.443+0000 7f172f13a800 20 add_watcher() i=3 2023-12-03T11:33:57.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.443+0000 7f172f13a800 20 add_watcher() i=4 2023-12-03T11:33:57.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.443+0000 7f172f13a800 20 add_watcher() i=5 2023-12-03T11:33:57.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.443+0000 7f172f13a800 20 add_watcher() i=6 2023-12-03T11:33:57.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.444+0000 7f172f13a800 20 add_watcher() i=7 2023-12-03T11:33:57.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.444+0000 7f172f13a800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:57.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.445+0000 7f166bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.446+0000 7f172f13a800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:57.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.446+0000 7f172f13a800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:57.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.451+0000 7f172f13a800 5 note: GC not initialized 2023-12-03T11:33:57.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.451+0000 7f165affd640 20 reqs_thread_entry: start 2023-12-03T11:33:57.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.452+0000 7f172f13a800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:57.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.452+0000 7f172f13a800 20 Filter name: none 2023-12-03T11:33:57.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.452+0000 7f1658ff9640 20 reqs_thread_entry: start 2023-12-03T11:33:57.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.452+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.452+0000 7f172f13a800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.452+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.453+0000 7f172f13a800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.453+0000 7f172f13a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:57.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.453+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.453+0000 7f172f13a800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.453+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.454+0000 7f172f13a800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.454+0000 7f172f13a800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:57.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.454+0000 7f172f13a800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.454+0000 7f172f13a800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.455+0000 7f166bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.457+0000 7f172f13a800 20 remove_watcher() i=0 2023-12-03T11:33:57.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.457+0000 7f172f13a800 2 removed watcher, disabling cache 2023-12-03T11:33:57.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.458+0000 7f172f13a800 20 remove_watcher() i=1 2023-12-03T11:33:57.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.459+0000 7f172f13a800 20 remove_watcher() i=2 2023-12-03T11:33:57.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.460+0000 7f172f13a800 20 remove_watcher() i=3 2023-12-03T11:33:57.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.461+0000 7f172f13a800 20 remove_watcher() i=4 2023-12-03T11:33:57.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.462+0000 7f172f13a800 20 remove_watcher() i=5 2023-12-03T11:33:57.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.463+0000 7f172f13a800 20 remove_watcher() i=6 2023-12-03T11:33:57.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.464+0000 7f172f13a800 20 remove_watcher() i=7 2023-12-03T11:33:57.470 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:57.470 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:33:57.470 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-set-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.18 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:33:57.470 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:57.542 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2023-12-03T11:33:57.543 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:57.705 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:33:57.732 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:57.732 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:57.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.744+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.746+0000 7fd346b2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.746+0000 7fd346b2f800 20 realm 2023-12-03T11:33:57.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.746+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.748 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.746+0000 7fd346b2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.748 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.746+0000 7fd346b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:57.748 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.746+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.748 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.746+0000 7fd346b2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.748 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.746+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.748 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.747+0000 7fd346b2f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.748 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.747+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.748 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.747+0000 7fd346b2f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:57.749 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.747+0000 7fd346b2f800 20 searching for the correct realm 2023-12-03T11:33:57.757 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.756+0000 7fd34277e640 0 -- 172.21.15.131:0/4220301232 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x561e7c7af6a0 msgr2=0x561e7c7b1ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:57.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.757+0000 7fd346b2f800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:57.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.757+0000 7fd346b2f800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:57.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.757+0000 7fd346b2f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:57.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.757+0000 7fd346b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:57.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.757+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.759 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.760 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 20 zone default found 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 4 Realm: () 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 20 zonegroup default 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.758+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.759+0000 7fd346b2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.759+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.759+0000 7fd346b2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.759+0000 7fd346b2f800 20 started sync module instance, tier type = 2023-12-03T11:33:57.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.759+0000 7fd346b2f800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:57.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.765+0000 7fd34277e640 0 -- 172.21.15.131:0/4220301232 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7fd33c052070 msgr2=0x7fd33c071920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:57.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.768+0000 7fd346b2f800 20 add_watcher() i=0 2023-12-03T11:33:57.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.768+0000 7fd346b2f800 20 add_watcher() i=1 2023-12-03T11:33:57.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.768+0000 7fd346b2f800 20 add_watcher() i=2 2023-12-03T11:33:57.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.768+0000 7fd346b2f800 20 add_watcher() i=3 2023-12-03T11:33:57.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.768+0000 7fd346b2f800 20 add_watcher() i=4 2023-12-03T11:33:57.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.768+0000 7fd346b2f800 20 add_watcher() i=5 2023-12-03T11:33:57.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.768+0000 7fd346b2f800 20 add_watcher() i=6 2023-12-03T11:33:57.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.769+0000 7fd346b2f800 20 add_watcher() i=7 2023-12-03T11:33:57.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.769+0000 7fd346b2f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:57.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.771+0000 7fd307fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.771+0000 7fd346b2f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:57.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.771+0000 7fd346b2f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:57.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.777+0000 7fd346b2f800 5 note: GC not initialized 2023-12-03T11:33:57.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.777+0000 7fd276ffd640 20 reqs_thread_entry: start 2023-12-03T11:33:57.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.777+0000 7fd346b2f800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:57.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.777+0000 7fd346b2f800 20 Filter name: none 2023-12-03T11:33:57.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.777+0000 7fd274ff9640 20 reqs_thread_entry: start 2023-12-03T11:33:57.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.777+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.778+0000 7fd346b2f800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.778+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.778+0000 7fd346b2f800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.778+0000 7fd346b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:57.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.778+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.779+0000 7fd346b2f800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.780 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.779+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.779+0000 7fd346b2f800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.779+0000 7fd346b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:57.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.779+0000 7fd346b2f800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.779+0000 7fd346b2f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.780+0000 7fd307fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.782+0000 7fd346b2f800 20 remove_watcher() i=0 2023-12-03T11:33:57.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.782+0000 7fd346b2f800 2 removed watcher, disabling cache 2023-12-03T11:33:57.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.783+0000 7fd346b2f800 20 remove_watcher() i=1 2023-12-03T11:33:57.785 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.784+0000 7fd346b2f800 20 remove_watcher() i=2 2023-12-03T11:33:57.786 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.785+0000 7fd346b2f800 20 remove_watcher() i=3 2023-12-03T11:33:57.787 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.786+0000 7fd346b2f800 20 remove_watcher() i=4 2023-12-03T11:33:57.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.787+0000 7fd346b2f800 20 remove_watcher() i=5 2023-12-03T11:33:57.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.788+0000 7fd346b2f800 20 remove_watcher() i=6 2023-12-03T11:33:57.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.789+0000 7fd346b2f800 20 remove_watcher() i=7 2023-12-03T11:33:57.795 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:57.795 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:33:57.795 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-set-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:33:57.795 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:57.796 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2023-12-03T11:33:57.830 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:57.831 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:57.844 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.843+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.845+0000 7f27c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.845+0000 7f27c2f3e800 20 realm 2023-12-03T11:33:57.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.845+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.845+0000 7f27c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.845+0000 7f27c2f3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:57.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.845+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.845+0000 7f27c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.845+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.846+0000 7f27c2f3e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.846+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.846+0000 7f27c2f3e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:57.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.846+0000 7f27c2f3e800 20 searching for the correct realm 2023-12-03T11:33:57.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.854+0000 7f27bed03640 0 -- 172.21.15.131:0/345712036 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f27b8014470 msgr2=0x7f27b8014870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:33:57.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.856+0000 7f27c2f3e800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:57.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.856+0000 7f27c2f3e800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:57.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.856+0000 7f27c2f3e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:57.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.856+0000 7f27c2f3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:57.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.856+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 20 zone default found 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 4 Realm: () 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 20 zonegroup default 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.857+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.858+0000 7f27c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.858+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.858+0000 7f27c2f3e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.858+0000 7f27c2f3e800 20 started sync module instance, tier type = 2023-12-03T11:33:57.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.858+0000 7f27c2f3e800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:57.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.863+0000 7f27bf504640 0 -- 172.21.15.131:0/345712036 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f27b40565a0 msgr2=0x7f27b4015a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:33:57.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.869+0000 7f27c2f3e800 20 add_watcher() i=0 2023-12-03T11:33:57.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.869+0000 7f27c2f3e800 20 add_watcher() i=1 2023-12-03T11:33:57.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.869+0000 7f27c2f3e800 20 add_watcher() i=2 2023-12-03T11:33:57.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.869+0000 7f27c2f3e800 20 add_watcher() i=3 2023-12-03T11:33:57.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.869+0000 7f27c2f3e800 20 add_watcher() i=4 2023-12-03T11:33:57.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.869+0000 7f27c2f3e800 20 add_watcher() i=5 2023-12-03T11:33:57.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.869+0000 7f27c2f3e800 20 add_watcher() i=6 2023-12-03T11:33:57.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.870+0000 7f27c2f3e800 20 add_watcher() i=7 2023-12-03T11:33:57.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.870+0000 7f27c2f3e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:57.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.871+0000 7f26fffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.872+0000 7f27c2f3e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:57.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.872+0000 7f27c2f3e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:57.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.877+0000 7f27c2f3e800 5 note: GC not initialized 2023-12-03T11:33:57.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.878+0000 7f26eeffd640 20 reqs_thread_entry: start 2023-12-03T11:33:57.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.878+0000 7f27c2f3e800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:57.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.878+0000 7f27c2f3e800 20 Filter name: none 2023-12-03T11:33:57.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.878+0000 7f26ecff9640 20 reqs_thread_entry: start 2023-12-03T11:33:57.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.878+0000 7f27c2f3e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2023-12-03T11:33:57.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.878+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.878+0000 7f27c2f3e800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.878+0000 7f27c2f3e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2023-12-03T11:33:57.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.878+0000 7f27c2f3e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2023-12-03T11:33:57.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.878+0000 7f27c2f3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 : miss 2023-12-03T11:33:57.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.878+0000 7f27c2f3e800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.879+0000 7f27c2f3e800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.879+0000 7f27c2f3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 info.flags=0x17 2023-12-03T11:33:57.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.879+0000 7f27c2f3e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 to cache LRU end 2023-12-03T11:33:57.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.879+0000 7f27c2f3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:33:57.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.879+0000 7f27c2f3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.879+0000 7f27c2f3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 2023-12-03T11:33:57.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.882+0000 7f27c2f3e800 -1 Injecting error=-125 at location=set_target_layout 2023-12-03T11:33:57.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.883+0000 7f27c2f3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 info.flags=0x17 2023-12-03T11:33:57.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.883+0000 7f27c2f3e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 to cache LRU end 2023-12-03T11:33:57.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.883+0000 7f27c2f3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.883+0000 7f27c2f3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19, ofs0, ns] 2023-12-03T11:33:57.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.883+0000 7f27a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791388 cookie 93991136715136 notifier 6438 bl.length()=887 2023-12-03T11:33:57.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.883+0000 7f27a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 info.flags=0x17 2023-12-03T11:33:57.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.883+0000 7f27a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 to cache LRU end 2023-12-03T11:33:57.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.883+0000 7f27a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.884+0000 7f27a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791389 cookie 93991136715136 notifier 6438 bl.length()=887 2023-12-03T11:33:57.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.884+0000 7f27a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 info.flags=0x17 2023-12-03T11:33:57.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.884+0000 7f27a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 to cache LRU end 2023-12-03T11:33:57.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.884+0000 7f27a4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.885+0000 7f27c2f3e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19]): orig_sources= new_sources= 2023-12-03T11:33:57.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.885+0000 7f27c2f3e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19]): potential sources added=[] removed=[] 2023-12-03T11:33:57.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.885+0000 7f27c2f3e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19]): orig_dests= new_dests= 2023-12-03T11:33:57.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.885+0000 7f27c2f3e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19]): potential dests added=[] removed=[] 2023-12-03T11:33:57.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.886+0000 7f27c2f3e800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19.1.0 2023-12-03T11:33:57.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.886+0000 7f27c2f3e800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19.1.0 2023-12-03T11:33:57.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.886+0000 7f27c2f3e800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19.1.1 2023-12-03T11:33:57.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.886+0000 7f27c2f3e800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19.1.1 2023-12-03T11:33:57.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.886+0000 7f27c2f3e800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19.0 2023-12-03T11:33:57.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.888+0000 7f27c2f3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 : hit (requested=0x17, cached=0x17) 2023-12-03T11:33:57.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.888+0000 7f27c2f3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 2023-12-03T11:33:57.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.889+0000 7f27c2f3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 info.flags=0x17 2023-12-03T11:33:57.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.889+0000 7f27c2f3e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 to cache LRU end 2023-12-03T11:33:57.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.889+0000 7f27c2f3e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.889+0000 7f27c2f3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19, ofs0, ns] 2023-12-03T11:33:57.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.889+0000 7f27a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791390 cookie 93991136715136 notifier 6438 bl.length()=855 2023-12-03T11:33:57.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.889+0000 7f27a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 info.flags=0x17 2023-12-03T11:33:57.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.889+0000 7f27a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 to cache LRU end 2023-12-03T11:33:57.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.889+0000 7f27a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:57.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.890+0000 7f27c2f3e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19]): orig_sources= new_sources= 2023-12-03T11:33:57.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.890+0000 7f27c2f3e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19]): potential sources added=[] removed=[] 2023-12-03T11:33:57.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.890+0000 7f27c2f3e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19]): orig_dests= new_dests= 2023-12-03T11:33:57.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.890+0000 7f27c2f3e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19]): potential dests added=[] removed=[] 2023-12-03T11:33:57.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.891+0000 7f27c2f3e800 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2023-12-03T11:33:57.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.893+0000 7f26fffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.896 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.895+0000 7f27c2f3e800 20 remove_watcher() i=0 2023-12-03T11:33:57.896 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.895+0000 7f27c2f3e800 2 removed watcher, disabling cache 2023-12-03T11:33:57.897 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.896+0000 7f27c2f3e800 20 remove_watcher() i=1 2023-12-03T11:33:57.898 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.897+0000 7f27c2f3e800 20 remove_watcher() i=2 2023-12-03T11:33:57.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.898+0000 7f27c2f3e800 20 remove_watcher() i=3 2023-12-03T11:33:57.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.899+0000 7f27c2f3e800 20 remove_watcher() i=4 2023-12-03T11:33:57.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.900+0000 7f27c2f3e800 20 remove_watcher() i=5 2023-12-03T11:33:57.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.901+0000 7f27c2f3e800 20 remove_watcher() i=6 2023-12-03T11:33:57.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.902+0000 7f27c2f3e800 20 remove_watcher() i=7 2023-12-03T11:33:57.909 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2023-12-03T11:33:57.936 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:57.936 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:57.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.949+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.951+0000 7f48824e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.951+0000 7f48824e4800 20 realm 2023-12-03T11:33:57.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.951+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.951+0000 7f48824e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.951+0000 7f48824e4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:57.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.951+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.951+0000 7f48824e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.951+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.952+0000 7f48824e4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.952+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.952+0000 7f48824e4800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:57.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.952+0000 7f48824e4800 20 searching for the correct realm 2023-12-03T11:33:57.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.960+0000 7f487ffe4640 0 -- 172.21.15.131:0/3703938915 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7f48680a1e20 msgr2=0x7f48680a0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:57.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.962+0000 7f48824e4800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:57.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.962+0000 7f48824e4800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:57.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.962+0000 7f48824e4800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:57.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.962+0000 7f48824e4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:57.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.962+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.962+0000 7f48824e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.962+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.962+0000 7f48824e4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:57.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.962+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:57.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 20 zone default found 2023-12-03T11:33:57.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 4 Realm: () 2023-12-03T11:33:57.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:57.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:57.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:57.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 20 zonegroup default 2023-12-03T11:33:57.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 20 started sync module instance, tier type = 2023-12-03T11:33:57.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.963+0000 7f48824e4800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:57.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.968+0000 7f48807e5640 0 -- 172.21.15.131:0/3703938915 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7f486806d030 msgr2=0x7f4868059890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:57.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.973+0000 7f48824e4800 20 add_watcher() i=0 2023-12-03T11:33:57.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.973+0000 7f48824e4800 20 add_watcher() i=1 2023-12-03T11:33:57.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.973+0000 7f48824e4800 20 add_watcher() i=2 2023-12-03T11:33:57.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.973+0000 7f48824e4800 20 add_watcher() i=3 2023-12-03T11:33:57.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.973+0000 7f48824e4800 20 add_watcher() i=4 2023-12-03T11:33:57.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.973+0000 7f48824e4800 20 add_watcher() i=5 2023-12-03T11:33:57.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.973+0000 7f48824e4800 20 add_watcher() i=6 2023-12-03T11:33:57.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.974+0000 7f48824e4800 20 add_watcher() i=7 2023-12-03T11:33:57.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.974+0000 7f48824e4800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:57.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.975+0000 7f4845fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.975+0000 7f48824e4800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:57.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.975+0000 7f48824e4800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:57.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.981+0000 7f48824e4800 5 note: GC not initialized 2023-12-03T11:33:57.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.981+0000 7f47bcff9640 20 reqs_thread_entry: start 2023-12-03T11:33:57.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.981+0000 7f48824e4800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:57.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.982+0000 7f48824e4800 20 Filter name: none 2023-12-03T11:33:57.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.982+0000 7f47b27fc640 20 reqs_thread_entry: start 2023-12-03T11:33:57.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.982+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.982+0000 7f48824e4800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.982+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.983+0000 7f48824e4800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.983+0000 7f48824e4800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:57.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.983+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.983+0000 7f48824e4800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:57.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.983+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.983+0000 7f48824e4800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:57.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.983+0000 7f48824e4800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:57.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.984+0000 7f48824e4800 20 rados->read ofs=0 len=0 2023-12-03T11:33:57.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.984+0000 7f48824e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:57.986 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.985+0000 7f4845fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:57.988 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.987+0000 7f48824e4800 20 remove_watcher() i=0 2023-12-03T11:33:57.988 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.987+0000 7f48824e4800 2 removed watcher, disabling cache 2023-12-03T11:33:57.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.988+0000 7f48824e4800 20 remove_watcher() i=1 2023-12-03T11:33:57.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.989+0000 7f48824e4800 20 remove_watcher() i=2 2023-12-03T11:33:57.991 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.990+0000 7f48824e4800 20 remove_watcher() i=3 2023-12-03T11:33:57.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.991+0000 7f48824e4800 20 remove_watcher() i=4 2023-12-03T11:33:57.993 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.992+0000 7f48824e4800 20 remove_watcher() i=5 2023-12-03T11:33:57.994 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.993+0000 7f48824e4800 20 remove_watcher() i=6 2023-12-03T11:33:57.995 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:57.994+0000 7f48824e4800 20 remove_watcher() i=7 2023-12-03T11:33:58.000 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.000 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:33:58.000 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-set-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.19 num_objects: 20 size_kb: 1 num_shards: 2 2023-12-03T11:33:58.000 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.074 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard bucket with abort at set_target_layout 2023-12-03T11:33:58.074 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.246 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-12-03T11:33:58.273 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:58.273 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:58.287 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.285+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.287+0000 7ff5b8b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.287+0000 7ff5b8b40800 20 realm 2023-12-03T11:33:58.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.287+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.287+0000 7ff5b8b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.287+0000 7ff5b8b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:58.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.287+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.287+0000 7ff5b8b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.287+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.288+0000 7ff5b8b40800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.288+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.288+0000 7ff5b8b40800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:58.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.288+0000 7ff5b8b40800 20 searching for the correct realm 2023-12-03T11:33:58.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.297+0000 7ff5b4845640 0 -- 172.21.15.131:0/1653620047 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55659b5527d0 msgr2=0x55659b554bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:58.300 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.299+0000 7ff5b8b40800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:58.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.299+0000 7ff5b8b40800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:58.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.299+0000 7ff5b8b40800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:58.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.299+0000 7ff5b8b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:58.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.299+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.299+0000 7ff5b8b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.299+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.299+0000 7ff5b8b40800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.301 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.299+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:58.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 20 zone default found 2023-12-03T11:33:58.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 4 Realm: () 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 20 zonegroup default 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 20 started sync module instance, tier type = 2023-12-03T11:33:58.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.300+0000 7ff5b8b40800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:58.308 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.307+0000 7ff5b5046640 0 -- 172.21.15.131:0/1653620047 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7ff59c092040 msgr2=0x7ff59c087a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:33:58.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.311+0000 7ff5b8b40800 20 add_watcher() i=0 2023-12-03T11:33:58.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.311+0000 7ff5b8b40800 20 add_watcher() i=1 2023-12-03T11:33:58.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.311+0000 7ff5b8b40800 20 add_watcher() i=2 2023-12-03T11:33:58.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.311+0000 7ff5b8b40800 20 add_watcher() i=3 2023-12-03T11:33:58.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.311+0000 7ff5b8b40800 20 add_watcher() i=4 2023-12-03T11:33:58.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.311+0000 7ff5b8b40800 20 add_watcher() i=5 2023-12-03T11:33:58.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.311+0000 7ff5b8b40800 20 add_watcher() i=6 2023-12-03T11:33:58.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.312+0000 7ff5b8b40800 20 add_watcher() i=7 2023-12-03T11:33:58.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.312+0000 7ff5b8b40800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:58.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.313+0000 7ff57b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:58.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.313+0000 7ff5b8b40800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:58.314 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.313+0000 7ff5b8b40800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:58.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.319+0000 7ff5b8b40800 5 note: GC not initialized 2023-12-03T11:33:58.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.319+0000 7ff4ea7fc640 20 reqs_thread_entry: start 2023-12-03T11:33:58.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.319+0000 7ff5b8b40800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:58.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.319+0000 7ff5b8b40800 20 Filter name: none 2023-12-03T11:33:58.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.320+0000 7ff4dbfff640 20 reqs_thread_entry: start 2023-12-03T11:33:58.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.320+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.320+0000 7ff5b8b40800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:58.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.320+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.321+0000 7ff5b8b40800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:58.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.321+0000 7ff5b8b40800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:58.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.321+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.321+0000 7ff5b8b40800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:58.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.321+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.322+0000 7ff5b8b40800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:58.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.322+0000 7ff5b8b40800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:58.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.322+0000 7ff5b8b40800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.322+0000 7ff5b8b40800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.323+0000 7ff57b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:58.326 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.325+0000 7ff5b8b40800 20 remove_watcher() i=0 2023-12-03T11:33:58.326 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.325+0000 7ff5b8b40800 2 removed watcher, disabling cache 2023-12-03T11:33:58.327 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.326+0000 7ff5b8b40800 20 remove_watcher() i=1 2023-12-03T11:33:58.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.327+0000 7ff5b8b40800 20 remove_watcher() i=2 2023-12-03T11:33:58.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.328+0000 7ff5b8b40800 20 remove_watcher() i=3 2023-12-03T11:33:58.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.329+0000 7ff5b8b40800 20 remove_watcher() i=4 2023-12-03T11:33:58.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.330+0000 7ff5b8b40800 20 remove_watcher() i=5 2023-12-03T11:33:58.332 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.331+0000 7ff5b8b40800 20 remove_watcher() i=6 2023-12-03T11:33:58.333 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.332+0000 7ff5b8b40800 20 remove_watcher() i=7 2023-12-03T11:33:58.337 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.338 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:33:58.338 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-set-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:33:58.338 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.339 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2023-12-03T11:33:58.371 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:58.371 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:58.385 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.384+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.386+0000 7f98a1f31800 20 realm 2023-12-03T11:33:58.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.386+0000 7f98a1f31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:58.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.388 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.387+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.387+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.387+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:58.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.387+0000 7f98a1f31800 20 searching for the correct realm 2023-12-03T11:33:58.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.396+0000 7f989dc3c640 0 -- 172.21.15.131:0/3825538438 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x556e7458e8c0 msgr2=0x556e74590d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:58.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.397+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 20 zone default found 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 4 Realm: () 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:58.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:58.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:58.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 20 zonegroup default 2023-12-03T11:33:58.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.399+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.399+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.399+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.399+0000 7f98a1f31800 20 started sync module instance, tier type = 2023-12-03T11:33:58.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.399+0000 7f98a1f31800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:58.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.404+0000 7f989e43d640 0 -- 172.21.15.131:0/3825538438 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f98940569f0 msgr2=0x7f989408b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:58.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=0 2023-12-03T11:33:58.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=1 2023-12-03T11:33:58.408 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=2 2023-12-03T11:33:58.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=3 2023-12-03T11:33:58.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=4 2023-12-03T11:33:58.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=5 2023-12-03T11:33:58.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=6 2023-12-03T11:33:58.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.408+0000 7f98a1f31800 20 add_watcher() i=7 2023-12-03T11:33:58.409 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.408+0000 7f98a1f31800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:58.410 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.409+0000 7f98637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:58.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.410+0000 7f98a1f31800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:58.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.410+0000 7f98a1f31800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:58.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.415+0000 7f98a1f31800 5 note: GC not initialized 2023-12-03T11:33:58.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.415+0000 7f97d27fc640 20 reqs_thread_entry: start 2023-12-03T11:33:58.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.415+0000 7f98a1f31800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:58.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.416+0000 7f98a1f31800 20 Filter name: none 2023-12-03T11:33:58.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.416+0000 7f97c3fff640 20 reqs_thread_entry: start 2023-12-03T11:33:58.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.416+0000 7f98a1f31800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:33:58.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.416+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.416+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:58.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.416+0000 7f98a1f31800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:33:58.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.416+0000 7f98a1f31800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:33:58.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.416+0000 7f98a1f31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 : miss 2023-12-03T11:33:58.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.416+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.417+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:58.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.417+0000 7f98a1f31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 info.flags=0x17 2023-12-03T11:33:58.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.417+0000 7f98a1f31800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 to cache LRU end 2023-12-03T11:33:58.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.417+0000 7f98a1f31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:33:58.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.417+0000 7f98a1f31800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:58.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.417+0000 7f98a1f31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 2023-12-03T11:33:58.421 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f98a1f31800 time 2023-12-03T11:33:58.420969+0000 2023-12-03T11:33:58.421 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:33:58.421 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:33:58.421 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f98a4b6eef8] 2023-12-03T11:33:58.422 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f98a4b6f0b6] 2023-12-03T11:33:58.422 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e735eda71] 2023-12-03T11:33:58.422 INFO:tasks.workunit.client.0.smithi131.stderr: 4: radosgw-admin(+0x79787a) [0x556e735f587a] 2023-12-03T11:33:58.422 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x556e735f9e6b] 2023-12-03T11:33:58.422 INFO:tasks.workunit.client.0.smithi131.stderr: 6: main() 2023-12-03T11:33:58.422 INFO:tasks.workunit.client.0.smithi131.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f98a243feb0] 2023-12-03T11:33:58.422 INFO:tasks.workunit.client.0.smithi131.stderr: 8: __libc_start_main() 2023-12-03T11:33:58.422 INFO:tasks.workunit.client.0.smithi131.stderr: 9: _start() 2023-12-03T11:33:58.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.420+0000 7f98a1f31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f98a1f31800 time 2023-12-03T11:33:58.420969+0000 2023-12-03T11:33:58.423 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:33:58.423 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.423 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:33:58.423 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f98a4b6eef8] 2023-12-03T11:33:58.423 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f98a4b6f0b6] 2023-12-03T11:33:58.423 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e735eda71] 2023-12-03T11:33:58.423 INFO:tasks.workunit.client.0.smithi131.stderr: 4: radosgw-admin(+0x79787a) [0x556e735f587a] 2023-12-03T11:33:58.423 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x556e735f9e6b] 2023-12-03T11:33:58.424 INFO:tasks.workunit.client.0.smithi131.stderr: 6: main() 2023-12-03T11:33:58.424 INFO:tasks.workunit.client.0.smithi131.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f98a243feb0] 2023-12-03T11:33:58.424 INFO:tasks.workunit.client.0.smithi131.stderr: 8: __libc_start_main() 2023-12-03T11:33:58.424 INFO:tasks.workunit.client.0.smithi131.stderr: 9: _start() 2023-12-03T11:33:58.424 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.424 INFO:tasks.workunit.client.0.smithi131.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:33:58.424 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f98a1f31800 thread_name:radosgw-admin 2023-12-03T11:33:58.439 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f98a2454db0] 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f98a24a154c] 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f98a4b6ef52] 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f98a4b6f0b6] 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e735eda71] 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 8: radosgw-admin(+0x79787a) [0x556e735f587a] 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x556e735f9e6b] 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 10: main() 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f98a243feb0] 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 12: __libc_start_main() 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: 13: _start() 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.421+0000 7f98a1f31800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:33:58.440 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f98a1f31800 thread_name:radosgw-admin 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f98a2454db0] 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f98a24a154c] 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f98a4b6ef52] 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f98a4b6f0b6] 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e735eda71] 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 8: radosgw-admin(+0x79787a) [0x556e735f587a] 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x556e735f9e6b] 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 10: main() 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f98a243feb0] 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 12: __libc_start_main() 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: 13: _start() 2023-12-03T11:33:58.441 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr:--- begin dump of recent events --- 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr: -499> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr: -498> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: dump: 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.442 INFO:tasks.workunit.client.0.smithi131.stderr: -497> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: _finish_auth 0 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr: -496> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: _check_auth_tickets 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr: -495> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr: -494> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr: -493> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr: -492> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: dump: 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr: -491> 2023-12-03T11:33:58.378+0000 7f98a1f31800 5 monclient: authenticate success, global_id 6492 2023-12-03T11:33:58.443 INFO:tasks.workunit.client.0.smithi131.stderr: -490> 2023-12-03T11:33:58.378+0000 7f988ffff640 4 set_mon_vals no callback set 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr: -489> 2023-12-03T11:33:58.378+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr: -488> 2023-12-03T11:33:58.378+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr: -487> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr: -486> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr: -485> 2023-12-03T11:33:58.379+0000 7f98a1f31800 1 librados: init done 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr: -484> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: get_monmap_and_config 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr: -483> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: build_initial_monmap 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr: -482> 2023-12-03T11:33:58.379+0000 7f98a1f31800 1 build_initial for_mkfs: 0 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr: -481> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: monmap: 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:33:58.444 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -480> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding auth protocol: cephx 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -479> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding auth protocol: cephx 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -478> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding auth protocol: cephx 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -477> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -476> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -475> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -474> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -473> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -472> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -471> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -470> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -469> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -468> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -467> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.445 INFO:tasks.workunit.client.0.smithi131.stderr: -466> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -465> 2023-12-03T11:33:58.379+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -464> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: init 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -463> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding auth protocol: cephx 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -462> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding auth protocol: cephx 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -461> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding auth protocol: cephx 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -460> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -459> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -458> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -457> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -456> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -455> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -454> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -453> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.446 INFO:tasks.workunit.client.0.smithi131.stderr: -452> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -451> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -450> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -449> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -448> 2023-12-03T11:33:58.380+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -447> 2023-12-03T11:33:58.380+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -446> 2023-12-03T11:33:58.380+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe660c6c88 EEXIST 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -445> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient: _reopen_session rank -1 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -444> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -443> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-b con 0x556e7456ce60 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -442> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-a con 0x556e7456d240 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -441> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-c con 0x556e7456c6d0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -440> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -439> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -438> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -437> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): _renew_subs 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -436> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): authenticate will time out at 1529.758793s 2023-12-03T11:33:58.447 INFO:tasks.workunit.client.0.smithi131.stderr: -435> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): get_auth_request con 0x556e7456d240 auth_method 0 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -434> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -433> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -432> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -431> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): get_auth_request con 0x556e7456c6d0 auth_method 0 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -430> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -429> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -428> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -427> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): get_auth_request con 0x556e7456ce60 auth_method 0 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -426> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -425> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -424> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -423> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -422> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -421> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.448 INFO:tasks.workunit.client.0.smithi131.stderr: -420> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -419> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -418> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -417> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -416> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -415> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -414> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): handle_auth_done global_id 6495 payload 274 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -413> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient: _finish_hunting 0 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -412> 2023-12-03T11:33:58.380+0000 7f989dc3c640 1 monclient: found mon.noname-a 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -411> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -410> 2023-12-03T11:33:58.380+0000 7f988effd640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -409> 2023-12-03T11:33:58.380+0000 7f988effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -408> 2023-12-03T11:33:58.380+0000 7f988effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -407> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient: get_auth_request con 0x7f9880069820 auth_method 0 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -406> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -405> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr: -404> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: dump: 2023-12-03T11:33:58.449 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr: -403> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: _finish_auth 0 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr: -402> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: _check_auth_tickets 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr: -401> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr: -400> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 monclient: authenticate success, global_id 6495 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr: -399> 2023-12-03T11:33:58.381+0000 7f98a1f31800 10 monclient: get_monmap_and_config success 2023-12-03T11:33:58.450 INFO:tasks.workunit.client.0.smithi131.stderr: -398> 2023-12-03T11:33:58.381+0000 7f98a1f31800 4 set_mon_vals no callback set 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr: -397> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr: -396> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr: -395> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: dump: 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr: -394> 2023-12-03T11:33:58.381+0000 7f98a1f31800 10 monclient: shutdown 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr: -393> 2023-12-03T11:33:58.381+0000 7f98a1f31800 10 monclient: build_initial_monmap 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr: -392> 2023-12-03T11:33:58.381+0000 7f98a1f31800 1 build_initial for_mkfs: 0 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr: -391> 2023-12-03T11:33:58.381+0000 7f98a1f31800 10 monclient: monmap: 2023-12-03T11:33:58.451 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr: -390> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding auth protocol: cephx 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr: -389> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding auth protocol: cephx 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr: -388> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding auth protocol: cephx 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr: -387> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr: -386> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr: -385> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.452 INFO:tasks.workunit.client.0.smithi131.stderr: -384> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -383> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -382> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -381> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -380> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -379> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -378> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -377> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -376> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -375> 2023-12-03T11:33:58.382+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -374> 2023-12-03T11:33:58.382+0000 7f98a1f31800 1 librados: starting msgr at 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -373> 2023-12-03T11:33:58.382+0000 7f98a1f31800 1 librados: starting objecter 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -372> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command objecter_requests cmddesc objecter_requests hook 0x556e74541300 EEXIST 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -371> 2023-12-03T11:33:58.382+0000 7f98a1f31800 1 librados: setting wanted keys 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -370> 2023-12-03T11:33:58.382+0000 7f98a1f31800 1 librados: calling monclient init 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -369> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient: init 2023-12-03T11:33:58.453 INFO:tasks.workunit.client.0.smithi131.stderr: -368> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding auth protocol: cephx 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -367> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding auth protocol: cephx 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -366> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding auth protocol: cephx 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -365> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -364> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -363> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -362> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -361> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -360> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -359> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -358> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -357> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -356> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -355> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -354> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -353> 2023-12-03T11:33:58.382+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.454 INFO:tasks.workunit.client.0.smithi131.stderr: -352> 2023-12-03T11:33:58.382+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -351> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command rotate-key cmddesc rotate-key hook 0x556e7453c900 EEXIST 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -350> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient: _reopen_session rank -1 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -349> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -348> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-c con 0x556e7456c6d0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -347> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-b con 0x556e7456ce60 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -346> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-a con 0x556e7456d240 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -345> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -344> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -343> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -342> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): _renew_subs 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -341> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): authenticate will time out at 1529.761150s 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -340> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): get_auth_request con 0x556e7456d240 auth_method 0 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -339> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -338> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.455 INFO:tasks.workunit.client.0.smithi131.stderr: -337> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -336> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): get_auth_request con 0x556e7456c6d0 auth_method 0 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -335> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -334> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -333> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -332> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -331> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -330> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -329> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): get_auth_request con 0x556e7456ce60 auth_method 0 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -328> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -327> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -326> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -325> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -324> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -323> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -322> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -321> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.456 INFO:tasks.workunit.client.0.smithi131.stderr: -320> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr: -319> 2023-12-03T11:33:58.383+0000 7f989e43d640 10 monclient(hunting): handle_auth_done global_id 6498 payload 824 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr: -318> 2023-12-03T11:33:58.383+0000 7f989e43d640 10 monclient: _finish_hunting 0 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr: -317> 2023-12-03T11:33:58.383+0000 7f989e43d640 1 monclient: found mon.noname-a 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr: -316> 2023-12-03T11:33:58.383+0000 7f989e43d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr: -315> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr: -314> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr: -313> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: dump: 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.457 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr: -312> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: _finish_auth 0 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr: -311> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: _check_auth_tickets 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr: -310> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr: -309> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr: -308> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr: -307> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: dump: 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.458 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: -306> 2023-12-03T11:33:58.383+0000 7f987ffff640 4 set_mon_vals no callback set 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: -305> 2023-12-03T11:33:58.383+0000 7f98a1f31800 5 monclient: authenticate success, global_id 6498 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: -304> 2023-12-03T11:33:58.383+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: -303> 2023-12-03T11:33:58.383+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: -302> 2023-12-03T11:33:58.383+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: -301> 2023-12-03T11:33:58.383+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: -300> 2023-12-03T11:33:58.383+0000 7f98a1f31800 1 librados: init done 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: -299> 2023-12-03T11:33:58.384+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: -298> 2023-12-03T11:33:58.385+0000 7f987e7fc640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: -297> 2023-12-03T11:33:58.385+0000 7f987e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.459 INFO:tasks.workunit.client.0.smithi131.stderr: -296> 2023-12-03T11:33:58.385+0000 7f987e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -295> 2023-12-03T11:33:58.385+0000 7f989dc3c640 10 monclient: get_auth_request con 0x7f9878069850 auth_method 0 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -294> 2023-12-03T11:33:58.385+0000 7f989d43b640 10 monclient: get_auth_request con 0x556e7458a990 auth_method 0 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -293> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -292> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 realm 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -291> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -290> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -289> 2023-12-03T11:33:58.386+0000 7f98a1f31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -288> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -287> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -286> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -285> 2023-12-03T11:33:58.386+0000 7f989dc3c640 10 monclient: get_auth_request con 0x556e7458e8c0 auth_method 0 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -284> 2023-12-03T11:33:58.387+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -283> 2023-12-03T11:33:58.387+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.460 INFO:tasks.workunit.client.0.smithi131.stderr: -282> 2023-12-03T11:33:58.387+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -281> 2023-12-03T11:33:58.387+0000 7f98a1f31800 20 searching for the correct realm 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -280> 2023-12-03T11:33:58.387+0000 7f989d43b640 10 monclient: get_auth_request con 0x556e74593900 auth_method 0 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -279> 2023-12-03T11:33:58.388+0000 7f989e43d640 10 monclient: get_auth_request con 0x7f9894057760 auth_method 0 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -278> 2023-12-03T11:33:58.388+0000 7f989dc3c640 10 monclient: get_auth_request con 0x7f9898018070 auth_method 0 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -277> 2023-12-03T11:33:58.389+0000 7f989d43b640 10 monclient: get_auth_request con 0x7f989005e070 auth_method 0 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -276> 2023-12-03T11:33:58.391+0000 7f989e43d640 10 monclient: get_auth_request con 0x7f98940569f0 auth_method 0 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -275> 2023-12-03T11:33:58.393+0000 7f989dc3c640 10 monclient: get_auth_request con 0x7f989405f2c0 auth_method 0 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -274> 2023-12-03T11:33:58.396+0000 7f989dc3c640 0 -- 172.21.15.131:0/3825538438 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x556e7458e8c0 msgr2=0x556e74590d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -273> 2023-12-03T11:33:58.396+0000 7f987e7fc640 1 client.6498.objecter ms_handle_reset 0x556e7458e8c0 session 0x556e742fc320 osd.5 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -272> 2023-12-03T11:33:58.396+0000 7f987e7fc640 10 monclient: _renew_subs 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -271> 2023-12-03T11:33:58.396+0000 7f987e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -270> 2023-12-03T11:33:58.396+0000 7f989dc3c640 10 monclient: get_auth_request con 0x7f9878079670 auth_method 0 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -269> 2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -268> 2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -267> 2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:58.461 INFO:tasks.workunit.client.0.smithi131.stderr: -266> 2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -265> 2023-12-03T11:33:58.397+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -264> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -263> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -262> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -261> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -260> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -259> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 zone default found 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -258> 2023-12-03T11:33:58.398+0000 7f98a1f31800 4 Realm: () 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -257> 2023-12-03T11:33:58.398+0000 7f98a1f31800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -256> 2023-12-03T11:33:58.398+0000 7f98a1f31800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -255> 2023-12-03T11:33:58.398+0000 7f98a1f31800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -254> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 zonegroup default 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -253> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -252> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.462 INFO:tasks.workunit.client.0.smithi131.stderr: -251> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -250> 2023-12-03T11:33:58.399+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -249> 2023-12-03T11:33:58.399+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -248> 2023-12-03T11:33:58.399+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -247> 2023-12-03T11:33:58.399+0000 7f98a1f31800 20 started sync module instance, tier type = 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -246> 2023-12-03T11:33:58.399+0000 7f98a1f31800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -245> 2023-12-03T11:33:58.404+0000 7f989e43d640 0 -- 172.21.15.131:0/3825538438 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f98940569f0 msgr2=0x7f989408b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -244> 2023-12-03T11:33:58.404+0000 7f987e7fc640 1 client.6498.objecter ms_handle_reset 0x7f98940569f0 session 0x7f989405b620 osd.6 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -243> 2023-12-03T11:33:58.404+0000 7f989e43d640 10 monclient: get_auth_request con 0x556e7458e8c0 auth_method 0 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -242> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=0 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -241> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=1 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -240> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=2 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -239> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=3 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -238> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=4 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -237> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=5 2023-12-03T11:33:58.463 INFO:tasks.workunit.client.0.smithi131.stderr: -236> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=6 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -235> 2023-12-03T11:33:58.408+0000 7f98a1f31800 20 add_watcher() i=7 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -234> 2023-12-03T11:33:58.408+0000 7f98a1f31800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -233> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding auth protocol: cephx 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -232> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding auth protocol: cephx 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -231> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding auth protocol: cephx 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -230> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -229> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -228> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -227> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -226> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -225> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -224> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.464 INFO:tasks.workunit.client.0.smithi131.stderr: -223> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -222> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -221> 2023-12-03T11:33:58.409+0000 7f98637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -220> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -219> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -218> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -217> 2023-12-03T11:33:58.410+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -216> 2023-12-03T11:33:58.410+0000 7f98a1f31800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -215> 2023-12-03T11:33:58.410+0000 7f98a1f31800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -214> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command cache list hook 0x556e74535dc0 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -213> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command cache inspect hook 0x556e74535dc0 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -212> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command cache erase hook 0x556e74535dc0 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -211> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command cache zap hook 0x556e74535dc0 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -210> 2023-12-03T11:33:58.410+0000 7f98a1f31800 10 monclient: get_monmap_and_config 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -209> 2023-12-03T11:33:58.410+0000 7f98a1f31800 10 monclient: build_initial_monmap 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -208> 2023-12-03T11:33:58.410+0000 7f98a1f31800 1 build_initial for_mkfs: 0 2023-12-03T11:33:58.465 INFO:tasks.workunit.client.0.smithi131.stderr: -207> 2023-12-03T11:33:58.410+0000 7f98a1f31800 10 monclient: monmap: 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr: -206> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding auth protocol: cephx 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr: -205> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding auth protocol: cephx 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr: -204> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding auth protocol: cephx 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr: -203> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.466 INFO:tasks.workunit.client.0.smithi131.stderr: -202> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -201> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -200> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -199> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -198> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -197> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -196> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -195> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -194> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -193> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -192> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -191> 2023-12-03T11:33:58.410+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -190> 2023-12-03T11:33:58.410+0000 7f98a1f31800 10 monclient: init 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -189> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding auth protocol: cephx 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -188> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding auth protocol: cephx 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -187> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding auth protocol: cephx 2023-12-03T11:33:58.467 INFO:tasks.workunit.client.0.smithi131.stderr: -186> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -185> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -184> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -183> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -182> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -181> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -180> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -179> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -178> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -177> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -176> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -175> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -174> 2023-12-03T11:33:58.410+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -173> 2023-12-03T11:33:58.410+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -172> 2023-12-03T11:33:58.411+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe660c7208 EEXIST 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -171> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient: _reopen_session rank -1 2023-12-03T11:33:58.468 INFO:tasks.workunit.client.0.smithi131.stderr: -170> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -169> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-c con 0x556e745d0350 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -168> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-a con 0x556e745cf930 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -167> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-b con 0x556e745d18a0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -166> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -165> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -164> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -163> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): _renew_subs 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -162> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): authenticate will time out at 1529.789498s 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -161> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): get_auth_request con 0x556e745d0350 auth_method 0 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -160> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -159> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -158> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -157> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): get_auth_request con 0x556e745cf930 auth_method 0 2023-12-03T11:33:58.469 INFO:tasks.workunit.client.0.smithi131.stderr: -156> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -155> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -154> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -153> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): get_auth_request con 0x556e745d18a0 auth_method 0 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -152> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -151> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -150> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -149> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -148> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -147> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -146> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -145> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -144> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -143> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.470 INFO:tasks.workunit.client.0.smithi131.stderr: -142> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.473 INFO:tasks.workunit.client.0.smithi131.stderr: -141> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.473 INFO:tasks.workunit.client.0.smithi131.stderr: -140> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): handle_auth_done global_id 6212 payload 274 2023-12-03T11:33:58.473 INFO:tasks.workunit.client.0.smithi131.stderr: -139> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient: _finish_hunting 0 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr: -138> 2023-12-03T11:33:58.411+0000 7f989e43d640 1 monclient: found mon.noname-c 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr: -137> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr: -136> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr: -135> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr: -134> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: dump: 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.474 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr: -133> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: _finish_auth 0 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr: -132> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: _check_auth_tickets 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr: -131> 2023-12-03T11:33:58.411+0000 7f98a1f31800 5 monclient: authenticate success, global_id 6212 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr: -130> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr: -129> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient: get_monmap_and_config success 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr: -128> 2023-12-03T11:33:58.411+0000 7f98a1f31800 4 set_mon_vals no callback set 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr: -127> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr: -126> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr: -125> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: dump: 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.475 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr: -124> 2023-12-03T11:33:58.412+0000 7f98a1f31800 10 monclient: shutdown 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr: -123> 2023-12-03T11:33:58.412+0000 7f98a1f31800 10 monclient: build_initial_monmap 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr: -122> 2023-12-03T11:33:58.412+0000 7f98a1f31800 1 build_initial for_mkfs: 0 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr: -121> 2023-12-03T11:33:58.412+0000 7f98a1f31800 10 monclient: monmap: 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.476 INFO:tasks.workunit.client.0.smithi131.stderr: -120> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding auth protocol: cephx 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -119> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding auth protocol: cephx 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -118> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding auth protocol: cephx 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -117> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -116> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -115> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -114> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -113> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -112> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -111> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -110> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -109> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -108> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -107> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -106> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -105> 2023-12-03T11:33:58.412+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -104> 2023-12-03T11:33:58.412+0000 7f98a1f31800 1 librados: starting msgr at 2023-12-03T11:33:58.477 INFO:tasks.workunit.client.0.smithi131.stderr: -103> 2023-12-03T11:33:58.412+0000 7f98a1f31800 1 librados: starting objecter 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -102> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command objecter_requests cmddesc objecter_requests hook 0x556e745ccba0 EEXIST 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -101> 2023-12-03T11:33:58.412+0000 7f98a1f31800 1 librados: setting wanted keys 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -100> 2023-12-03T11:33:58.412+0000 7f98a1f31800 1 librados: calling monclient init 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -99> 2023-12-03T11:33:58.412+0000 7f98a1f31800 10 monclient: init 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -98> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding auth protocol: cephx 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -97> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding auth protocol: cephx 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -96> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding auth protocol: cephx 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -95> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -94> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -93> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -92> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.478 INFO:tasks.workunit.client.0.smithi131.stderr: -91> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -90> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -89> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -88> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -87> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -86> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -85> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -84> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -83> 2023-12-03T11:33:58.413+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -82> 2023-12-03T11:33:58.413+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -81> 2023-12-03T11:33:58.413+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command rotate-key cmddesc rotate-key hook 0x556e745d2460 EEXIST 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -80> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient: _reopen_session rank -1 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -79> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -78> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-a con 0x556e745d0350 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -77> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-c con 0x556e745d18a0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -76> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-b con 0x556e745ca750 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -75> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.479 INFO:tasks.workunit.client.0.smithi131.stderr: -74> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -73> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -72> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): _renew_subs 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -71> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): authenticate will time out at 1529.791887s 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -70> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): get_auth_request con 0x556e745d0350 auth_method 0 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -69> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -68> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -67> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -66> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): get_auth_request con 0x556e745d18a0 auth_method 0 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -65> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -64> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -63> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -62> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -61> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -60> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -59> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.480 INFO:tasks.workunit.client.0.smithi131.stderr: -58> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -57> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -56> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): get_auth_request con 0x556e745ca750 auth_method 0 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -55> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -54> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -53> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -52> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -51> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -50> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -49> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): handle_auth_done global_id 6504 payload 824 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -48> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient: _finish_hunting 0 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -47> 2023-12-03T11:33:58.413+0000 7f989e43d640 1 monclient: found mon.noname-a 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -46> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -45> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -44> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr: -43> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: dump: 2023-12-03T11:33:58.481 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr: -42> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: _finish_auth 0 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr: -41> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: _check_auth_tickets 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr: -40> 2023-12-03T11:33:58.414+0000 7f98a1f31800 5 monclient: authenticate success, global_id 6504 2023-12-03T11:33:58.482 INFO:tasks.workunit.client.0.smithi131.stderr: -39> 2023-12-03T11:33:58.414+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr: -38> 2023-12-03T11:33:58.414+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr: -37> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr: -36> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr: -35> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr: -34> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: dump: 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.483 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -33> 2023-12-03T11:33:58.414+0000 7f9862fe5640 4 set_mon_vals no callback set 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -32> 2023-12-03T11:33:58.414+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -31> 2023-12-03T11:33:58.414+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -30> 2023-12-03T11:33:58.414+0000 7f98a1f31800 1 librados: init done 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -29> 2023-12-03T11:33:58.414+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command cr dump hook 0x556e745e3eb8 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -28> 2023-12-03T11:33:58.415+0000 7f98617e2640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -27> 2023-12-03T11:33:58.415+0000 7f98617e2640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -26> 2023-12-03T11:33:58.415+0000 7f98617e2640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -25> 2023-12-03T11:33:58.415+0000 7f989dc3c640 10 monclient: get_auth_request con 0x7f97d8069820 auth_method 0 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -24> 2023-12-03T11:33:58.415+0000 7f98a1f31800 5 note: GC not initialized 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -23> 2023-12-03T11:33:58.415+0000 7f97d27fc640 20 reqs_thread_entry: start 2023-12-03T11:33:58.484 INFO:tasks.workunit.client.0.smithi131.stderr: -22> 2023-12-03T11:33:58.415+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command sync trace show hook 0x7f98900047e0 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -21> 2023-12-03T11:33:58.415+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command sync trace history hook 0x7f98900047e0 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -20> 2023-12-03T11:33:58.415+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command sync trace active hook 0x7f98900047e0 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -19> 2023-12-03T11:33:58.415+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command sync trace active_short hook 0x7f98900047e0 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -18> 2023-12-03T11:33:58.415+0000 7f98a1f31800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -17> 2023-12-03T11:33:58.416+0000 7f98a1f31800 20 Filter name: none 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -16> 2023-12-03T11:33:58.416+0000 7f97c3fff640 20 reqs_thread_entry: start 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -15> 2023-12-03T11:33:58.416+0000 7f98a1f31800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -14> 2023-12-03T11:33:58.416+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -13> 2023-12-03T11:33:58.416+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -12> 2023-12-03T11:33:58.416+0000 7f98a1f31800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -11> 2023-12-03T11:33:58.416+0000 7f98a1f31800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -10> 2023-12-03T11:33:58.416+0000 7f98a1f31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 : miss 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -9> 2023-12-03T11:33:58.416+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -8> 2023-12-03T11:33:58.417+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:58.485 INFO:tasks.workunit.client.0.smithi131.stderr: -7> 2023-12-03T11:33:58.417+0000 7f98a1f31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 info.flags=0x17 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: -6> 2023-12-03T11:33:58.417+0000 7f98a1f31800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 to cache LRU end 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: -5> 2023-12-03T11:33:58.417+0000 7f98a1f31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: -4> 2023-12-03T11:33:58.417+0000 7f98a1f31800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: -3> 2023-12-03T11:33:58.417+0000 7f98a1f31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: -2> 2023-12-03T11:33:58.417+0000 7f989d43b640 10 monclient: get_auth_request con 0x556e7461fd50 auth_method 0 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: -1> 2023-12-03T11:33:58.420+0000 7f98a1f31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f98a1f31800 time 2023-12-03T11:33:58.420969+0000 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f98a4b6eef8] 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f98a4b6f0b6] 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e735eda71] 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: 4: radosgw-admin(+0x79787a) [0x556e735f587a] 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x556e735f9e6b] 2023-12-03T11:33:58.486 INFO:tasks.workunit.client.0.smithi131.stderr: 6: main() 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f98a243feb0] 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 8: __libc_start_main() 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 9: _start() 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 0> 2023-12-03T11:33:58.421+0000 7f98a1f31800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f98a1f31800 thread_name:radosgw-admin 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f98a2454db0] 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f98a24a154c] 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f98a4b6ef52] 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f98a4b6f0b6] 2023-12-03T11:33:58.487 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e735eda71] 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 8: radosgw-admin(+0x79787a) [0x556e735f587a] 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x556e735f9e6b] 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 10: main() 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f98a243feb0] 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 12: __libc_start_main() 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 13: _start() 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr:--- logging levels --- 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 none 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 lockdep 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 context 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 crush 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_balancer 2023-12-03T11:33:58.488 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_locker 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log_expire 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_migrator 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 buffer 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 timer 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 filer 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 striper 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 objecter 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rados 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_mirror 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_replay 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_pwl 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 journaler 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objectcacher 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:33:58.489 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 client 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 osd 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 optracker 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objclass 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 filestore 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 journal 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 ms 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mon 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 0/10 monc 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 paxos 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 tp 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 auth 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 crypto 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 finisher 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 reserver 2023-12-03T11:33:58.490 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 heartbeatmap 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 perfcounter 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 20/20 rgw 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_sync 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_datacache 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_access 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_flight 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 javaclient 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 asok 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 throttle 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 refs 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 compressor 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluestore 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluefs 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 bdev 2023-12-03T11:33:58.491 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 kstore 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 4/ 5 rocksdb 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 fuse 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 2/ 5 mgr 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mgrc 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 dpdk 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 eventtrace 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 prioritycache 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 test 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephsqlite 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_onode 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_odata 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_omap 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_tm 2023-12-03T11:33:58.492 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_t 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_epm 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_lba 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cache 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_journal 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_device 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_backref 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 alienstore 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mclock 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cyanstore 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 ceph_exporter 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 memstore 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 trace 2023-12-03T11:33:58.493 INFO:tasks.workunit.client.0.smithi131.stderr: -2/-2 (syslog threshold) 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 99/99 (stderr threshold) 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f97c3fff640 / http_manager 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f97d27fc640 / http_manager 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f98617e2640 / ms_dispatch 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f9862fe5640 / io_context_pool 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f98637e6640 / rgw_dt_lg_renew 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f987e7fc640 / ms_dispatch 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f987ffff640 / io_context_pool 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f988effd640 / ms_dispatch 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f988ffff640 / io_context_pool 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f989d43b640 / msgr-worker-2 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f989dc3c640 / msgr-worker-1 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f989e43d640 / msgr-worker-0 2023-12-03T11:33:58.494 INFO:tasks.workunit.client.0.smithi131.stderr: 7f98a1f31800 / radosgw-admin 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr: max_recent 500 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr: max_new 1000 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr: log_file /var/log/ceph/ceph-client.admin.101838.log 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr:--- end dump of recent events --- 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr:--- begin dump of recent events --- 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr: -499> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr: -498> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: dump: 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.495 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr: -497> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: _finish_auth 0 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr: -496> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: _check_auth_tickets 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr: -495> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr: -494> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr: -493> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr: -492> 2023-12-03T11:33:58.378+0000 7f988effd640 10 monclient: dump: 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.496 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: -491> 2023-12-03T11:33:58.378+0000 7f98a1f31800 5 monclient: authenticate success, global_id 6492 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: -490> 2023-12-03T11:33:58.378+0000 7f988ffff640 4 set_mon_vals no callback set 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: -489> 2023-12-03T11:33:58.378+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: -488> 2023-12-03T11:33:58.378+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: -487> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: -486> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: -485> 2023-12-03T11:33:58.379+0000 7f98a1f31800 1 librados: init done 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: -484> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: get_monmap_and_config 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: -483> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: build_initial_monmap 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: -482> 2023-12-03T11:33:58.379+0000 7f98a1f31800 1 build_initial for_mkfs: 0 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr: -481> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: monmap: 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:33:58.497 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr: -480> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding auth protocol: cephx 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr: -479> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding auth protocol: cephx 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr: -478> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding auth protocol: cephx 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr: -477> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr: -476> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr: -475> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.498 INFO:tasks.workunit.client.0.smithi131.stderr: -474> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -473> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -472> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -471> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -470> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -469> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -468> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -467> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: crc 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -466> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e310) adding con mode: secure 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -465> 2023-12-03T11:33:58.379+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -464> 2023-12-03T11:33:58.379+0000 7f98a1f31800 10 monclient: init 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -463> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding auth protocol: cephx 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -462> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding auth protocol: cephx 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -461> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding auth protocol: cephx 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -460> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.499 INFO:tasks.workunit.client.0.smithi131.stderr: -459> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -458> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -457> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -456> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -455> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -454> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -453> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -452> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -451> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -450> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: crc 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -449> 2023-12-03T11:33:58.379+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c6b40) adding con mode: secure 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -448> 2023-12-03T11:33:58.380+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -447> 2023-12-03T11:33:58.380+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -446> 2023-12-03T11:33:58.380+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe660c6c88 EEXIST 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -445> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient: _reopen_session rank -1 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -444> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -443> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-b con 0x556e7456ce60 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:33:58.500 INFO:tasks.workunit.client.0.smithi131.stderr: -442> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-a con 0x556e7456d240 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -441> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-c con 0x556e7456c6d0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -440> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -439> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -438> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -437> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): _renew_subs 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -436> 2023-12-03T11:33:58.380+0000 7f98a1f31800 10 monclient(hunting): authenticate will time out at 1529.758793s 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -435> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): get_auth_request con 0x556e7456d240 auth_method 0 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -434> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -433> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -432> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -431> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): get_auth_request con 0x556e7456c6d0 auth_method 0 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -430> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -429> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -428> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -427> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): get_auth_request con 0x556e7456ce60 auth_method 0 2023-12-03T11:33:58.501 INFO:tasks.workunit.client.0.smithi131.stderr: -426> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -425> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -424> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -423> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -422> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -421> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -420> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -419> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -418> 2023-12-03T11:33:58.380+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -417> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -416> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -415> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -414> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient(hunting): handle_auth_done global_id 6495 payload 274 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -413> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient: _finish_hunting 0 2023-12-03T11:33:58.502 INFO:tasks.workunit.client.0.smithi131.stderr: -412> 2023-12-03T11:33:58.380+0000 7f989dc3c640 1 monclient: found mon.noname-a 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr: -411> 2023-12-03T11:33:58.380+0000 7f989dc3c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr: -410> 2023-12-03T11:33:58.380+0000 7f988effd640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr: -409> 2023-12-03T11:33:58.380+0000 7f988effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr: -408> 2023-12-03T11:33:58.380+0000 7f988effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr: -407> 2023-12-03T11:33:58.380+0000 7f989e43d640 10 monclient: get_auth_request con 0x7f9880069820 auth_method 0 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr: -406> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr: -405> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr: -404> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: dump: 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.503 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr: -403> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: _finish_auth 0 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr: -402> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: _check_auth_tickets 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr: -401> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr: -400> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 monclient: authenticate success, global_id 6495 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr: -399> 2023-12-03T11:33:58.381+0000 7f98a1f31800 10 monclient: get_monmap_and_config success 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr: -398> 2023-12-03T11:33:58.381+0000 7f98a1f31800 4 set_mon_vals no callback set 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr: -397> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr: -396> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr: -395> 2023-12-03T11:33:58.381+0000 7f987ffff640 10 monclient: dump: 2023-12-03T11:33:58.504 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr: -394> 2023-12-03T11:33:58.381+0000 7f98a1f31800 10 monclient: shutdown 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr: -393> 2023-12-03T11:33:58.381+0000 7f98a1f31800 10 monclient: build_initial_monmap 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr: -392> 2023-12-03T11:33:58.381+0000 7f98a1f31800 1 build_initial for_mkfs: 0 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr: -391> 2023-12-03T11:33:58.381+0000 7f98a1f31800 10 monclient: monmap: 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:33:58.505 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr: -390> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding auth protocol: cephx 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr: -389> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding auth protocol: cephx 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr: -388> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding auth protocol: cephx 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr: -387> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr: -386> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr: -385> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr: -384> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.506 INFO:tasks.workunit.client.0.smithi131.stderr: -383> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -382> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -381> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -380> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -379> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -378> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -377> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: crc 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -376> 2023-12-03T11:33:58.381+0000 7f98a1f31800 5 AuthRegistry(0x556e7453e1e0) adding con mode: secure 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -375> 2023-12-03T11:33:58.382+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -374> 2023-12-03T11:33:58.382+0000 7f98a1f31800 1 librados: starting msgr at 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -373> 2023-12-03T11:33:58.382+0000 7f98a1f31800 1 librados: starting objecter 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -372> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command objecter_requests cmddesc objecter_requests hook 0x556e74541300 EEXIST 2023-12-03T11:33:58.507 INFO:tasks.workunit.client.0.smithi131.stderr: -371> 2023-12-03T11:33:58.382+0000 7f98a1f31800 1 librados: setting wanted keys 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -370> 2023-12-03T11:33:58.382+0000 7f98a1f31800 1 librados: calling monclient init 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -369> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient: init 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -368> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding auth protocol: cephx 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -367> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding auth protocol: cephx 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -366> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding auth protocol: cephx 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -365> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -364> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -363> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -362> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -361> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -360> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -359> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -358> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.508 INFO:tasks.workunit.client.0.smithi131.stderr: -357> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -356> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -355> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: crc 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -354> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 AuthRegistry(0x556e7453c7b8) adding con mode: secure 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -353> 2023-12-03T11:33:58.382+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -352> 2023-12-03T11:33:58.382+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -351> 2023-12-03T11:33:58.382+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command rotate-key cmddesc rotate-key hook 0x556e7453c900 EEXIST 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -350> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient: _reopen_session rank -1 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -349> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -348> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-c con 0x556e7456c6d0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -347> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-b con 0x556e7456ce60 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -346> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-a con 0x556e7456d240 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -345> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -344> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.509 INFO:tasks.workunit.client.0.smithi131.stderr: -343> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -342> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): _renew_subs 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -341> 2023-12-03T11:33:58.382+0000 7f98a1f31800 10 monclient(hunting): authenticate will time out at 1529.761150s 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -340> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): get_auth_request con 0x556e7456d240 auth_method 0 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -339> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -338> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -337> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -336> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): get_auth_request con 0x556e7456c6d0 auth_method 0 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -335> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -334> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -333> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -332> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -331> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -330> 2023-12-03T11:33:58.382+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.510 INFO:tasks.workunit.client.0.smithi131.stderr: -329> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): get_auth_request con 0x556e7456ce60 auth_method 0 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -328> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -327> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -326> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -325> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -324> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -323> 2023-12-03T11:33:58.382+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -322> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -321> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -320> 2023-12-03T11:33:58.382+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -319> 2023-12-03T11:33:58.383+0000 7f989e43d640 10 monclient(hunting): handle_auth_done global_id 6498 payload 824 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -318> 2023-12-03T11:33:58.383+0000 7f989e43d640 10 monclient: _finish_hunting 0 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -317> 2023-12-03T11:33:58.383+0000 7f989e43d640 1 monclient: found mon.noname-a 2023-12-03T11:33:58.511 INFO:tasks.workunit.client.0.smithi131.stderr: -316> 2023-12-03T11:33:58.383+0000 7f989e43d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr: -315> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr: -314> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr: -313> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: dump: 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr: -312> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: _finish_auth 0 2023-12-03T11:33:58.512 INFO:tasks.workunit.client.0.smithi131.stderr: -311> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: _check_auth_tickets 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr: -310> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr: -309> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr: -308> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr: -307> 2023-12-03T11:33:58.383+0000 7f987e7fc640 10 monclient: dump: 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.513 INFO:tasks.workunit.client.0.smithi131.stderr: -306> 2023-12-03T11:33:58.383+0000 7f987ffff640 4 set_mon_vals no callback set 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -305> 2023-12-03T11:33:58.383+0000 7f98a1f31800 5 monclient: authenticate success, global_id 6498 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -304> 2023-12-03T11:33:58.383+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -303> 2023-12-03T11:33:58.383+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -302> 2023-12-03T11:33:58.383+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -301> 2023-12-03T11:33:58.383+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -300> 2023-12-03T11:33:58.383+0000 7f98a1f31800 1 librados: init done 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -299> 2023-12-03T11:33:58.384+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -298> 2023-12-03T11:33:58.385+0000 7f987e7fc640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -297> 2023-12-03T11:33:58.385+0000 7f987e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -296> 2023-12-03T11:33:58.385+0000 7f987e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -295> 2023-12-03T11:33:58.385+0000 7f989dc3c640 10 monclient: get_auth_request con 0x7f9878069850 auth_method 0 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -294> 2023-12-03T11:33:58.385+0000 7f989d43b640 10 monclient: get_auth_request con 0x556e7458a990 auth_method 0 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -293> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.514 INFO:tasks.workunit.client.0.smithi131.stderr: -292> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 realm 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -291> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -290> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -289> 2023-12-03T11:33:58.386+0000 7f98a1f31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -288> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -287> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -286> 2023-12-03T11:33:58.386+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -285> 2023-12-03T11:33:58.386+0000 7f989dc3c640 10 monclient: get_auth_request con 0x556e7458e8c0 auth_method 0 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -284> 2023-12-03T11:33:58.387+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -283> 2023-12-03T11:33:58.387+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -282> 2023-12-03T11:33:58.387+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -281> 2023-12-03T11:33:58.387+0000 7f98a1f31800 20 searching for the correct realm 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -280> 2023-12-03T11:33:58.387+0000 7f989d43b640 10 monclient: get_auth_request con 0x556e74593900 auth_method 0 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -279> 2023-12-03T11:33:58.388+0000 7f989e43d640 10 monclient: get_auth_request con 0x7f9894057760 auth_method 0 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -278> 2023-12-03T11:33:58.388+0000 7f989dc3c640 10 monclient: get_auth_request con 0x7f9898018070 auth_method 0 2023-12-03T11:33:58.515 INFO:tasks.workunit.client.0.smithi131.stderr: -277> 2023-12-03T11:33:58.389+0000 7f989d43b640 10 monclient: get_auth_request con 0x7f989005e070 auth_method 0 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -276> 2023-12-03T11:33:58.391+0000 7f989e43d640 10 monclient: get_auth_request con 0x7f98940569f0 auth_method 0 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -275> 2023-12-03T11:33:58.393+0000 7f989dc3c640 10 monclient: get_auth_request con 0x7f989405f2c0 auth_method 0 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -274> 2023-12-03T11:33:58.396+0000 7f989dc3c640 0 -- 172.21.15.131:0/3825538438 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x556e7458e8c0 msgr2=0x556e74590d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -273> 2023-12-03T11:33:58.396+0000 7f987e7fc640 1 client.6498.objecter ms_handle_reset 0x556e7458e8c0 session 0x556e742fc320 osd.5 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -272> 2023-12-03T11:33:58.396+0000 7f987e7fc640 10 monclient: _renew_subs 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -271> 2023-12-03T11:33:58.396+0000 7f987e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -270> 2023-12-03T11:33:58.396+0000 7f989dc3c640 10 monclient: get_auth_request con 0x7f9878079670 auth_method 0 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -269> 2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -268> 2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -267> 2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -266> 2023-12-03T11:33:58.397+0000 7f98a1f31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -265> 2023-12-03T11:33:58.397+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -264> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -263> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.516 INFO:tasks.workunit.client.0.smithi131.stderr: -262> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -261> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -260> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -259> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 zone default found 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -258> 2023-12-03T11:33:58.398+0000 7f98a1f31800 4 Realm: () 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -257> 2023-12-03T11:33:58.398+0000 7f98a1f31800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -256> 2023-12-03T11:33:58.398+0000 7f98a1f31800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -255> 2023-12-03T11:33:58.398+0000 7f98a1f31800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -254> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 zonegroup default 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -253> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -252> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -251> 2023-12-03T11:33:58.398+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -250> 2023-12-03T11:33:58.399+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -249> 2023-12-03T11:33:58.399+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -248> 2023-12-03T11:33:58.399+0000 7f98a1f31800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -247> 2023-12-03T11:33:58.399+0000 7f98a1f31800 20 started sync module instance, tier type = 2023-12-03T11:33:58.517 INFO:tasks.workunit.client.0.smithi131.stderr: -246> 2023-12-03T11:33:58.399+0000 7f98a1f31800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -245> 2023-12-03T11:33:58.404+0000 7f989e43d640 0 -- 172.21.15.131:0/3825538438 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f98940569f0 msgr2=0x7f989408b780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -244> 2023-12-03T11:33:58.404+0000 7f987e7fc640 1 client.6498.objecter ms_handle_reset 0x7f98940569f0 session 0x7f989405b620 osd.6 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -243> 2023-12-03T11:33:58.404+0000 7f989e43d640 10 monclient: get_auth_request con 0x556e7458e8c0 auth_method 0 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -242> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=0 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -241> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=1 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -240> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=2 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -239> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=3 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -238> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=4 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -237> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=5 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -236> 2023-12-03T11:33:58.407+0000 7f98a1f31800 20 add_watcher() i=6 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -235> 2023-12-03T11:33:58.408+0000 7f98a1f31800 20 add_watcher() i=7 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -234> 2023-12-03T11:33:58.408+0000 7f98a1f31800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -233> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding auth protocol: cephx 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -232> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding auth protocol: cephx 2023-12-03T11:33:58.518 INFO:tasks.workunit.client.0.smithi131.stderr: -231> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding auth protocol: cephx 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -230> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -229> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -228> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -227> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -226> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -225> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -224> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -223> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -222> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -221> 2023-12-03T11:33:58.409+0000 7f98637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -220> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -219> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: crc 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -218> 2023-12-03T11:33:58.409+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c7570) adding con mode: secure 2023-12-03T11:33:58.519 INFO:tasks.workunit.client.0.smithi131.stderr: -217> 2023-12-03T11:33:58.410+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr: -216> 2023-12-03T11:33:58.410+0000 7f98a1f31800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr: -215> 2023-12-03T11:33:58.410+0000 7f98a1f31800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr: -214> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command cache list hook 0x556e74535dc0 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr: -213> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command cache inspect hook 0x556e74535dc0 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr: -212> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command cache erase hook 0x556e74535dc0 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr: -211> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command cache zap hook 0x556e74535dc0 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr: -210> 2023-12-03T11:33:58.410+0000 7f98a1f31800 10 monclient: get_monmap_and_config 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr: -209> 2023-12-03T11:33:58.410+0000 7f98a1f31800 10 monclient: build_initial_monmap 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr: -208> 2023-12-03T11:33:58.410+0000 7f98a1f31800 1 build_initial for_mkfs: 0 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr: -207> 2023-12-03T11:33:58.410+0000 7f98a1f31800 10 monclient: monmap: 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:33:58.520 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr: -206> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding auth protocol: cephx 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr: -205> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding auth protocol: cephx 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr: -204> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding auth protocol: cephx 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr: -203> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr: -202> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr: -201> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr: -200> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr: -199> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr: -198> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.521 INFO:tasks.workunit.client.0.smithi131.stderr: -197> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -196> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -195> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -194> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -193> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: crc 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -192> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x556e745cee00) adding con mode: secure 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -191> 2023-12-03T11:33:58.410+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -190> 2023-12-03T11:33:58.410+0000 7f98a1f31800 10 monclient: init 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -189> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding auth protocol: cephx 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -188> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding auth protocol: cephx 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -187> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding auth protocol: cephx 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -186> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -185> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -184> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -183> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -182> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.522 INFO:tasks.workunit.client.0.smithi131.stderr: -181> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -180> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -179> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -178> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -177> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -176> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: crc 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -175> 2023-12-03T11:33:58.410+0000 7f98a1f31800 5 AuthRegistry(0x7ffe660c70c0) adding con mode: secure 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -174> 2023-12-03T11:33:58.410+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -173> 2023-12-03T11:33:58.410+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -172> 2023-12-03T11:33:58.411+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command rotate-key cmddesc rotate-key hook 0x7ffe660c7208 EEXIST 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -171> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient: _reopen_session rank -1 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -170> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -169> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-c con 0x556e745d0350 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -168> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-a con 0x556e745cf930 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -167> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-b con 0x556e745d18a0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:33:58.523 INFO:tasks.workunit.client.0.smithi131.stderr: -166> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -165> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -164> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -163> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): _renew_subs 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -162> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient(hunting): authenticate will time out at 1529.789498s 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -161> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): get_auth_request con 0x556e745d0350 auth_method 0 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -160> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -159> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -158> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -157> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): get_auth_request con 0x556e745cf930 auth_method 0 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -156> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -155> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -154> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -153> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): get_auth_request con 0x556e745d18a0 auth_method 0 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -152> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -151> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.524 INFO:tasks.workunit.client.0.smithi131.stderr: -150> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -149> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -148> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -147> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -146> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -145> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -144> 2023-12-03T11:33:58.411+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -143> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -142> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -141> 2023-12-03T11:33:58.411+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -140> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient(hunting): handle_auth_done global_id 6212 payload 274 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -139> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient: _finish_hunting 0 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -138> 2023-12-03T11:33:58.411+0000 7f989e43d640 1 monclient: found mon.noname-c 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -137> 2023-12-03T11:33:58.411+0000 7f989e43d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -136> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -135> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr: -134> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: dump: 2023-12-03T11:33:58.525 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr: -133> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: _finish_auth 0 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr: -132> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: _check_auth_tickets 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr: -131> 2023-12-03T11:33:58.411+0000 7f98a1f31800 5 monclient: authenticate success, global_id 6212 2023-12-03T11:33:58.526 INFO:tasks.workunit.client.0.smithi131.stderr: -130> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr: -129> 2023-12-03T11:33:58.411+0000 7f98a1f31800 10 monclient: get_monmap_and_config success 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr: -128> 2023-12-03T11:33:58.411+0000 7f98a1f31800 4 set_mon_vals no callback set 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr: -127> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr: -126> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr: -125> 2023-12-03T11:33:58.411+0000 7f9862fe5640 10 monclient: dump: 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.527 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr: -124> 2023-12-03T11:33:58.412+0000 7f98a1f31800 10 monclient: shutdown 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr: -123> 2023-12-03T11:33:58.412+0000 7f98a1f31800 10 monclient: build_initial_monmap 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr: -122> 2023-12-03T11:33:58.412+0000 7f98a1f31800 1 build_initial for_mkfs: 0 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr: -121> 2023-12-03T11:33:58.412+0000 7f98a1f31800 10 monclient: monmap: 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:33:58.528 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -120> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding auth protocol: cephx 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -119> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding auth protocol: cephx 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -118> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding auth protocol: cephx 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -117> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -116> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -115> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -114> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -113> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -112> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -111> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -110> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -109> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.529 INFO:tasks.workunit.client.0.smithi131.stderr: -108> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -107> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: crc 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -106> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745ced90) adding con mode: secure 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -105> 2023-12-03T11:33:58.412+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -104> 2023-12-03T11:33:58.412+0000 7f98a1f31800 1 librados: starting msgr at 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -103> 2023-12-03T11:33:58.412+0000 7f98a1f31800 1 librados: starting objecter 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -102> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command objecter_requests cmddesc objecter_requests hook 0x556e745ccba0 EEXIST 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -101> 2023-12-03T11:33:58.412+0000 7f98a1f31800 1 librados: setting wanted keys 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -100> 2023-12-03T11:33:58.412+0000 7f98a1f31800 1 librados: calling monclient init 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -99> 2023-12-03T11:33:58.412+0000 7f98a1f31800 10 monclient: init 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -98> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding auth protocol: cephx 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -97> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding auth protocol: cephx 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -96> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding auth protocol: cephx 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -95> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.530 INFO:tasks.workunit.client.0.smithi131.stderr: -94> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -93> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -92> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -91> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -90> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -89> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -88> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -87> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -86> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -85> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: crc 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -84> 2023-12-03T11:33:58.412+0000 7f98a1f31800 5 AuthRegistry(0x556e745d2318) adding con mode: secure 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -83> 2023-12-03T11:33:58.413+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -82> 2023-12-03T11:33:58.413+0000 7f98a1f31800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -81> 2023-12-03T11:33:58.413+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command rotate-key cmddesc rotate-key hook 0x556e745d2460 EEXIST 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -80> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient: _reopen_session rank -1 2023-12-03T11:33:58.531 INFO:tasks.workunit.client.0.smithi131.stderr: -79> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -78> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-a con 0x556e745d0350 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -77> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-c con 0x556e745d18a0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -76> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): picked mon.noname-b con 0x556e745ca750 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -75> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -74> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -73> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): start opening mon connection 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -72> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): _renew_subs 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -71> 2023-12-03T11:33:58.413+0000 7f98a1f31800 10 monclient(hunting): authenticate will time out at 1529.791887s 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -70> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): get_auth_request con 0x556e745d0350 auth_method 0 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -69> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -68> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -67> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -66> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): get_auth_request con 0x556e745d18a0 auth_method 0 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -65> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -64> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.532 INFO:tasks.workunit.client.0.smithi131.stderr: -63> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -62> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -61> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -60> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -59> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -58> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -57> 2023-12-03T11:33:58.413+0000 7f989dc3c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -56> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): get_auth_request con 0x556e745ca750 auth_method 0 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -55> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -54> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -53> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -52> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -51> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -50> 2023-12-03T11:33:58.413+0000 7f989d43b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -49> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient(hunting): handle_auth_done global_id 6504 payload 824 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -48> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient: _finish_hunting 0 2023-12-03T11:33:58.533 INFO:tasks.workunit.client.0.smithi131.stderr: -47> 2023-12-03T11:33:58.413+0000 7f989e43d640 1 monclient: found mon.noname-a 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr: -46> 2023-12-03T11:33:58.413+0000 7f989e43d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr: -45> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr: -44> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr: -43> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: dump: 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.534 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr: -42> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: _finish_auth 0 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr: -41> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: _check_auth_tickets 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr: -40> 2023-12-03T11:33:58.414+0000 7f98a1f31800 5 monclient: authenticate success, global_id 6504 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr: -39> 2023-12-03T11:33:58.414+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr: -38> 2023-12-03T11:33:58.414+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr: -37> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr: -36> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr: -35> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr: -34> 2023-12-03T11:33:58.414+0000 7f98617e2640 10 monclient: dump: 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:33:58.535 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -33> 2023-12-03T11:33:58.414+0000 7f9862fe5640 4 set_mon_vals no callback set 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -32> 2023-12-03T11:33:58.414+0000 7f98a1f31800 10 monclient: _renew_subs 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -31> 2023-12-03T11:33:58.414+0000 7f98a1f31800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -30> 2023-12-03T11:33:58.414+0000 7f98a1f31800 1 librados: init done 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -29> 2023-12-03T11:33:58.414+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command cr dump hook 0x556e745e3eb8 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -28> 2023-12-03T11:33:58.415+0000 7f98617e2640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -27> 2023-12-03T11:33:58.415+0000 7f98617e2640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -26> 2023-12-03T11:33:58.415+0000 7f98617e2640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -25> 2023-12-03T11:33:58.415+0000 7f989dc3c640 10 monclient: get_auth_request con 0x7f97d8069820 auth_method 0 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -24> 2023-12-03T11:33:58.415+0000 7f98a1f31800 5 note: GC not initialized 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -23> 2023-12-03T11:33:58.415+0000 7f97d27fc640 20 reqs_thread_entry: start 2023-12-03T11:33:58.536 INFO:tasks.workunit.client.0.smithi131.stderr: -22> 2023-12-03T11:33:58.415+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command sync trace show hook 0x7f98900047e0 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -21> 2023-12-03T11:33:58.415+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command sync trace history hook 0x7f98900047e0 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -20> 2023-12-03T11:33:58.415+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command sync trace active hook 0x7f98900047e0 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -19> 2023-12-03T11:33:58.415+0000 7f98a1f31800 5 asok(0x556e74333a10) register_command sync trace active_short hook 0x7f98900047e0 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -18> 2023-12-03T11:33:58.415+0000 7f98a1f31800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -17> 2023-12-03T11:33:58.416+0000 7f98a1f31800 20 Filter name: none 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -16> 2023-12-03T11:33:58.416+0000 7f97c3fff640 20 reqs_thread_entry: start 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -15> 2023-12-03T11:33:58.416+0000 7f98a1f31800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -14> 2023-12-03T11:33:58.416+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -13> 2023-12-03T11:33:58.416+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -12> 2023-12-03T11:33:58.416+0000 7f98a1f31800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -11> 2023-12-03T11:33:58.416+0000 7f98a1f31800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -10> 2023-12-03T11:33:58.416+0000 7f98a1f31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 : miss 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -9> 2023-12-03T11:33:58.416+0000 7f98a1f31800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -8> 2023-12-03T11:33:58.417+0000 7f98a1f31800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -7> 2023-12-03T11:33:58.417+0000 7f98a1f31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 info.flags=0x17 2023-12-03T11:33:58.537 INFO:tasks.workunit.client.0.smithi131.stderr: -6> 2023-12-03T11:33:58.417+0000 7f98a1f31800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 to cache LRU end 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: -5> 2023-12-03T11:33:58.417+0000 7f98a1f31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: -4> 2023-12-03T11:33:58.417+0000 7f98a1f31800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: -3> 2023-12-03T11:33:58.417+0000 7f98a1f31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: -2> 2023-12-03T11:33:58.417+0000 7f989d43b640 10 monclient: get_auth_request con 0x556e7461fd50 auth_method 0 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: -1> 2023-12-03T11:33:58.420+0000 7f98a1f31800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f98a1f31800 time 2023-12-03T11:33:58.420969+0000 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f98a4b6eef8] 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f98a4b6f0b6] 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e735eda71] 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: 4: radosgw-admin(+0x79787a) [0x556e735f587a] 2023-12-03T11:33:58.538 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x556e735f9e6b] 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 6: main() 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 7: /lib64/libc.so.6(+0x3feb0) [0x7f98a243feb0] 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 8: __libc_start_main() 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 9: _start() 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 0> 2023-12-03T11:33:58.421+0000 7f98a1f31800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f98a1f31800 thread_name:radosgw-admin 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f98a2454db0] 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f98a24a154c] 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f98a4b6ef52] 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f98a4b6f0b6] 2023-12-03T11:33:58.539 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556e735eda71] 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 8: radosgw-admin(+0x79787a) [0x556e735f587a] 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x556e735f9e6b] 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 10: main() 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 11: /lib64/libc.so.6(+0x3feb0) [0x7f98a243feb0] 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 12: __libc_start_main() 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 13: _start() 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr:--- logging levels --- 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 none 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 lockdep 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 context 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 crush 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds 2023-12-03T11:33:58.540 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_balancer 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_locker 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log_expire 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_migrator 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 buffer 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 timer 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 filer 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 striper 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 objecter 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rados 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_mirror 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_replay 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_pwl 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 journaler 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objectcacher 2023-12-03T11:33:58.541 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 client 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 osd 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 optracker 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objclass 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 filestore 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 journal 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 ms 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mon 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 0/10 monc 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 paxos 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 tp 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 auth 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 crypto 2023-12-03T11:33:58.542 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 finisher 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 reserver 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 heartbeatmap 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 perfcounter 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 20/20 rgw 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_sync 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_datacache 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_access 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_flight 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 javaclient 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 asok 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 throttle 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 refs 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 compressor 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluestore 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluefs 2023-12-03T11:33:58.543 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 bdev 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 kstore 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 4/ 5 rocksdb 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 fuse 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 2/ 5 mgr 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mgrc 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 dpdk 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 eventtrace 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 prioritycache 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 test 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephsqlite 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_onode 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_odata 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_omap 2023-12-03T11:33:58.544 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_tm 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_t 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_epm 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_lba 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cache 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_journal 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_device 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_backref 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 alienstore 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mclock 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cyanstore 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 ceph_exporter 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 memstore 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 trace 2023-12-03T11:33:58.545 INFO:tasks.workunit.client.0.smithi131.stderr: -2/-2 (syslog threshold) 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 99/99 (stderr threshold) 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f97c3fff640 / http_manager 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f97d27fc640 / http_manager 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f98617e2640 / ms_dispatch 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f9862fe5640 / io_context_pool 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f98637e6640 / rgw_dt_lg_renew 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f987e7fc640 / ms_dispatch 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f987ffff640 / io_context_pool 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f988effd640 / ms_dispatch 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f988ffff640 / io_context_pool 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f989d43b640 / msgr-worker-2 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f989dc3c640 / msgr-worker-1 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f989e43d640 / msgr-worker-0 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: 7f98a1f31800 / radosgw-admin 2023-12-03T11:33:58.546 INFO:tasks.workunit.client.0.smithi131.stderr: max_recent 500 2023-12-03T11:33:58.547 INFO:tasks.workunit.client.0.smithi131.stderr: max_new 1000 2023-12-03T11:33:58.547 INFO:tasks.workunit.client.0.smithi131.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:33:58.422511Z_8121afba-b0b9-472d-88d4-ad13a9d95359/log 2023-12-03T11:33:58.547 INFO:tasks.workunit.client.0.smithi131.stderr:--- end dump of recent events --- 2023-12-03T11:33:58.547 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-12-03T11:33:58.551 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.468+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.470+0000 7f3e87baf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.470+0000 7f3e87baf800 20 realm 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.470+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.470+0000 7f3e87baf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.470+0000 7f3e87baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.470+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.470+0000 7f3e87baf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.470+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.471+0000 7f3e87baf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.471+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.471+0000 7f3e87baf800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.471+0000 7f3e87baf800 20 searching for the correct realm 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.481+0000 7f3e856af640 0 -- 172.21.15.131:0/1896234896 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x558b2640b940 msgr2=0x558b2640de00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:58.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 zone default found 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 4 Realm: () 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 zonegroup default 2023-12-03T11:33:58.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.482+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.483+0000 7f3e87baf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.483+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.483+0000 7f3e87baf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.483+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.483+0000 7f3e87baf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.483+0000 7f3e87baf800 20 started sync module instance, tier type = 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.483+0000 7f3e87baf800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.489+0000 7f3e85eb0640 0 -- 172.21.15.131:0/1896234896 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f3e70035930 msgr2=0x7f3e70026420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.492+0000 7f3e87baf800 20 add_watcher() i=0 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.492+0000 7f3e87baf800 20 add_watcher() i=1 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.492+0000 7f3e87baf800 20 add_watcher() i=2 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.492+0000 7f3e87baf800 20 add_watcher() i=3 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.492+0000 7f3e87baf800 20 add_watcher() i=4 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.492+0000 7f3e87baf800 20 add_watcher() i=5 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.492+0000 7f3e87baf800 20 add_watcher() i=6 2023-12-03T11:33:58.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.493+0000 7f3e87baf800 20 add_watcher() i=7 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.493+0000 7f3e87baf800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.495+0000 7f3e4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.495+0000 7f3e87baf800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.495+0000 7f3e87baf800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.501+0000 7f3e87baf800 5 note: GC not initialized 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.501+0000 7f3db9ffb640 20 reqs_thread_entry: start 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.501+0000 7f3e87baf800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.501+0000 7f3e87baf800 20 Filter name: none 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.502+0000 7f3dab7fe640 20 reqs_thread_entry: start 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.502+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.502+0000 7f3e87baf800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.502+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.502+0000 7f3e87baf800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.502+0000 7f3e87baf800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.502+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.503+0000 7f3e87baf800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.503+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.503+0000 7f3e87baf800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.503+0000 7f3e87baf800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.503+0000 7f3e87baf800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.504+0000 7f3e87baf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.504+0000 7f3e4afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.506+0000 7f3e87baf800 20 remove_watcher() i=0 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.506+0000 7f3e87baf800 2 removed watcher, disabling cache 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.507+0000 7f3e87baf800 20 remove_watcher() i=1 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.508+0000 7f3e87baf800 20 remove_watcher() i=2 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.509+0000 7f3e87baf800 20 remove_watcher() i=3 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.510+0000 7f3e87baf800 20 remove_watcher() i=4 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.511+0000 7f3e87baf800 20 remove_watcher() i=5 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.512+0000 7f3e87baf800 20 remove_watcher() i=6 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.513+0000 7f3e87baf800 20 remove_watcher() i=7 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.556 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:33:58.557 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-set-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:33:58.557 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:33:58.570 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:33:58.601 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:33:58.601 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:33:58.614 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.613+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.615+0000 7f411c522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.615+0000 7f411c522800 20 realm 2023-12-03T11:33:58.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.615+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.615+0000 7f411c522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.615+0000 7f411c522800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:33:58.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.615+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.615+0000 7f411c522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.615+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.616+0000 7f411c522800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.617 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.616+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.616+0000 7f411c522800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:33:58.618 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.616+0000 7f411c522800 20 searching for the correct realm 2023-12-03T11:33:58.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.625+0000 7f410ffff640 0 -- 172.21.15.131:0/1595166271 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x564b633d8ad0 msgr2=0x564b633daec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:33:58.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.626+0000 7f411c522800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:33:58.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.626+0000 7f411c522800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:33:58.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.626+0000 7f411c522800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:33:58.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.626+0000 7f411c522800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:33:58.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.626+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.627+0000 7f411c522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.627+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.627+0000 7f411c522800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.627+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 20 zone default found 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 4 Realm: () 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 20 zonegroup default 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:33:58.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 20 started sync module instance, tier type = 2023-12-03T11:33:58.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.628+0000 7f411c522800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:33:58.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.634+0000 7f410ffff640 0 -- 172.21.15.131:0/1595166271 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x7f40f00795c0 msgr2=0x7f40f007b9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:33:58.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.637+0000 7f411c522800 20 add_watcher() i=0 2023-12-03T11:33:58.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.637+0000 7f411c522800 20 add_watcher() i=1 2023-12-03T11:33:58.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.637+0000 7f411c522800 20 add_watcher() i=2 2023-12-03T11:33:58.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.637+0000 7f411c522800 20 add_watcher() i=3 2023-12-03T11:33:58.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.637+0000 7f411c522800 20 add_watcher() i=4 2023-12-03T11:33:58.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.637+0000 7f411c522800 20 add_watcher() i=5 2023-12-03T11:33:58.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.637+0000 7f411c522800 20 add_watcher() i=6 2023-12-03T11:33:58.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.638+0000 7f411c522800 20 add_watcher() i=7 2023-12-03T11:33:58.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.638+0000 7f411c522800 2 all 8 watchers are set, enabling cache 2023-12-03T11:33:58.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.640+0000 7f40de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:58.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.640+0000 7f411c522800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:33:58.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.640+0000 7f411c522800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:33:58.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.646+0000 7f411c522800 5 note: GC not initialized 2023-12-03T11:33:58.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.646+0000 7f404d7fa640 20 reqs_thread_entry: start 2023-12-03T11:33:58.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.646+0000 7f411c522800 20 init_complete bucket index max shards: 1 2023-12-03T11:33:58.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.646+0000 7f411c522800 20 Filter name: none 2023-12-03T11:33:58.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.646+0000 7f4046ffd640 20 reqs_thread_entry: start 2023-12-03T11:33:58.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.646+0000 7f411c522800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:33:58.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.646+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.647+0000 7f411c522800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:33:58.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.647+0000 7f411c522800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:33:58.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.647+0000 7f411c522800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:33:58.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.647+0000 7f411c522800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 : miss 2023-12-03T11:33:58.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.647+0000 7f411c522800 20 rados->read ofs=0 len=0 2023-12-03T11:33:58.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.647+0000 7f411c522800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:33:58.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.647+0000 7f411c522800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 info.flags=0x17 2023-12-03T11:33:58.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.647+0000 7f411c522800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 to cache LRU end 2023-12-03T11:33:58.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.647+0000 7f411c522800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:33:58.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.647+0000 7f411c522800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:33:58.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.647+0000 7f411c522800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 2023-12-03T11:33:58.650 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.648+0000 7f411c522800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 to be held by another RGW process; skipping for now 2023-12-03T11:33:58.650 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.649+0000 7f40de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:33:58.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.651+0000 7f411c522800 20 remove_watcher() i=0 2023-12-03T11:33:58.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.651+0000 7f411c522800 2 removed watcher, disabling cache 2023-12-03T11:33:58.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.652+0000 7f411c522800 20 remove_watcher() i=1 2023-12-03T11:33:58.654 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.653+0000 7f411c522800 20 remove_watcher() i=2 2023-12-03T11:33:58.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.654+0000 7f411c522800 20 remove_watcher() i=3 2023-12-03T11:33:58.656 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.655+0000 7f411c522800 20 remove_watcher() i=4 2023-12-03T11:33:58.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.656+0000 7f411c522800 20 remove_watcher() i=5 2023-12-03T11:33:58.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.657+0000 7f411c522800 20 remove_watcher() i=6 2023-12-03T11:33:58.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:33:58.658+0000 7f411c522800 20 remove_watcher() i=7 2023-12-03T11:33:58.663 INFO:tasks.workunit.client.0.smithi131.stderr:waiting 30 seconds for reshard lock to expire... 2023-12-03T11:34:28.684 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:34:28.719 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:28.719 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:28.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.733+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.735+0000 7fc5b2f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.735+0000 7fc5b2f30800 20 realm 2023-12-03T11:34:28.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.735+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.735+0000 7fc5b2f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.735+0000 7fc5b2f30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:28.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.735+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.736+0000 7fc5b2f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.737 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.736+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.737+0000 7fc5b2f30800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:28.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.737+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.737+0000 7fc5b2f30800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:28.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.737+0000 7fc5b2f30800 20 searching for the correct realm 2023-12-03T11:34:28.750 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.749+0000 7fc5aeb5b640 0 -- 172.21.15.131:0/478875259 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55cab05e4c00 msgr2=0x55cab05e7050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:28.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.750+0000 7fc5b2f30800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:28.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.750+0000 7fc5b2f30800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:28.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.750+0000 7fc5b2f30800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:28.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.750+0000 7fc5b2f30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:28.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.750+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.750+0000 7fc5b2f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.750+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.750+0000 7fc5b2f30800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:28.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:28.753 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 20 zone default found 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 4 Realm: () 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 20 zonegroup default 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.751+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.752+0000 7fc5b2f30800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.752+0000 7fc5b2f30800 20 started sync module instance, tier type = 2023-12-03T11:34:28.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.752+0000 7fc5b2f30800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:28.761 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.760+0000 7fc5aeb5b640 0 -- 172.21.15.131:0/478875259 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7fc5a8037030 msgr2=0x7fc5a807c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:28.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.762+0000 7fc5b2f30800 20 add_watcher() i=0 2023-12-03T11:34:28.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.762+0000 7fc5b2f30800 20 add_watcher() i=1 2023-12-03T11:34:28.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.762+0000 7fc5b2f30800 20 add_watcher() i=2 2023-12-03T11:34:28.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.762+0000 7fc5b2f30800 20 add_watcher() i=3 2023-12-03T11:34:28.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.762+0000 7fc5b2f30800 20 add_watcher() i=4 2023-12-03T11:34:28.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.762+0000 7fc5b2f30800 20 add_watcher() i=5 2023-12-03T11:34:28.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.762+0000 7fc5b2f30800 20 add_watcher() i=6 2023-12-03T11:34:28.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.763+0000 7fc5b2f30800 20 add_watcher() i=7 2023-12-03T11:34:28.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.763+0000 7fc5b2f30800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:28.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.764+0000 7fc4effff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:28.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.765+0000 7fc5b2f30800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:28.766 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.765+0000 7fc5b2f30800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:28.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.771+0000 7fc5b2f30800 5 note: GC not initialized 2023-12-03T11:34:28.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.771+0000 7fc4deffd640 20 reqs_thread_entry: start 2023-12-03T11:34:28.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.771+0000 7fc5b2f30800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:28.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.771+0000 7fc5b2f30800 20 Filter name: none 2023-12-03T11:34:28.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.771+0000 7fc4dcff9640 20 reqs_thread_entry: start 2023-12-03T11:34:28.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.771+0000 7fc5b2f30800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2023-12-03T11:34:28.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.771+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.772+0000 7fc5b2f30800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:34:28.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.772+0000 7fc5b2f30800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2023-12-03T11:34:28.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.772+0000 7fc5b2f30800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2023-12-03T11:34:28.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.772+0000 7fc5b2f30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 : miss 2023-12-03T11:34:28.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.772+0000 7fc5b2f30800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.772+0000 7fc5b2f30800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:34:28.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.772+0000 7fc5b2f30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 info.flags=0x17 2023-12-03T11:34:28.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.772+0000 7fc5b2f30800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 to cache LRU end 2023-12-03T11:34:28.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.772+0000 7fc5b2f30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:34:28.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.772+0000 7fc5b2f30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:28.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.772+0000 7fc5b2f30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 2023-12-03T11:34:28.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.776+0000 7fc5b2f30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 info.flags=0x17 2023-12-03T11:34:28.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.776+0000 7fc5b2f30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 to cache LRU end 2023-12-03T11:34:28.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.776+0000 7fc5b2f30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:28.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.776+0000 7fc5b2f30800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20, ofs0, ns] 2023-12-03T11:34:28.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.776+0000 7fc5a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791318 cookie 94329030766432 notifier 6266 bl.length()=887 2023-12-03T11:34:28.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.776+0000 7fc5a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 info.flags=0x17 2023-12-03T11:34:28.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.776+0000 7fc5a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 to cache LRU end 2023-12-03T11:34:28.778 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.776+0000 7fc5a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:28.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.777+0000 7fc5b2f30800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20]): orig_sources= new_sources= 2023-12-03T11:34:28.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.777+0000 7fc5b2f30800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20]): potential sources added=[] removed=[] 2023-12-03T11:34:28.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.777+0000 7fc5b2f30800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20]): orig_dests= new_dests= 2023-12-03T11:34:28.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.777+0000 7fc5b2f30800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20]): potential dests added=[] removed=[] 2023-12-03T11:34:28.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.778+0000 7fc5b2f30800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20.1.0 2023-12-03T11:34:28.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.778+0000 7fc5b2f30800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20.1.0 2023-12-03T11:34:28.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.778+0000 7fc5b2f30800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20.1.1 2023-12-03T11:34:28.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.778+0000 7fc5b2f30800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20.1.1 2023-12-03T11:34:28.779 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.778+0000 7fc5b2f30800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20.0 2023-12-03T11:34:28.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.780+0000 7fc5b2f30800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 : hit (requested=0x17, cached=0x17) 2023-12-03T11:34:28.781 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.780+0000 7fc5b2f30800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 2023-12-03T11:34:28.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.781+0000 7fc5b2f30800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 info.flags=0x17 2023-12-03T11:34:28.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.781+0000 7fc5b2f30800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 to cache LRU end 2023-12-03T11:34:28.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.781+0000 7fc5b2f30800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:28.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.781+0000 7fc5b2f30800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20, ofs0, ns] 2023-12-03T11:34:28.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.782+0000 7fc5a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791319 cookie 94329030766432 notifier 6266 bl.length()=855 2023-12-03T11:34:28.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.782+0000 7fc5a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 info.flags=0x17 2023-12-03T11:34:28.783 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.782+0000 7fc5a4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 to cache LRU end 2023-12-03T11:34:28.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.782+0000 7fc5a4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:28.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.782+0000 7fc5b2f30800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20]): orig_sources= new_sources= 2023-12-03T11:34:28.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.782+0000 7fc5b2f30800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20]): potential sources added=[] removed=[] 2023-12-03T11:34:28.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.782+0000 7fc5b2f30800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20]): orig_dests= new_dests= 2023-12-03T11:34:28.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.782+0000 7fc5b2f30800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20]): potential dests added=[] removed=[] 2023-12-03T11:34:28.784 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.783+0000 7fc5b2f30800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2023-12-03T11:34:28.786 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.785+0000 7fc4effff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:28.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.787+0000 7fc5b2f30800 20 remove_watcher() i=0 2023-12-03T11:34:28.788 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.787+0000 7fc5b2f30800 2 removed watcher, disabling cache 2023-12-03T11:34:28.789 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.788+0000 7fc5b2f30800 20 remove_watcher() i=1 2023-12-03T11:34:28.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.789+0000 7fc5b2f30800 20 remove_watcher() i=2 2023-12-03T11:34:28.791 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.790+0000 7fc5b2f30800 20 remove_watcher() i=3 2023-12-03T11:34:28.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.791+0000 7fc5b2f30800 20 remove_watcher() i=4 2023-12-03T11:34:28.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.792+0000 7fc5b2f30800 20 remove_watcher() i=5 2023-12-03T11:34:28.794 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.793+0000 7fc5b2f30800 20 remove_watcher() i=6 2023-12-03T11:34:28.795 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.794+0000 7fc5b2f30800 20 remove_watcher() i=7 2023-12-03T11:34:28.802 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2023-12-03T11:34:28.830 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:28.830 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:28.843 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.842+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.844+0000 7ff36a122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.844+0000 7ff36a122800 20 realm 2023-12-03T11:34:28.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.844+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.844+0000 7ff36a122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.844+0000 7ff36a122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:28.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.844+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.844+0000 7ff36a122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.844+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.845+0000 7ff36a122800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:28.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.845+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.845+0000 7ff36a122800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:28.847 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.845+0000 7ff36a122800 20 searching for the correct realm 2023-12-03T11:34:28.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.855+0000 7ff35ffff640 0 -- 172.21.15.131:0/2315389134 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x56386066d0d0 msgr2=0x56386066f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:34:28.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.856+0000 7ff36a122800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:28.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.856+0000 7ff36a122800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:28.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.856+0000 7ff36a122800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:28.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.856+0000 7ff36a122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:28.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.856+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.856+0000 7ff36a122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.856+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:28.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:28.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 20 zone default found 2023-12-03T11:34:28.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 4 Realm: () 2023-12-03T11:34:28.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:28.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:28.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:28.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 20 zonegroup default 2023-12-03T11:34:28.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.857+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.858+0000 7ff36a122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.858+0000 7ff36a122800 20 started sync module instance, tier type = 2023-12-03T11:34:28.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.858+0000 7ff36a122800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:28.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.864+0000 7ff3665ca640 0 -- 172.21.15.131:0/2315389134 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7ff35005f3a0 msgr2=0x7ff350076190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:28.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.867+0000 7ff36a122800 20 add_watcher() i=0 2023-12-03T11:34:28.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.867+0000 7ff36a122800 20 add_watcher() i=1 2023-12-03T11:34:28.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.867+0000 7ff36a122800 20 add_watcher() i=2 2023-12-03T11:34:28.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.867+0000 7ff36a122800 20 add_watcher() i=3 2023-12-03T11:34:28.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.867+0000 7ff36a122800 20 add_watcher() i=4 2023-12-03T11:34:28.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.867+0000 7ff36a122800 20 add_watcher() i=5 2023-12-03T11:34:28.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.867+0000 7ff36a122800 20 add_watcher() i=6 2023-12-03T11:34:28.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.868+0000 7ff36a122800 20 add_watcher() i=7 2023-12-03T11:34:28.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.868+0000 7ff36a122800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:28.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.869+0000 7ff32b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:28.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.869+0000 7ff36a122800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:28.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.869+0000 7ff36a122800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:28.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.875+0000 7ff36a122800 5 note: GC not initialized 2023-12-03T11:34:28.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.875+0000 7ff29a7fc640 20 reqs_thread_entry: start 2023-12-03T11:34:28.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.876+0000 7ff36a122800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:28.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.876+0000 7ff36a122800 20 Filter name: none 2023-12-03T11:34:28.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.876+0000 7ff28bfff640 20 reqs_thread_entry: start 2023-12-03T11:34:28.877 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.876+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.876+0000 7ff36a122800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:34:28.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.876+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.877+0000 7ff36a122800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:34:28.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.877+0000 7ff36a122800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:28.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.877+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.877+0000 7ff36a122800 20 rados_obj.operate() r=0 bl.length=194 2023-12-03T11:34:28.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.877+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.877+0000 7ff36a122800 20 rados_obj.operate() r=0 bl.length=378 2023-12-03T11:34:28.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.877+0000 7ff36a122800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:28.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.878+0000 7ff36a122800 20 rados->read ofs=0 len=0 2023-12-03T11:34:28.879 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.878+0000 7ff36a122800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:28.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.879+0000 7ff32b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:28.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.881+0000 7ff36a122800 20 remove_watcher() i=0 2023-12-03T11:34:28.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.881+0000 7ff36a122800 2 removed watcher, disabling cache 2023-12-03T11:34:28.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.882+0000 7ff36a122800 20 remove_watcher() i=1 2023-12-03T11:34:28.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.883+0000 7ff36a122800 20 remove_watcher() i=2 2023-12-03T11:34:28.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.884+0000 7ff36a122800 20 remove_watcher() i=3 2023-12-03T11:34:28.886 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.885+0000 7ff36a122800 20 remove_watcher() i=4 2023-12-03T11:34:28.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.885+0000 7ff36a122800 20 remove_watcher() i=5 2023-12-03T11:34:28.888 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.886+0000 7ff36a122800 20 remove_watcher() i=6 2023-12-03T11:34:28.888 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:28.887+0000 7ff36a122800 20 remove_watcher() i=7 2023-12-03T11:34:28.893 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:28.893 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:34:28.893 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-set-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.20 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:34:28.893 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:28.967 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard bucket with EIO injected at block_writes 2023-12-03T11:34:28.967 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:29.141 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-12-03T11:34:29.168 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:29.168 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:29.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.180+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.182+0000 7f0b31d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.182+0000 7f0b31d26800 20 realm 2023-12-03T11:34:29.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.182+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.182+0000 7f0b31d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.182+0000 7f0b31d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:29.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.182+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.182+0000 7f0b31d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.182+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.183+0000 7f0b31d26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.183+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.184+0000 7f0b31d26800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:29.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.184+0000 7f0b31d26800 20 searching for the correct realm 2023-12-03T11:34:29.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.193+0000 7f0b2d923640 0 -- 172.21.15.131:0/2018260901 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x564c9f8d8010 msgr2=0x564c9f8da400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:29.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.194+0000 7f0b31d26800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:29.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.194+0000 7f0b31d26800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:29.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.194+0000 7f0b31d26800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:29.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.194+0000 7f0b31d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:29.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.194+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.196 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.197 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 20 zone default found 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 4 Realm: () 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 20 zonegroup default 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.195+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.196+0000 7f0b31d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.196+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.196+0000 7f0b31d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.196+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.196+0000 7f0b31d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.198 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.196+0000 7f0b31d26800 20 started sync module instance, tier type = 2023-12-03T11:34:29.199 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.196+0000 7f0b31d26800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:29.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.202+0000 7f0b2e124640 0 -- 172.21.15.131:0/2018260901 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f0b24034910 msgr2=0x7f0b2402f3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:29.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.204+0000 7f0b31d26800 20 add_watcher() i=0 2023-12-03T11:34:29.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.204+0000 7f0b31d26800 20 add_watcher() i=1 2023-12-03T11:34:29.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.204+0000 7f0b31d26800 20 add_watcher() i=2 2023-12-03T11:34:29.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.204+0000 7f0b31d26800 20 add_watcher() i=3 2023-12-03T11:34:29.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.204+0000 7f0b31d26800 20 add_watcher() i=4 2023-12-03T11:34:29.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.204+0000 7f0b31d26800 20 add_watcher() i=5 2023-12-03T11:34:29.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.204+0000 7f0b31d26800 20 add_watcher() i=6 2023-12-03T11:34:29.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.205+0000 7f0b31d26800 20 add_watcher() i=7 2023-12-03T11:34:29.207 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.205+0000 7f0b31d26800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:29.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.207+0000 7f0af37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:29.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.207+0000 7f0b31d26800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:29.208 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.207+0000 7f0b31d26800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:29.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.213+0000 7f0b31d26800 5 note: GC not initialized 2023-12-03T11:34:29.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.213+0000 7f0a627fc640 20 reqs_thread_entry: start 2023-12-03T11:34:29.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.213+0000 7f0b31d26800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:29.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.213+0000 7f0b31d26800 20 Filter name: none 2023-12-03T11:34:29.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.213+0000 7f0a53fff640 20 reqs_thread_entry: start 2023-12-03T11:34:29.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.213+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.214+0000 7f0b31d26800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:29.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.214+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.215+0000 7f0b31d26800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:29.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.215+0000 7f0b31d26800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:29.216 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.215+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.215+0000 7f0b31d26800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:29.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.215+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.215+0000 7f0b31d26800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:29.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.215+0000 7f0b31d26800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:29.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.216+0000 7f0b31d26800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.216+0000 7f0b31d26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.217+0000 7f0af37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:29.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.219+0000 7f0b31d26800 20 remove_watcher() i=0 2023-12-03T11:34:29.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.219+0000 7f0b31d26800 2 removed watcher, disabling cache 2023-12-03T11:34:29.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.220+0000 7f0b31d26800 20 remove_watcher() i=1 2023-12-03T11:34:29.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.221+0000 7f0b31d26800 20 remove_watcher() i=2 2023-12-03T11:34:29.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.222+0000 7f0b31d26800 20 remove_watcher() i=3 2023-12-03T11:34:29.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.223+0000 7f0b31d26800 20 remove_watcher() i=4 2023-12-03T11:34:29.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.223+0000 7f0b31d26800 20 remove_watcher() i=5 2023-12-03T11:34:29.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.224+0000 7f0b31d26800 20 remove_watcher() i=6 2023-12-03T11:34:29.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.225+0000 7f0b31d26800 20 remove_watcher() i=7 2023-12-03T11:34:29.231 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:29.231 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:34:29.231 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-block-writes id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:34:29.231 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:29.232 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2023-12-03T11:34:29.265 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:29.265 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:29.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.277+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.279+0000 7f567a923800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.279+0000 7f567a923800 20 realm 2023-12-03T11:34:29.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.279+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.279+0000 7f567a923800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.279+0000 7f567a923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:29.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.279+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.279+0000 7f567a923800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.279+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.281 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.280+0000 7f567a923800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.280+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.280+0000 7f567a923800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:29.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.280+0000 7f567a923800 20 searching for the correct realm 2023-12-03T11:34:29.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.289+0000 7f5676543640 0 -- 172.21.15.131:0/1863751909 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55dcc820cea0 msgr2=0x55dcc820f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:29.292 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.291+0000 7f567a923800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:29.292 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.291+0000 7f567a923800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:29.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.291+0000 7f567a923800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:29.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.291+0000 7f567a923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:29.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.291+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.291+0000 7f567a923800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.291+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.291+0000 7f567a923800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.291+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:29.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 20 zone default found 2023-12-03T11:34:29.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 4 Realm: () 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 20 zonegroup default 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 20 started sync module instance, tier type = 2023-12-03T11:34:29.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.292+0000 7f567a923800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:29.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.298+0000 7f5676543640 0 -- 172.21.15.131:0/1863751909 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f5670015420 msgr2=0x7f5670015860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:29.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.301+0000 7f567a923800 20 add_watcher() i=0 2023-12-03T11:34:29.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.301+0000 7f567a923800 20 add_watcher() i=1 2023-12-03T11:34:29.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.301+0000 7f567a923800 20 add_watcher() i=2 2023-12-03T11:34:29.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.301+0000 7f567a923800 20 add_watcher() i=3 2023-12-03T11:34:29.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.301+0000 7f567a923800 20 add_watcher() i=4 2023-12-03T11:34:29.302 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.301+0000 7f567a923800 20 add_watcher() i=5 2023-12-03T11:34:29.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.301+0000 7f567a923800 20 add_watcher() i=6 2023-12-03T11:34:29.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.302+0000 7f567a923800 20 add_watcher() i=7 2023-12-03T11:34:29.303 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.302+0000 7f567a923800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:29.304 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.303+0000 7f563bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:29.305 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.304+0000 7f567a923800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:29.305 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.304+0000 7f567a923800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:29.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.309+0000 7f567a923800 5 note: GC not initialized 2023-12-03T11:34:29.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.309+0000 7f55aaffd640 20 reqs_thread_entry: start 2023-12-03T11:34:29.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.310+0000 7f567a923800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:29.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.310+0000 7f567a923800 20 Filter name: none 2023-12-03T11:34:29.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.310+0000 7f55a8ff9640 20 reqs_thread_entry: start 2023-12-03T11:34:29.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.310+0000 7f567a923800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2023-12-03T11:34:29.311 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.310+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.312 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.310+0000 7f567a923800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:29.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.310+0000 7f567a923800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2023-12-03T11:34:29.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.310+0000 7f567a923800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2023-12-03T11:34:29.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.310+0000 7f567a923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 : miss 2023-12-03T11:34:29.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.310+0000 7f567a923800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.311+0000 7f567a923800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:29.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.311+0000 7f567a923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 info.flags=0x17 2023-12-03T11:34:29.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.311+0000 7f567a923800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 to cache LRU end 2023-12-03T11:34:29.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.311+0000 7f567a923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:34:29.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.311+0000 7f567a923800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:29.313 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.311+0000 7f567a923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 2023-12-03T11:34:29.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.315+0000 7f567a923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 info.flags=0x17 2023-12-03T11:34:29.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.315+0000 7f567a923800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 to cache LRU end 2023-12-03T11:34:29.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.315+0000 7f567a923800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:29.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.315+0000 7f567a923800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21, ofs0, ns] 2023-12-03T11:34:29.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.316+0000 7f566cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791357 cookie 94406738802928 notifier 6633 bl.length()=877 2023-12-03T11:34:29.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.316+0000 7f566cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 info.flags=0x17 2023-12-03T11:34:29.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.316+0000 7f566cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 to cache LRU end 2023-12-03T11:34:29.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.316+0000 7f566cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:29.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.316+0000 7f567a923800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): orig_sources= new_sources= 2023-12-03T11:34:29.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.316+0000 7f567a923800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): potential sources added=[] removed=[] 2023-12-03T11:34:29.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.316+0000 7f567a923800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): orig_dests= new_dests= 2023-12-03T11:34:29.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.316+0000 7f567a923800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): potential dests added=[] removed=[] 2023-12-03T11:34:29.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.316+0000 7f567a923800 -1 Injecting error=-5 at location=block_writes 2023-12-03T11:34:29.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.316+0000 7f567a923800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2023-12-03T11:34:29.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.318+0000 7f567a923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 : hit (requested=0x17, cached=0x17) 2023-12-03T11:34:29.319 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.318+0000 7f567a923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 2023-12-03T11:34:29.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.319+0000 7f567a923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 info.flags=0x17 2023-12-03T11:34:29.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.319+0000 7f567a923800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 to cache LRU end 2023-12-03T11:34:29.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.319+0000 7f567a923800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:29.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.319+0000 7f567a923800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21, ofs0, ns] 2023-12-03T11:34:29.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.319+0000 7f566cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791358 cookie 94406738802928 notifier 6633 bl.length()=845 2023-12-03T11:34:29.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.319+0000 7f566cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 info.flags=0x17 2023-12-03T11:34:29.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.319+0000 7f566cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 to cache LRU end 2023-12-03T11:34:29.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.319+0000 7f566cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:29.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.320+0000 7f567a923800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): orig_sources= new_sources= 2023-12-03T11:34:29.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.320+0000 7f567a923800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): potential sources added=[] removed=[] 2023-12-03T11:34:29.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.320+0000 7f567a923800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): orig_dests= new_dests= 2023-12-03T11:34:29.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.320+0000 7f567a923800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): potential dests added=[] removed=[] 2023-12-03T11:34:29.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.321+0000 7f563bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:29.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.323+0000 7f567a923800 20 remove_watcher() i=0 2023-12-03T11:34:29.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.323+0000 7f567a923800 2 removed watcher, disabling cache 2023-12-03T11:34:29.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.324+0000 7f567a923800 20 remove_watcher() i=1 2023-12-03T11:34:29.326 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.325+0000 7f567a923800 20 remove_watcher() i=2 2023-12-03T11:34:29.327 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.326+0000 7f567a923800 20 remove_watcher() i=3 2023-12-03T11:34:29.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.327+0000 7f567a923800 20 remove_watcher() i=4 2023-12-03T11:34:29.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.328+0000 7f567a923800 20 remove_watcher() i=5 2023-12-03T11:34:29.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.329+0000 7f567a923800 20 remove_watcher() i=6 2023-12-03T11:34:29.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.330+0000 7f567a923800 20 remove_watcher() i=7 2023-12-03T11:34:29.337 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-12-03T11:34:29.364 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:29.364 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:29.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.376+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.379 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.378+0000 7f1d5e926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.378+0000 7f1d5e926800 20 realm 2023-12-03T11:34:29.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.378+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.378+0000 7f1d5e926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.378+0000 7f1d5e926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:29.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.378+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.378+0000 7f1d5e926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.378+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.379+0000 7f1d5e926800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.379+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.379+0000 7f1d5e926800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:29.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.379+0000 7f1d5e926800 20 searching for the correct realm 2023-12-03T11:34:29.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.389+0000 7f1d5a523640 0 -- 172.21.15.131:0/1920045779 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55c543fb0010 msgr2=0x55c543fb2400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:34:29.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.390+0000 7f1d5e926800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:29.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.390+0000 7f1d5e926800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:29.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.390+0000 7f1d5e926800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:29.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.390+0000 7f1d5e926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:29.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.390+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.390+0000 7f1d5e926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.390+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:29.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 20 zone default found 2023-12-03T11:34:29.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 4 Realm: () 2023-12-03T11:34:29.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:29.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:29.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:29.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 20 zonegroup default 2023-12-03T11:34:29.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.391+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.392+0000 7f1d5e926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.392+0000 7f1d5e926800 20 started sync module instance, tier type = 2023-12-03T11:34:29.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.392+0000 7f1d5e926800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:29.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.399+0000 7f1d59d22640 0 -- 172.21.15.131:0/1920045779 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55c543fb4fa0 msgr2=0x55c543fb7390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:29.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.400+0000 7f1d5e926800 20 add_watcher() i=0 2023-12-03T11:34:29.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.400+0000 7f1d5e926800 20 add_watcher() i=1 2023-12-03T11:34:29.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.400+0000 7f1d5e926800 20 add_watcher() i=2 2023-12-03T11:34:29.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.400+0000 7f1d5e926800 20 add_watcher() i=3 2023-12-03T11:34:29.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.400+0000 7f1d5e926800 20 add_watcher() i=4 2023-12-03T11:34:29.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.400+0000 7f1d5e926800 20 add_watcher() i=5 2023-12-03T11:34:29.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.400+0000 7f1d5e926800 20 add_watcher() i=6 2023-12-03T11:34:29.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.401+0000 7f1d5e926800 20 add_watcher() i=7 2023-12-03T11:34:29.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.401+0000 7f1d5e926800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:29.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.403+0000 7f1d1ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:29.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.403+0000 7f1d5e926800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:29.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.403+0000 7f1d5e926800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:29.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.409+0000 7f1d5e926800 5 note: GC not initialized 2023-12-03T11:34:29.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.409+0000 7f1c8effd640 20 reqs_thread_entry: start 2023-12-03T11:34:29.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.409+0000 7f1d5e926800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:29.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.409+0000 7f1d5e926800 20 Filter name: none 2023-12-03T11:34:29.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.409+0000 7f1c8cff9640 20 reqs_thread_entry: start 2023-12-03T11:34:29.411 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.409+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.410+0000 7f1d5e926800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:29.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.410+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.410+0000 7f1d5e926800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:29.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.410+0000 7f1d5e926800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:29.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.410+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.411+0000 7f1d5e926800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:29.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.411+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.411+0000 7f1d5e926800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:29.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.411+0000 7f1d5e926800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:29.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.412+0000 7f1d5e926800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.413 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.412+0000 7f1d5e926800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.413+0000 7f1d1ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:29.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.415+0000 7f1d5e926800 20 remove_watcher() i=0 2023-12-03T11:34:29.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.415+0000 7f1d5e926800 2 removed watcher, disabling cache 2023-12-03T11:34:29.417 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.416+0000 7f1d5e926800 20 remove_watcher() i=1 2023-12-03T11:34:29.418 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.417+0000 7f1d5e926800 20 remove_watcher() i=2 2023-12-03T11:34:29.419 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.418+0000 7f1d5e926800 20 remove_watcher() i=3 2023-12-03T11:34:29.420 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.419+0000 7f1d5e926800 20 remove_watcher() i=4 2023-12-03T11:34:29.421 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.420+0000 7f1d5e926800 20 remove_watcher() i=5 2023-12-03T11:34:29.422 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.421+0000 7f1d5e926800 20 remove_watcher() i=6 2023-12-03T11:34:29.423 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.422+0000 7f1d5e926800 20 remove_watcher() i=7 2023-12-03T11:34:29.427 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:29.427 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:34:29.428 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-block-writes id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:34:29.428 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:29.478 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:34:29.510 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:29.510 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:29.523 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.522+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.525 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.524+0000 7f39aab3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.525 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.524+0000 7f39aab3b800 20 realm 2023-12-03T11:34:29.525 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.524+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.524+0000 7f39aab3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.524+0000 7f39aab3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:29.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.524+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.524+0000 7f39aab3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.526 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.524+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.525+0000 7f39aab3b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.525+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.525+0000 7f39aab3b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:29.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.525+0000 7f39aab3b800 20 searching for the correct realm 2023-12-03T11:34:29.536 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.535+0000 7f39a6840640 0 -- 172.21.15.131:0/3817180436 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55e60877c600 msgr2=0x55e60877e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:29.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.536+0000 7f39aab3b800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:29.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.536+0000 7f39aab3b800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:29.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.536+0000 7f39aab3b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:29.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.536+0000 7f39aab3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:29.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.536+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.536+0000 7f39aab3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.536+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.536+0000 7f39aab3b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.536+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.539 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:29.539 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 20 zone default found 2023-12-03T11:34:29.539 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 4 Realm: () 2023-12-03T11:34:29.539 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:29.539 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:29.539 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:29.539 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 20 zonegroup default 2023-12-03T11:34:29.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 20 started sync module instance, tier type = 2023-12-03T11:34:29.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.537+0000 7f39aab3b800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:29.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.544+0000 7f39a7041640 0 -- 172.21.15.131:0/3817180436 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f399c05f040 msgr2=0x7f399c07b910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:29.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.546+0000 7f39aab3b800 20 add_watcher() i=0 2023-12-03T11:34:29.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.546+0000 7f39aab3b800 20 add_watcher() i=1 2023-12-03T11:34:29.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.546+0000 7f39aab3b800 20 add_watcher() i=2 2023-12-03T11:34:29.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.546+0000 7f39aab3b800 20 add_watcher() i=3 2023-12-03T11:34:29.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.546+0000 7f39aab3b800 20 add_watcher() i=4 2023-12-03T11:34:29.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.546+0000 7f39aab3b800 20 add_watcher() i=5 2023-12-03T11:34:29.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.546+0000 7f39aab3b800 20 add_watcher() i=6 2023-12-03T11:34:29.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.547+0000 7f39aab3b800 20 add_watcher() i=7 2023-12-03T11:34:29.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.547+0000 7f39aab3b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:29.549 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.548+0000 7f38e7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:29.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.548+0000 7f39aab3b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:29.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.548+0000 7f39aab3b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:29.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.554+0000 7f39aab3b800 5 note: GC not initialized 2023-12-03T11:34:29.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.554+0000 7f38d6ffd640 20 reqs_thread_entry: start 2023-12-03T11:34:29.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.554+0000 7f39aab3b800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:29.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.554+0000 7f39aab3b800 20 Filter name: none 2023-12-03T11:34:29.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.555+0000 7f38d4ff9640 20 reqs_thread_entry: start 2023-12-03T11:34:29.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.555+0000 7f39aab3b800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2023-12-03T11:34:29.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.555+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.555+0000 7f39aab3b800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:29.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.555+0000 7f39aab3b800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2023-12-03T11:34:29.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.555+0000 7f39aab3b800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2023-12-03T11:34:29.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.555+0000 7f39aab3b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 : miss 2023-12-03T11:34:29.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.555+0000 7f39aab3b800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.556+0000 7f39aab3b800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:29.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.556+0000 7f39aab3b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 info.flags=0x17 2023-12-03T11:34:29.557 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.556+0000 7f39aab3b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 to cache LRU end 2023-12-03T11:34:29.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.556+0000 7f39aab3b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:34:29.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.556+0000 7f39aab3b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:29.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.556+0000 7f39aab3b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 2023-12-03T11:34:29.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.559+0000 7f39aab3b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 info.flags=0x17 2023-12-03T11:34:29.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.559+0000 7f39aab3b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 to cache LRU end 2023-12-03T11:34:29.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.559+0000 7f39aab3b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:29.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.559+0000 7f39aab3b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21, ofs0, ns] 2023-12-03T11:34:29.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.560+0000 7f398d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791359 cookie 94446472950576 notifier 6362 bl.length()=877 2023-12-03T11:34:29.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.560+0000 7f398d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 info.flags=0x17 2023-12-03T11:34:29.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.560+0000 7f398d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 to cache LRU end 2023-12-03T11:34:29.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.560+0000 7f398d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:29.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.560+0000 7f39aab3b800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): orig_sources= new_sources= 2023-12-03T11:34:29.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.560+0000 7f39aab3b800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): potential sources added=[] removed=[] 2023-12-03T11:34:29.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.560+0000 7f39aab3b800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): orig_dests= new_dests= 2023-12-03T11:34:29.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.560+0000 7f39aab3b800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): potential dests added=[] removed=[] 2023-12-03T11:34:29.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.561+0000 7f39aab3b800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21.1.0 2023-12-03T11:34:29.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.561+0000 7f39aab3b800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21.1.0 2023-12-03T11:34:29.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.561+0000 7f39aab3b800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21.1.1 2023-12-03T11:34:29.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.561+0000 7f39aab3b800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21.1.1 2023-12-03T11:34:29.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.561+0000 7f39aab3b800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21.0 2023-12-03T11:34:29.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.564+0000 7f39aab3b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 : hit (requested=0x17, cached=0x17) 2023-12-03T11:34:29.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.564+0000 7f39aab3b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 2023-12-03T11:34:29.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.565+0000 7f39aab3b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 info.flags=0x17 2023-12-03T11:34:29.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.565+0000 7f39aab3b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 to cache LRU end 2023-12-03T11:34:29.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.565+0000 7f39aab3b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:29.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.565+0000 7f39aab3b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21, ofs0, ns] 2023-12-03T11:34:29.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.565+0000 7f398d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791360 cookie 94446472950576 notifier 6362 bl.length()=845 2023-12-03T11:34:29.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.565+0000 7f398d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 info.flags=0x17 2023-12-03T11:34:29.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.565+0000 7f398d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 to cache LRU end 2023-12-03T11:34:29.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.565+0000 7f398d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:29.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.566+0000 7f39aab3b800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): orig_sources= new_sources= 2023-12-03T11:34:29.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.566+0000 7f39aab3b800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): potential sources added=[] removed=[] 2023-12-03T11:34:29.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.566+0000 7f39aab3b800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): orig_dests= new_dests= 2023-12-03T11:34:29.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.566+0000 7f39aab3b800 20 handle_bi_update(): bucket=:error-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21]): potential dests added=[] removed=[] 2023-12-03T11:34:29.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.567+0000 7f39aab3b800 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2023-12-03T11:34:29.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.568+0000 7f38e7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:29.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.570+0000 7f39aab3b800 20 remove_watcher() i=0 2023-12-03T11:34:29.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.570+0000 7f39aab3b800 2 removed watcher, disabling cache 2023-12-03T11:34:29.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.571+0000 7f39aab3b800 20 remove_watcher() i=1 2023-12-03T11:34:29.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.572+0000 7f39aab3b800 20 remove_watcher() i=2 2023-12-03T11:34:29.574 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.573+0000 7f39aab3b800 20 remove_watcher() i=3 2023-12-03T11:34:29.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.574+0000 7f39aab3b800 20 remove_watcher() i=4 2023-12-03T11:34:29.576 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.575+0000 7f39aab3b800 20 remove_watcher() i=5 2023-12-03T11:34:29.578 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.576+0000 7f39aab3b800 20 remove_watcher() i=6 2023-12-03T11:34:29.578 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.577+0000 7f39aab3b800 20 remove_watcher() i=7 2023-12-03T11:34:29.584 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2023-12-03T11:34:29.612 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:29.612 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:29.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.624+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.626+0000 7ff5d711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.626+0000 7ff5d711f800 20 realm 2023-12-03T11:34:29.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.626+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.626+0000 7ff5d711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.626+0000 7ff5d711f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:29.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.626+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.626+0000 7ff5d711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.626+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.627+0000 7ff5d711f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.627+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.627+0000 7ff5d711f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:29.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.627+0000 7ff5d711f800 20 searching for the correct realm 2023-12-03T11:34:29.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.636+0000 7ff5d2d95640 0 -- 172.21.15.131:0/2201139496 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7ff5cc02a060 msgr2=0x7ff5cc088930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:29.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.637+0000 7ff5d711f800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:29.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.637+0000 7ff5d711f800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:29.639 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.637+0000 7ff5d711f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.637+0000 7ff5d711f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.637+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.637+0000 7ff5d711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.637+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.637+0000 7ff5d711f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.637+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 20 zone default found 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 4 Realm: () 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 20 zonegroup default 2023-12-03T11:34:29.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.638+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.639+0000 7ff5d711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.639+0000 7ff5d711f800 20 started sync module instance, tier type = 2023-12-03T11:34:29.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.639+0000 7ff5d711f800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:29.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.644+0000 7ff5d3596640 0 -- 172.21.15.131:0/2201139496 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7ff5bc098c30 msgr2=0x7ff5bc09d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:29.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.647+0000 7ff5d711f800 20 add_watcher() i=0 2023-12-03T11:34:29.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.647+0000 7ff5d711f800 20 add_watcher() i=1 2023-12-03T11:34:29.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.647+0000 7ff5d711f800 20 add_watcher() i=2 2023-12-03T11:34:29.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.647+0000 7ff5d711f800 20 add_watcher() i=3 2023-12-03T11:34:29.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.647+0000 7ff5d711f800 20 add_watcher() i=4 2023-12-03T11:34:29.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.647+0000 7ff5d711f800 20 add_watcher() i=5 2023-12-03T11:34:29.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.647+0000 7ff5d711f800 20 add_watcher() i=6 2023-12-03T11:34:29.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.648+0000 7ff5d711f800 20 add_watcher() i=7 2023-12-03T11:34:29.650 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.648+0000 7ff5d711f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:29.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.650+0000 7ff513fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:29.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.650+0000 7ff5d711f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:29.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.650+0000 7ff5d711f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:29.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.656+0000 7ff5d711f800 5 note: GC not initialized 2023-12-03T11:34:29.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.656+0000 7ff502ffd640 20 reqs_thread_entry: start 2023-12-03T11:34:29.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.656+0000 7ff5d711f800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:29.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.656+0000 7ff5d711f800 20 Filter name: none 2023-12-03T11:34:29.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.656+0000 7ff500ff9640 20 reqs_thread_entry: start 2023-12-03T11:34:29.658 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.656+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.657+0000 7ff5d711f800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:29.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.657+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.657+0000 7ff5d711f800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:29.659 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.657+0000 7ff5d711f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:29.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.657+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.658+0000 7ff5d711f800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:29.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.658+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.658+0000 7ff5d711f800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:29.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.658+0000 7ff5d711f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:29.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.659+0000 7ff5d711f800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.660 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.659+0000 7ff5d711f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.661 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.660+0000 7ff513fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:29.663 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.662+0000 7ff5d711f800 20 remove_watcher() i=0 2023-12-03T11:34:29.663 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.662+0000 7ff5d711f800 2 removed watcher, disabling cache 2023-12-03T11:34:29.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.663+0000 7ff5d711f800 20 remove_watcher() i=1 2023-12-03T11:34:29.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.664+0000 7ff5d711f800 20 remove_watcher() i=2 2023-12-03T11:34:29.666 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.665+0000 7ff5d711f800 20 remove_watcher() i=3 2023-12-03T11:34:29.667 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.666+0000 7ff5d711f800 20 remove_watcher() i=4 2023-12-03T11:34:29.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.667+0000 7ff5d711f800 20 remove_watcher() i=5 2023-12-03T11:34:29.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.668+0000 7ff5d711f800 20 remove_watcher() i=6 2023-12-03T11:34:29.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.669+0000 7ff5d711f800 20 remove_watcher() i=7 2023-12-03T11:34:29.678 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:29.678 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:34:29.678 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-block-writes id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.21 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:34:29.678 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:29.750 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard bucket with abort at block_writes 2023-12-03T11:34:29.751 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:29.925 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-12-03T11:34:29.952 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:29.952 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:29.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.965+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.966+0000 7f92e68c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.966+0000 7f92e68c0800 20 realm 2023-12-03T11:34:29.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.966+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.967+0000 7f92e68c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.967+0000 7f92e68c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:29.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.967+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.967+0000 7f92e68c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.967+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.968+0000 7f92e68c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.968+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.968+0000 7f92e68c0800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:29.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.968+0000 7f92e68c0800 20 searching for the correct realm 2023-12-03T11:34:29.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.977+0000 7f92e43c0640 0 -- 172.21.15.131:0/4180703885 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5606cf6d7520 msgr2=0x5606cf6d9910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:34:29.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.978+0000 7f92e68c0800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:29.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.978+0000 7f92e68c0800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:29.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.978+0000 7f92e68c0800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:29.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.978+0000 7f92e68c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:29.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.978+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.978+0000 7f92e68c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.978+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:29.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:29.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 20 zone default found 2023-12-03T11:34:29.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 4 Realm: () 2023-12-03T11:34:29.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:29.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:29.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:29.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 20 zonegroup default 2023-12-03T11:34:29.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.979+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.980+0000 7f92e68c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:29.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.980+0000 7f92e68c0800 20 started sync module instance, tier type = 2023-12-03T11:34:29.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.980+0000 7f92e68c0800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:29.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.986+0000 7f92e4bc1640 0 -- 172.21.15.131:0/4180703885 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f92d805f960 msgr2=0x7f92d8087430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:29.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.988+0000 7f92e68c0800 20 add_watcher() i=0 2023-12-03T11:34:29.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.988+0000 7f92e68c0800 20 add_watcher() i=1 2023-12-03T11:34:29.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.988+0000 7f92e68c0800 20 add_watcher() i=2 2023-12-03T11:34:29.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.988+0000 7f92e68c0800 20 add_watcher() i=3 2023-12-03T11:34:29.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.988+0000 7f92e68c0800 20 add_watcher() i=4 2023-12-03T11:34:29.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.988+0000 7f92e68c0800 20 add_watcher() i=5 2023-12-03T11:34:29.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.988+0000 7f92e68c0800 20 add_watcher() i=6 2023-12-03T11:34:29.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.989+0000 7f92e68c0800 20 add_watcher() i=7 2023-12-03T11:34:29.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.989+0000 7f92e68c0800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:29.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.990+0000 7f92aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:29.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.991+0000 7f92e68c0800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:29.992 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.991+0000 7f92e68c0800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:29.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.996+0000 7f92e68c0800 5 note: GC not initialized 2023-12-03T11:34:29.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.997+0000 7f92197fa640 20 reqs_thread_entry: start 2023-12-03T11:34:29.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.997+0000 7f92e68c0800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:29.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.997+0000 7f92e68c0800 20 Filter name: none 2023-12-03T11:34:29.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.997+0000 7f9212ffd640 20 reqs_thread_entry: start 2023-12-03T11:34:29.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.997+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:29.999 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.997+0000 7f92e68c0800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:29.999 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.997+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.998+0000 7f92e68c0800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:30.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.998+0000 7f92e68c0800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:30.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.998+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.998+0000 7f92e68c0800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:30.000 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.998+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.999+0000 7f92e68c0800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:30.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.999+0000 7f92e68c0800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:30.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.999+0000 7f92e68c0800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:29.999+0000 7f92e68c0800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.000+0000 7f92aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:30.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.002+0000 7f92e68c0800 20 remove_watcher() i=0 2023-12-03T11:34:30.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.002+0000 7f92e68c0800 2 removed watcher, disabling cache 2023-12-03T11:34:30.004 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.003+0000 7f92e68c0800 20 remove_watcher() i=1 2023-12-03T11:34:30.005 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.004+0000 7f92e68c0800 20 remove_watcher() i=2 2023-12-03T11:34:30.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.005+0000 7f92e68c0800 20 remove_watcher() i=3 2023-12-03T11:34:30.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.006+0000 7f92e68c0800 20 remove_watcher() i=4 2023-12-03T11:34:30.008 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.007+0000 7f92e68c0800 20 remove_watcher() i=5 2023-12-03T11:34:30.009 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.008+0000 7f92e68c0800 20 remove_watcher() i=6 2023-12-03T11:34:30.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.009+0000 7f92e68c0800 20 remove_watcher() i=7 2023-12-03T11:34:30.015 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.015 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:34:30.015 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-block-writes id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:34:30.015 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.016 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2023-12-03T11:34:30.048 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:30.048 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:30.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.061+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.062+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.062+0000 7f8b0bf1e800 20 realm 2023-12-03T11:34:30.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.062+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.063+0000 7f8b0bf1e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:30.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:30.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:30.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 searching for the correct realm 2023-12-03T11:34:30.073 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.072+0000 7f8b0a226640 0 -- 172.21.15.131:0/221833288 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55c48fd29f70 msgr2=0x55c48fd2c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:30.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:30.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:30.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:30.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 zone default found 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 4 Realm: () 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 zonegroup default 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 started sync module instance, tier type = 2023-12-03T11:34:30.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:30.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.079+0000 7f8b0a226640 0 -- 172.21.15.131:0/221833288 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7f8af409a1a0 msgr2=0x7f8af40c98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.085+0000 7f8b0bf1e800 20 add_watcher() i=0 2023-12-03T11:34:30.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.085+0000 7f8b0bf1e800 20 add_watcher() i=1 2023-12-03T11:34:30.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=2 2023-12-03T11:34:30.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=3 2023-12-03T11:34:30.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=4 2023-12-03T11:34:30.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=5 2023-12-03T11:34:30.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=6 2023-12-03T11:34:30.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=7 2023-12-03T11:34:30.283 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.281+0000 7f8b0bf1e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:30.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.283+0000 7f8acf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:30.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.283+0000 7f8b0bf1e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:30.284 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.283+0000 7f8b0bf1e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:30.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.488+0000 7f8b09a25640 0 --2- 172.21.15.131:0/580534104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c48fd710e0 0x55c48fd7a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-03T11:34:30.494 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.490+0000 7f8b0bf1e800 5 note: GC not initialized 2023-12-03T11:34:30.494 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.491+0000 7f8a3e7fc640 20 reqs_thread_entry: start 2023-12-03T11:34:30.494 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 Filter name: none 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.491+0000 7f8a2ffff640 20 reqs_thread_entry: start 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 : miss 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.492+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:34:30.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:34:30.496 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:30.496 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 2023-12-03T11:34:30.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:34:30.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:34:30.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:30.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22, ofs0, ns] 2023-12-03T11:34:30.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791324 cookie 94302714950208 notifier 6419 bl.length()=877 2023-12-03T11:34:30.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:34:30.499 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:34:30.499 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:30.499 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): orig_sources= new_sources= 2023-12-03T11:34:30.499 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): potential sources added=[] removed=[] 2023-12-03T11:34:30.499 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): orig_dests= new_dests= 2023-12-03T11:34:30.499 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): potential dests added=[] removed=[] 2023-12-03T11:34:30.499 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8b0bf1e800 time 2023-12-03T11:34:30.498501+0000 2023-12-03T11:34:30.499 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:34:30.512 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8b1096eef8] 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8b1096f0b6] 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c48e5d4a71] 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55c48e5e0ec4] 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f8b0e23feb0] 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.498+0000 7f8b0bf1e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8b0bf1e800 time 2023-12-03T11:34:30.498501+0000 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8b1096eef8] 2023-12-03T11:34:30.513 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8b1096f0b6] 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c48e5d4a71] 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55c48e5e0ec4] 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f8b0e23feb0] 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f8b0bf1e800 thread_name:radosgw-admin 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8b0e254db0] 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8b0e2a154c] 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:34:30.514 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8b1096ef52] 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8b1096f0b6] 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c48e5d4a71] 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55c48e5e0ec4] 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f8b0e23feb0] 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.498+0000 7f8b0bf1e800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f8b0bf1e800 thread_name:radosgw-admin 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8b0e254db0] 2023-12-03T11:34:30.515 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8b0e2a154c] 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8b1096ef52] 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8b1096f0b6] 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c48e5d4a71] 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55c48e5e0ec4] 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f8b0e23feb0] 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr:--- begin dump of recent events --- 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: -499> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd470) adding con mode: secure 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: -498> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd470) adding con mode: crc 2023-12-03T11:34:30.516 INFO:tasks.workunit.client.0.smithi131.stderr: -497> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd470) adding con mode: secure 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -496> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -495> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 10 monclient: init 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -494> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding auth protocol: cephx 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -493> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding auth protocol: cephx 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -492> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding auth protocol: cephx 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -491> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -490> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -489> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -488> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -487> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -486> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -485> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.517 INFO:tasks.workunit.client.0.smithi131.stderr: -484> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -483> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -482> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -481> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -480> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -479> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -478> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -477> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command rotate-key cmddesc rotate-key hook 0x7ffdf4f0d518 EEXIST 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -476> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient: _reopen_session rank -1 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -475> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -474> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-c con 0x55c48fd0d700 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -473> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-a con 0x55c48fd0dae0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -472> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-b con 0x55c48fce1be0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -471> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.518 INFO:tasks.workunit.client.0.smithi131.stderr: -470> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -469> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -468> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): _renew_subs 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -467> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): authenticate will time out at 1561.435827s 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -466> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): get_auth_request con 0x55c48fd0d700 auth_method 0 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -465> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -464> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -463> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -462> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): get_auth_request con 0x55c48fd0dae0 auth_method 0 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -461> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -460> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -459> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -458> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): get_auth_request con 0x55c48fce1be0 auth_method 0 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -457> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -456> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.519 INFO:tasks.workunit.client.0.smithi131.stderr: -455> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -454> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -453> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -452> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -451> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -450> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -449> 2023-12-03T11:34:30.057+0000 7f8b037fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -448> 2023-12-03T11:34:30.057+0000 7f8b037fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -447> 2023-12-03T11:34:30.057+0000 7f8b037fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -446> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -445> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -444> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -443> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -442> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): handle_auth_done global_id 6416 payload 274 2023-12-03T11:34:30.520 INFO:tasks.workunit.client.0.smithi131.stderr: -441> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient: _finish_hunting 0 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr: -440> 2023-12-03T11:34:30.057+0000 7f8b0a226640 1 monclient: found mon.noname-c 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr: -439> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr: -438> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient: get_auth_request con 0x7f8aec069850 auth_method 0 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr: -437> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr: -436> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr: -435> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: dump: 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.521 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr: -434> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: _finish_auth 0 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr: -433> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: _check_auth_tickets 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr: -432> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 monclient: authenticate success, global_id 6416 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr: -431> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr: -430> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr: -429> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr: -428> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: dump: 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.522 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr: -427> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 10 monclient: get_monmap_and_config success 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr: -426> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 4 set_mon_vals no callback set 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr: -425> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 10 monclient: shutdown 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr: -424> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 10 monclient: build_initial_monmap 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr: -423> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 1 build_initial for_mkfs: 0 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr: -422> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 10 monclient: monmap: 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:34:30.523 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr: -421> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding auth protocol: cephx 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr: -420> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding auth protocol: cephx 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr: -419> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding auth protocol: cephx 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr: -418> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr: -417> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr: -416> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr: -415> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.524 INFO:tasks.workunit.client.0.smithi131.stderr: -414> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -413> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -412> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -411> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -410> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -409> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -408> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -407> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -406> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -405> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 1 librados: starting msgr at 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -404> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 1 librados: starting objecter 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -403> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command objecter_requests cmddesc objecter_requests hook 0x55c48fce1bc0 EEXIST 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -402> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 1 librados: setting wanted keys 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -401> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 1 librados: calling monclient init 2023-12-03T11:34:30.525 INFO:tasks.workunit.client.0.smithi131.stderr: -400> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient: init 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -399> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding auth protocol: cephx 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -398> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding auth protocol: cephx 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -397> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding auth protocol: cephx 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -396> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -395> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -394> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -393> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -392> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -391> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -390> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -389> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -388> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -387> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.526 INFO:tasks.workunit.client.0.smithi131.stderr: -386> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -385> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -384> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -383> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -382> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command rotate-key cmddesc rotate-key hook 0x55c48fb682e0 EEXIST 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -381> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient: _reopen_session rank -1 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -380> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -379> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-b con 0x55c48fce1be0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -378> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-c con 0x55c48fd0d700 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -377> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-a con 0x55c48fcde580 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -376> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -375> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -374> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -373> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): _renew_subs 2023-12-03T11:34:30.527 INFO:tasks.workunit.client.0.smithi131.stderr: -372> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): authenticate will time out at 1561.438073s 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -371> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): get_auth_request con 0x55c48fd0d700 auth_method 0 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -370> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -369> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -368> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -367> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): get_auth_request con 0x55c48fcde580 auth_method 0 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -366> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -365> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -364> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -363> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -362> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -361> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -360> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -359> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -358> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -357> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): get_auth_request con 0x55c48fce1be0 auth_method 0 2023-12-03T11:34:30.528 INFO:tasks.workunit.client.0.smithi131.stderr: -356> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -355> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -354> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -353> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -352> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -351> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -350> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): handle_auth_done global_id 6419 payload 824 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -349> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient: _finish_hunting 0 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -348> 2023-12-03T11:34:30.059+0000 7f8b01224640 1 monclient: found mon.noname-c 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -347> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -346> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -345> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr: -344> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: dump: 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.529 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr: -343> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: _finish_auth 0 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr: -342> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: _check_auth_tickets 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr: -341> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr: -340> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr: -339> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:34:30.530 INFO:tasks.workunit.client.0.smithi131.stderr: -338> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: dump: 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr: -337> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 5 monclient: authenticate success, global_id 6419 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr: -336> 2023-12-03T11:34:30.060+0000 7f8aebfff640 4 set_mon_vals no callback set 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr: -335> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 10 monclient: _renew_subs 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr: -334> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.531 INFO:tasks.workunit.client.0.smithi131.stderr: -333> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 10 monclient: _renew_subs 2023-12-03T11:34:30.532 INFO:tasks.workunit.client.0.smithi131.stderr: -332> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.532 INFO:tasks.workunit.client.0.smithi131.stderr: -331> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 1 librados: init done 2023-12-03T11:34:30.532 INFO:tasks.workunit.client.0.smithi131.stderr: -330> 2023-12-03T11:34:30.061+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.532 INFO:tasks.workunit.client.0.smithi131.stderr: -329> 2023-12-03T11:34:30.062+0000 7f8aea7fc640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:34:30.532 INFO:tasks.workunit.client.0.smithi131.stderr: -328> 2023-12-03T11:34:30.062+0000 7f8aea7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.532 INFO:tasks.workunit.client.0.smithi131.stderr: -327> 2023-12-03T11:34:30.062+0000 7f8aea7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.532 INFO:tasks.workunit.client.0.smithi131.stderr: -326> 2023-12-03T11:34:30.062+0000 7f8b09a25640 10 monclient: get_auth_request con 0x7f8ae4069820 auth_method 0 2023-12-03T11:34:30.532 INFO:tasks.workunit.client.0.smithi131.stderr: -325> 2023-12-03T11:34:30.062+0000 7f8b0a226640 10 monclient: get_auth_request con 0x55c48fd29f70 auth_method 0 2023-12-03T11:34:30.532 INFO:tasks.workunit.client.0.smithi131.stderr: -324> 2023-12-03T11:34:30.062+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.532 INFO:tasks.workunit.client.0.smithi131.stderr: -323> 2023-12-03T11:34:30.062+0000 7f8b0bf1e800 20 realm 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -322> 2023-12-03T11:34:30.062+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -321> 2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -320> 2023-12-03T11:34:30.063+0000 7f8b0bf1e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -319> 2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -318> 2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -317> 2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -316> 2023-12-03T11:34:30.063+0000 7f8b09a25640 10 monclient: get_auth_request con 0x55c48fd2de80 auth_method 0 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -315> 2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -314> 2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -313> 2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -312> 2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 searching for the correct realm 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -311> 2023-12-03T11:34:30.064+0000 7f8b01224640 10 monclient: get_auth_request con 0x55c48fd32e60 auth_method 0 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -310> 2023-12-03T11:34:30.065+0000 7f8b0a226640 10 monclient: get_auth_request con 0x7f8af409a1a0 auth_method 0 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -309> 2023-12-03T11:34:30.065+0000 7f8b09a25640 10 monclient: get_auth_request con 0x7f8b04025980 auth_method 0 2023-12-03T11:34:30.533 INFO:tasks.workunit.client.0.smithi131.stderr: -308> 2023-12-03T11:34:30.066+0000 7f8b01224640 10 monclient: get_auth_request con 0x7f8afc060160 auth_method 0 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -307> 2023-12-03T11:34:30.068+0000 7f8b0a226640 10 monclient: get_auth_request con 0x7f8af40c7040 auth_method 0 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -306> 2023-12-03T11:34:30.070+0000 7f8b09a25640 10 monclient: get_auth_request con 0x7f8af4099430 auth_method 0 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -305> 2023-12-03T11:34:30.072+0000 7f8b0a226640 0 -- 172.21.15.131:0/221833288 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55c48fd29f70 msgr2=0x55c48fd2c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -304> 2023-12-03T11:34:30.072+0000 7f8aea7fc640 1 client.6419.objecter ms_handle_reset 0x55c48fd29f70 session 0x55c48fafa3a0 osd.1 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -303> 2023-12-03T11:34:30.072+0000 7f8aea7fc640 10 monclient: _renew_subs 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -302> 2023-12-03T11:34:30.072+0000 7f8aea7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -301> 2023-12-03T11:34:30.072+0000 7f8b0a226640 10 monclient: get_auth_request con 0x7f8ae4079640 auth_method 0 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -300> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -299> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -298> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -297> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -296> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -295> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.534 INFO:tasks.workunit.client.0.smithi131.stderr: -294> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -293> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -292> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -291> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -290> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 zone default found 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -289> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 4 Realm: () 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -288> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -287> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -286> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -285> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 zonegroup default 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -284> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -283> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -282> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -281> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -280> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -279> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.535 INFO:tasks.workunit.client.0.smithi131.stderr: -278> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 started sync module instance, tier type = 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -277> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -276> 2023-12-03T11:34:30.079+0000 7f8b0a226640 0 -- 172.21.15.131:0/221833288 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7f8af409a1a0 msgr2=0x7f8af40c98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -275> 2023-12-03T11:34:30.079+0000 7f8aea7fc640 1 client.6419.objecter ms_handle_reset 0x7f8af409a1a0 session 0x7f8af409e060 osd.7 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -274> 2023-12-03T11:34:30.079+0000 7f8b0a226640 10 monclient: get_auth_request con 0x55c48fd29f70 auth_method 0 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -273> 2023-12-03T11:34:30.085+0000 7f8b0bf1e800 20 add_watcher() i=0 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -272> 2023-12-03T11:34:30.085+0000 7f8b0bf1e800 20 add_watcher() i=1 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -271> 2023-12-03T11:34:30.280+0000 7f8b0a226640 10 monclient: get_auth_request con 0x55c48fd29f70 auth_method 0 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -270> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=2 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -269> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=3 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -268> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=4 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -267> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=5 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -266> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=6 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -265> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=7 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -264> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:30.536 INFO:tasks.workunit.client.0.smithi131.stderr: -263> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding auth protocol: cephx 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -262> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding auth protocol: cephx 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -261> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding auth protocol: cephx 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -260> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -259> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -258> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -257> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -256> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -255> 2023-12-03T11:34:30.283+0000 7f8acf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -254> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -253> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -252> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -251> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -250> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -249> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.537 INFO:tasks.workunit.client.0.smithi131.stderr: -248> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr: -247> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr: -246> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr: -245> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr: -244> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command cache list hook 0x55c48fcc1980 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr: -243> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command cache inspect hook 0x55c48fcc1980 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr: -242> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command cache erase hook 0x55c48fcc1980 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr: -241> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command cache zap hook 0x55c48fcc1980 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr: -240> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 10 monclient: get_monmap_and_config 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr: -239> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 10 monclient: build_initial_monmap 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr: -238> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 1 build_initial for_mkfs: 0 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr: -237> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 10 monclient: monmap: 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:34:30.538 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr: -236> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding auth protocol: cephx 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr: -235> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding auth protocol: cephx 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr: -234> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding auth protocol: cephx 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr: -233> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr: -232> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr: -231> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr: -230> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.539 INFO:tasks.workunit.client.0.smithi131.stderr: -229> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -228> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -227> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -226> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -225> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -224> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -223> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -222> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -221> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -220> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 10 monclient: init 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -219> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding auth protocol: cephx 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -218> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding auth protocol: cephx 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -217> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding auth protocol: cephx 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -216> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -215> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -214> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.540 INFO:tasks.workunit.client.0.smithi131.stderr: -213> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -212> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -211> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -210> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -209> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -208> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -207> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -206> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -205> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -204> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -203> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -202> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command rotate-key cmddesc rotate-key hook 0x7ffdf4f0da98 EEXIST 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -201> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient: _reopen_session rank -1 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -200> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -199> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-c con 0x55c48fd710e0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:34:30.541 INFO:tasks.workunit.client.0.smithi131.stderr: -198> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-a con 0x55c48fd6efe0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -197> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-b con 0x55c48fd709f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -196> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -195> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -194> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -193> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): _renew_subs 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -192> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): authenticate will time out at 1561.662827s 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -191> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): get_auth_request con 0x55c48fd710e0 auth_method 0 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -190> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -189> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -188> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -187> 2023-12-03T11:34:30.284+0000 7f8b09a25640 10 monclient(hunting): get_auth_request con 0x55c48fd6efe0 auth_method 0 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -186> 2023-12-03T11:34:30.284+0000 7f8b09a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -185> 2023-12-03T11:34:30.284+0000 7f8b09a25640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.542 INFO:tasks.workunit.client.0.smithi131.stderr: -184> 2023-12-03T11:34:30.284+0000 7f8b09a25640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr: -183> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr: -182> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr: -181> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr: -180> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): handle_auth_done global_id 6422 payload 274 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr: -179> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient: _finish_hunting 0 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr: -178> 2023-12-03T11:34:30.284+0000 7f8b0a226640 1 monclient: found mon.noname-c 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr: -177> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr: -176> 2023-12-03T11:34:30.284+0000 7f8acefe5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr: -175> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr: -174> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: dump: 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.543 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr: -173> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: _finish_auth 0 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr: -172> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: _check_auth_tickets 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr: -171> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 monclient: authenticate success, global_id 6422 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr: -170> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr: -169> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr: -168> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr: -167> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: dump: 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.544 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr: -166> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 10 monclient: get_monmap_and_config success 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr: -165> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 4 set_mon_vals no callback set 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr: -164> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 10 monclient: shutdown 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr: -163> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 10 monclient: build_initial_monmap 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr: -162> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 1 build_initial for_mkfs: 0 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr: -161> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 10 monclient: monmap: 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:34:30.545 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr: -160> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding auth protocol: cephx 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr: -159> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding auth protocol: cephx 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr: -158> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding auth protocol: cephx 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr: -157> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr: -156> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr: -155> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr: -154> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.546 INFO:tasks.workunit.client.0.smithi131.stderr: -153> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -152> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -151> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -150> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -149> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -148> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -147> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -146> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -145> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -144> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 1 librados: starting msgr at 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -143> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 1 librados: starting objecter 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -142> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command objecter_requests cmddesc objecter_requests hook 0x55c48fd3b260 EEXIST 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -141> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 1 librados: setting wanted keys 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -140> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 1 librados: calling monclient init 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -139> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient: init 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -138> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding auth protocol: cephx 2023-12-03T11:34:30.547 INFO:tasks.workunit.client.0.smithi131.stderr: -137> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding auth protocol: cephx 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -136> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding auth protocol: cephx 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -135> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -134> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -133> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -132> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -131> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -130> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -129> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -128> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -127> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -126> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -125> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -124> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -123> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -122> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.548 INFO:tasks.workunit.client.0.smithi131.stderr: -121> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command rotate-key cmddesc rotate-key hook 0x55c48fd71b10 EEXIST 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -120> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient: _reopen_session rank -1 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -119> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -118> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-b con 0x55c48fd709f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -117> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-a con 0x55c48fd710e0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -116> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-c con 0x55c48fd74340 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -115> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -114> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -113> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -112> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): _renew_subs 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -111> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): authenticate will time out at 1561.665273s 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -110> 2023-12-03T11:34:30.286+0000 7f8b09a25640 10 monclient(hunting): get_auth_request con 0x55c48fd710e0 auth_method 0 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -109> 2023-12-03T11:34:30.286+0000 7f8b09a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.549 INFO:tasks.workunit.client.0.smithi131.stderr: -108> 2023-12-03T11:34:30.286+0000 7f8b09a25640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -107> 2023-12-03T11:34:30.286+0000 7f8b09a25640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -106> 2023-12-03T11:34:30.286+0000 7f8b01224640 10 monclient(hunting): get_auth_request con 0x55c48fd74340 auth_method 0 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -105> 2023-12-03T11:34:30.286+0000 7f8b01224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -104> 2023-12-03T11:34:30.286+0000 7f8b01224640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -103> 2023-12-03T11:34:30.286+0000 7f8b01224640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -102> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -101> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -100> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -99> 2023-12-03T11:34:30.287+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -98> 2023-12-03T11:34:30.287+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -97> 2023-12-03T11:34:30.287+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -96> 2023-12-03T11:34:30.287+0000 7f8b0a226640 10 monclient(hunting): get_auth_request con 0x55c48fd709f0 auth_method 0 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -95> 2023-12-03T11:34:30.287+0000 7f8b0a226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.550 INFO:tasks.workunit.client.0.smithi131.stderr: -94> 2023-12-03T11:34:30.287+0000 7f8b0a226640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -93> 2023-12-03T11:34:30.287+0000 7f8b0a226640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -92> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient(hunting): handle_auth_done global_id 6744 payload 824 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -91> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient: _finish_hunting 0 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -90> 2023-12-03T11:34:30.287+0000 7f8b09a25640 1 monclient: found mon.noname-a 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -89> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -88> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient: get_auth_request con 0x55c48fd710e0 auth_method 0 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -87> 2023-12-03T11:34:30.488+0000 7f8b09a25640 0 --2- 172.21.15.131:0/580534104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c48fd710e0 0x55c48fd7a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -86> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: ms_handle_reset current mon [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -85> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: _reopen_session rank -1 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -84> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -83> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): picked mon.noname-b con 0x55c48fd709f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -82> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): picked mon.noname-a con 0x7f8a44004900 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -81> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): picked mon.noname-c con 0x55c48fd74340 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:34:30.551 INFO:tasks.workunit.client.0.smithi131.stderr: -80> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -79> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -78> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -77> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): _renew_subs 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -76> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): get_auth_request con 0x7f8a44004900 auth_method 0 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -75> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -74> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -73> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): _init_auth already have auth, reseting 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -72> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -71> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -70> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -69> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): get_auth_request con 0x55c48fd74340 auth_method 0 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -68> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -67> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -66> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): _init_auth already have auth, reseting 2023-12-03T11:34:30.552 INFO:tasks.workunit.client.0.smithi131.stderr: -65> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr: -64> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr: -63> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr: -62> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): handle_auth_done global_id 6744 payload 293 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr: -61> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient: _finish_hunting 0 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr: -60> 2023-12-03T11:34:30.488+0000 7f8b09a25640 1 monclient: found mon.noname-a 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr: -59> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr: -58> 2023-12-03T11:34:30.488+0000 7f8b0a226640 10 monclient: get_auth_request con 0x55c48fd709f0 auth_method 0 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr: -57> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr: -56> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr: -55> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: dump: 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.553 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr: -54> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: _finish_auth 0 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr: -53> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: _check_auth_tickets 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr: -52> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr: -51> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr: -50> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr: -49> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: dump: 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.554 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr: -48> 2023-12-03T11:34:30.488+0000 7f8b0bf1e800 5 monclient: authenticate success, global_id 6744 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr: -47> 2023-12-03T11:34:30.488+0000 7f8b0bf1e800 10 monclient: _renew_subs 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr: -46> 2023-12-03T11:34:30.488+0000 7f8acefe5640 4 set_mon_vals no callback set 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr: -45> 2023-12-03T11:34:30.488+0000 7f8b0bf1e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr: -44> 2023-12-03T11:34:30.489+0000 7f8b0bf1e800 10 monclient: _renew_subs 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr: -43> 2023-12-03T11:34:30.489+0000 7f8b0bf1e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr: -42> 2023-12-03T11:34:30.489+0000 7f8b0bf1e800 1 librados: init done 2023-12-03T11:34:30.555 INFO:tasks.workunit.client.0.smithi131.stderr: -41> 2023-12-03T11:34:30.489+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command cr dump hook 0x55c48fd74ed8 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -40> 2023-12-03T11:34:30.490+0000 7f8acd7e2640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -39> 2023-12-03T11:34:30.490+0000 7f8acd7e2640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -38> 2023-12-03T11:34:30.490+0000 7f8acd7e2640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -37> 2023-12-03T11:34:30.490+0000 7f8b0bf1e800 5 note: GC not initialized 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -36> 2023-12-03T11:34:30.490+0000 7f8b0a226640 10 monclient: get_auth_request con 0x55c48fd710e0 auth_method 0 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -35> 2023-12-03T11:34:30.491+0000 7f8a3e7fc640 20 reqs_thread_entry: start 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -34> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command sync trace show hook 0x7f8af40043a0 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -33> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command sync trace history hook 0x7f8af40043a0 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -32> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command sync trace active hook 0x7f8af40043a0 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -31> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command sync trace active_short hook 0x7f8af40043a0 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -30> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -29> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 Filter name: none 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -28> 2023-12-03T11:34:30.491+0000 7f8a2ffff640 20 reqs_thread_entry: start 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -27> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:34:30.556 INFO:tasks.workunit.client.0.smithi131.stderr: -26> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -25> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -24> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -23> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -22> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 : miss 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -21> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -20> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -19> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -18> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -17> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -16> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -15> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -14> 2023-12-03T11:34:30.492+0000 7f8b01224640 10 monclient: get_auth_request con 0x55c48fdb7dc0 auth_method 0 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -13> 2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:34:30.557 INFO:tasks.workunit.client.0.smithi131.stderr: -12> 2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: -11> 2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: -10> 2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22, ofs0, ns] 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: -9> 2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791324 cookie 94302714950208 notifier 6419 bl.length()=877 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: -8> 2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: -7> 2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: -6> 2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: -5> 2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): orig_sources= new_sources= 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: -4> 2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): potential sources added=[] removed=[] 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: -3> 2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): orig_dests= new_dests= 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: -2> 2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): potential dests added=[] removed=[] 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: -1> 2023-12-03T11:34:30.498+0000 7f8b0bf1e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8b0bf1e800 time 2023-12-03T11:34:30.498501+0000 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:34:30.558 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8b1096eef8] 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8b1096f0b6] 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c48e5d4a71] 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55c48e5e0ec4] 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f8b0e23feb0] 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: 0> 2023-12-03T11:34:30.498+0000 7f8b0bf1e800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f8b0bf1e800 thread_name:radosgw-admin 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:34:30.559 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8b0e254db0] 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8b0e2a154c] 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8b1096ef52] 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8b1096f0b6] 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c48e5d4a71] 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55c48e5e0ec4] 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f8b0e23feb0] 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr:--- logging levels --- 2023-12-03T11:34:30.560 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 none 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 lockdep 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 context 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 crush 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_balancer 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_locker 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log_expire 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_migrator 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 buffer 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 timer 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 filer 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 striper 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 objecter 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rados 2023-12-03T11:34:30.561 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_mirror 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_replay 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_pwl 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 journaler 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objectcacher 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 client 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 osd 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 optracker 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objclass 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 filestore 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 journal 2023-12-03T11:34:30.562 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 ms 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mon 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 0/10 monc 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 paxos 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 tp 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 auth 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 crypto 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 finisher 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 reserver 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 heartbeatmap 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 perfcounter 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 20/20 rgw 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_sync 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_datacache 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_access 2023-12-03T11:34:30.563 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_flight 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 javaclient 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 asok 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 throttle 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 refs 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 compressor 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluestore 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluefs 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 bdev 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 kstore 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 4/ 5 rocksdb 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 fuse 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 2/ 5 mgr 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mgrc 2023-12-03T11:34:30.564 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 dpdk 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 eventtrace 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 prioritycache 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 test 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephsqlite 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_onode 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_odata 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_omap 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_tm 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_t 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:34:30.565 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_epm 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_lba 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cache 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_journal 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_device 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_backref 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 alienstore 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mclock 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cyanstore 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 ceph_exporter 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 memstore 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 trace 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: -2/-2 (syslog threshold) 2023-12-03T11:34:30.566 INFO:tasks.workunit.client.0.smithi131.stderr: 99/99 (stderr threshold) 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8a2ffff640 / http_manager 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8a3e7fc640 / http_manager 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8acd7e2640 / ms_dispatch 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8acefe5640 / io_context_pool 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8acf7e6640 / rgw_dt_lg_renew 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8aea7fc640 / ms_dispatch 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8aeb7fe640 / io_context_pool 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8aebfff640 / io_context_pool 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8b01224640 / msgr-worker-2 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8b037fe640 / ms_dispatch 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8b09a25640 / msgr-worker-1 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8b0a226640 / msgr-worker-0 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8b0bf1e800 / radosgw-admin 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: max_recent 500 2023-12-03T11:34:30.567 INFO:tasks.workunit.client.0.smithi131.stderr: max_new 1000 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: log_file /var/log/ceph/ceph-client.admin.102740.log 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr:--- end dump of recent events --- 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr:--- begin dump of recent events --- 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -499> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd470) adding con mode: secure 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -498> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd470) adding con mode: crc 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -497> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd470) adding con mode: secure 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -496> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -495> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 10 monclient: init 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -494> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding auth protocol: cephx 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -493> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding auth protocol: cephx 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -492> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding auth protocol: cephx 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -491> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -490> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -489> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -488> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.568 INFO:tasks.workunit.client.0.smithi131.stderr: -487> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -486> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -485> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -484> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -483> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -482> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -481> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: crc 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -480> 2023-12-03T11:34:30.056+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d3d0) adding con mode: secure 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -479> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -478> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -477> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command rotate-key cmddesc rotate-key hook 0x7ffdf4f0d518 EEXIST 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -476> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient: _reopen_session rank -1 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -475> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -474> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-c con 0x55c48fd0d700 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -473> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-a con 0x55c48fd0dae0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -472> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-b con 0x55c48fce1be0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:34:30.569 INFO:tasks.workunit.client.0.smithi131.stderr: -471> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -470> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -469> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -468> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): _renew_subs 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -467> 2023-12-03T11:34:30.057+0000 7f8b0bf1e800 10 monclient(hunting): authenticate will time out at 1561.435827s 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -466> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): get_auth_request con 0x55c48fd0d700 auth_method 0 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -465> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -464> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -463> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -462> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): get_auth_request con 0x55c48fd0dae0 auth_method 0 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -461> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -460> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -459> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -458> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): get_auth_request con 0x55c48fce1be0 auth_method 0 2023-12-03T11:34:30.570 INFO:tasks.workunit.client.0.smithi131.stderr: -457> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -456> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -455> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -454> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -453> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -452> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -451> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -450> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -449> 2023-12-03T11:34:30.057+0000 7f8b037fe640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -448> 2023-12-03T11:34:30.057+0000 7f8b037fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -447> 2023-12-03T11:34:30.057+0000 7f8b037fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -446> 2023-12-03T11:34:30.057+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -445> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -444> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -443> 2023-12-03T11:34:30.057+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.571 INFO:tasks.workunit.client.0.smithi131.stderr: -442> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient(hunting): handle_auth_done global_id 6416 payload 274 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr: -441> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient: _finish_hunting 0 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr: -440> 2023-12-03T11:34:30.057+0000 7f8b0a226640 1 monclient: found mon.noname-c 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr: -439> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr: -438> 2023-12-03T11:34:30.057+0000 7f8b0a226640 10 monclient: get_auth_request con 0x7f8aec069850 auth_method 0 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr: -437> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr: -436> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr: -435> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: dump: 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.572 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr: -434> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: _finish_auth 0 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr: -433> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: _check_auth_tickets 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr: -432> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 monclient: authenticate success, global_id 6416 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr: -431> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr: -430> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr: -429> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr: -428> 2023-12-03T11:34:30.058+0000 7f8aebfff640 10 monclient: dump: 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.573 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr: -427> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 10 monclient: get_monmap_and_config success 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr: -426> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 4 set_mon_vals no callback set 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr: -425> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 10 monclient: shutdown 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr: -424> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 10 monclient: build_initial_monmap 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr: -423> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 1 build_initial for_mkfs: 0 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr: -422> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 10 monclient: monmap: 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:34:30.574 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: -421> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding auth protocol: cephx 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: -420> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding auth protocol: cephx 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: -419> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding auth protocol: cephx 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: -418> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: -417> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: -416> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: -415> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: -414> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: -413> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: -412> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.575 INFO:tasks.workunit.client.0.smithi131.stderr: -411> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -410> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -409> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -408> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: crc 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -407> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fcdd340) adding con mode: secure 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -406> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -405> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 1 librados: starting msgr at 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -404> 2023-12-03T11:34:30.058+0000 7f8b0bf1e800 1 librados: starting objecter 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -403> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command objecter_requests cmddesc objecter_requests hook 0x55c48fce1bc0 EEXIST 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -402> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 1 librados: setting wanted keys 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -401> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 1 librados: calling monclient init 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -400> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient: init 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -399> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding auth protocol: cephx 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -398> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding auth protocol: cephx 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -397> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding auth protocol: cephx 2023-12-03T11:34:30.576 INFO:tasks.workunit.client.0.smithi131.stderr: -396> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -395> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -394> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -393> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -392> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -391> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -390> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -389> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -388> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -387> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -386> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: crc 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -385> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fb68198) adding con mode: secure 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -384> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -383> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -382> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command rotate-key cmddesc rotate-key hook 0x55c48fb682e0 EEXIST 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -381> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient: _reopen_session rank -1 2023-12-03T11:34:30.577 INFO:tasks.workunit.client.0.smithi131.stderr: -380> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -379> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-b con 0x55c48fce1be0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -378> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-c con 0x55c48fd0d700 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -377> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-a con 0x55c48fcde580 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -376> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -375> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -374> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -373> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): _renew_subs 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -372> 2023-12-03T11:34:30.059+0000 7f8b0bf1e800 10 monclient(hunting): authenticate will time out at 1561.438073s 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -371> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): get_auth_request con 0x55c48fd0d700 auth_method 0 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -370> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -369> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -368> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -367> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): get_auth_request con 0x55c48fcde580 auth_method 0 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -366> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.578 INFO:tasks.workunit.client.0.smithi131.stderr: -365> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -364> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -363> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -362> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -361> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -360> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -359> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -358> 2023-12-03T11:34:30.059+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -357> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): get_auth_request con 0x55c48fce1be0 auth_method 0 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -356> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -355> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -354> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -353> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -352> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -351> 2023-12-03T11:34:30.059+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -350> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient(hunting): handle_auth_done global_id 6419 payload 824 2023-12-03T11:34:30.579 INFO:tasks.workunit.client.0.smithi131.stderr: -349> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient: _finish_hunting 0 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr: -348> 2023-12-03T11:34:30.059+0000 7f8b01224640 1 monclient: found mon.noname-c 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr: -347> 2023-12-03T11:34:30.059+0000 7f8b01224640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr: -346> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr: -345> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr: -344> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: dump: 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.580 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr: -343> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: _finish_auth 0 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr: -342> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: _check_auth_tickets 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr: -341> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr: -340> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr: -339> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr: -338> 2023-12-03T11:34:30.060+0000 7f8aea7fc640 10 monclient: dump: 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.581 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -337> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 5 monclient: authenticate success, global_id 6419 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -336> 2023-12-03T11:34:30.060+0000 7f8aebfff640 4 set_mon_vals no callback set 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -335> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 10 monclient: _renew_subs 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -334> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -333> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 10 monclient: _renew_subs 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -332> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -331> 2023-12-03T11:34:30.060+0000 7f8b0bf1e800 1 librados: init done 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -330> 2023-12-03T11:34:30.061+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -329> 2023-12-03T11:34:30.062+0000 7f8aea7fc640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -328> 2023-12-03T11:34:30.062+0000 7f8aea7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -327> 2023-12-03T11:34:30.062+0000 7f8aea7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.582 INFO:tasks.workunit.client.0.smithi131.stderr: -326> 2023-12-03T11:34:30.062+0000 7f8b09a25640 10 monclient: get_auth_request con 0x7f8ae4069820 auth_method 0 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -325> 2023-12-03T11:34:30.062+0000 7f8b0a226640 10 monclient: get_auth_request con 0x55c48fd29f70 auth_method 0 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -324> 2023-12-03T11:34:30.062+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -323> 2023-12-03T11:34:30.062+0000 7f8b0bf1e800 20 realm 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -322> 2023-12-03T11:34:30.062+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -321> 2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -320> 2023-12-03T11:34:30.063+0000 7f8b0bf1e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -319> 2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -318> 2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -317> 2023-12-03T11:34:30.063+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -316> 2023-12-03T11:34:30.063+0000 7f8b09a25640 10 monclient: get_auth_request con 0x55c48fd2de80 auth_method 0 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -315> 2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -314> 2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -313> 2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:30.583 INFO:tasks.workunit.client.0.smithi131.stderr: -312> 2023-12-03T11:34:30.064+0000 7f8b0bf1e800 20 searching for the correct realm 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -311> 2023-12-03T11:34:30.064+0000 7f8b01224640 10 monclient: get_auth_request con 0x55c48fd32e60 auth_method 0 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -310> 2023-12-03T11:34:30.065+0000 7f8b0a226640 10 monclient: get_auth_request con 0x7f8af409a1a0 auth_method 0 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -309> 2023-12-03T11:34:30.065+0000 7f8b09a25640 10 monclient: get_auth_request con 0x7f8b04025980 auth_method 0 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -308> 2023-12-03T11:34:30.066+0000 7f8b01224640 10 monclient: get_auth_request con 0x7f8afc060160 auth_method 0 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -307> 2023-12-03T11:34:30.068+0000 7f8b0a226640 10 monclient: get_auth_request con 0x7f8af40c7040 auth_method 0 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -306> 2023-12-03T11:34:30.070+0000 7f8b09a25640 10 monclient: get_auth_request con 0x7f8af4099430 auth_method 0 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -305> 2023-12-03T11:34:30.072+0000 7f8b0a226640 0 -- 172.21.15.131:0/221833288 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55c48fd29f70 msgr2=0x55c48fd2c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -304> 2023-12-03T11:34:30.072+0000 7f8aea7fc640 1 client.6419.objecter ms_handle_reset 0x55c48fd29f70 session 0x55c48fafa3a0 osd.1 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -303> 2023-12-03T11:34:30.072+0000 7f8aea7fc640 10 monclient: _renew_subs 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -302> 2023-12-03T11:34:30.072+0000 7f8aea7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -301> 2023-12-03T11:34:30.072+0000 7f8b0a226640 10 monclient: get_auth_request con 0x7f8ae4079640 auth_method 0 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -300> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:30.584 INFO:tasks.workunit.client.0.smithi131.stderr: -299> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -298> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -297> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -296> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -295> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -294> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -293> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -292> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -291> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -290> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 zone default found 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -289> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 4 Realm: () 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -288> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -287> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -286> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -285> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 zonegroup default 2023-12-03T11:34:30.585 INFO:tasks.workunit.client.0.smithi131.stderr: -284> 2023-12-03T11:34:30.074+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -283> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -282> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -281> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -280> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -279> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -278> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 started sync module instance, tier type = 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -277> 2023-12-03T11:34:30.075+0000 7f8b0bf1e800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -276> 2023-12-03T11:34:30.079+0000 7f8b0a226640 0 -- 172.21.15.131:0/221833288 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7f8af409a1a0 msgr2=0x7f8af40c98a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -275> 2023-12-03T11:34:30.079+0000 7f8aea7fc640 1 client.6419.objecter ms_handle_reset 0x7f8af409a1a0 session 0x7f8af409e060 osd.7 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -274> 2023-12-03T11:34:30.079+0000 7f8b0a226640 10 monclient: get_auth_request con 0x55c48fd29f70 auth_method 0 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -273> 2023-12-03T11:34:30.085+0000 7f8b0bf1e800 20 add_watcher() i=0 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -272> 2023-12-03T11:34:30.085+0000 7f8b0bf1e800 20 add_watcher() i=1 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -271> 2023-12-03T11:34:30.280+0000 7f8b0a226640 10 monclient: get_auth_request con 0x55c48fd29f70 auth_method 0 2023-12-03T11:34:30.586 INFO:tasks.workunit.client.0.smithi131.stderr: -270> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=2 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -269> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=3 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -268> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=4 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -267> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=5 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -266> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=6 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -265> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 20 add_watcher() i=7 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -264> 2023-12-03T11:34:30.281+0000 7f8b0bf1e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -263> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding auth protocol: cephx 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -262> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding auth protocol: cephx 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -261> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding auth protocol: cephx 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -260> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -259> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -258> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -257> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -256> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.587 INFO:tasks.workunit.client.0.smithi131.stderr: -255> 2023-12-03T11:34:30.283+0000 7f8acf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -254> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -253> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -252> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -251> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -250> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -249> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: crc 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -248> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0de00) adding con mode: secure 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -247> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -246> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -245> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -244> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command cache list hook 0x55c48fcc1980 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -243> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command cache inspect hook 0x55c48fcc1980 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -242> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command cache erase hook 0x55c48fcc1980 2023-12-03T11:34:30.588 INFO:tasks.workunit.client.0.smithi131.stderr: -241> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command cache zap hook 0x55c48fcc1980 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr: -240> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 10 monclient: get_monmap_and_config 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr: -239> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 10 monclient: build_initial_monmap 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr: -238> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 1 build_initial for_mkfs: 0 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr: -237> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 10 monclient: monmap: 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.589 INFO:tasks.workunit.client.0.smithi131.stderr: -236> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding auth protocol: cephx 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -235> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding auth protocol: cephx 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -234> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding auth protocol: cephx 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -233> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -232> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -231> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -230> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -229> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -228> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -227> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -226> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -225> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -224> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -223> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: crc 2023-12-03T11:34:30.590 INFO:tasks.workunit.client.0.smithi131.stderr: -222> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd6e4b0) adding con mode: secure 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -221> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -220> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 10 monclient: init 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -219> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding auth protocol: cephx 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -218> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding auth protocol: cephx 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -217> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding auth protocol: cephx 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -216> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -215> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -214> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -213> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -212> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -211> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -210> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -209> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -208> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.591 INFO:tasks.workunit.client.0.smithi131.stderr: -207> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -206> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: crc 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -205> 2023-12-03T11:34:30.283+0000 7f8b0bf1e800 5 AuthRegistry(0x7ffdf4f0d950) adding con mode: secure 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -204> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -203> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -202> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command rotate-key cmddesc rotate-key hook 0x7ffdf4f0da98 EEXIST 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -201> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient: _reopen_session rank -1 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -200> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient: _add_conns ranks=[2,0,1] 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -199> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-c con 0x55c48fd710e0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -198> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-a con 0x55c48fd6efe0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -197> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-b con 0x55c48fd709f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -196> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -195> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -194> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -193> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): _renew_subs 2023-12-03T11:34:30.592 INFO:tasks.workunit.client.0.smithi131.stderr: -192> 2023-12-03T11:34:30.284+0000 7f8b0bf1e800 10 monclient(hunting): authenticate will time out at 1561.662827s 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -191> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): get_auth_request con 0x55c48fd710e0 auth_method 0 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -190> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -189> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -188> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -187> 2023-12-03T11:34:30.284+0000 7f8b09a25640 10 monclient(hunting): get_auth_request con 0x55c48fd6efe0 auth_method 0 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -186> 2023-12-03T11:34:30.284+0000 7f8b09a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -185> 2023-12-03T11:34:30.284+0000 7f8b09a25640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -184> 2023-12-03T11:34:30.284+0000 7f8b09a25640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -183> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -182> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -181> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -180> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient(hunting): handle_auth_done global_id 6422 payload 274 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -179> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient: _finish_hunting 0 2023-12-03T11:34:30.593 INFO:tasks.workunit.client.0.smithi131.stderr: -178> 2023-12-03T11:34:30.284+0000 7f8b0a226640 1 monclient: found mon.noname-c 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr: -177> 2023-12-03T11:34:30.284+0000 7f8b0a226640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr: -176> 2023-12-03T11:34:30.284+0000 7f8acefe5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr: -175> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr: -174> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: dump: 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.594 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr: -173> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: _finish_auth 0 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr: -172> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: _check_auth_tickets 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr: -171> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 monclient: authenticate success, global_id 6422 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr: -170> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr: -169> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr: -168> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr: -167> 2023-12-03T11:34:30.285+0000 7f8acefe5640 10 monclient: dump: 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.595 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr: -166> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 10 monclient: get_monmap_and_config success 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr: -165> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 4 set_mon_vals no callback set 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr: -164> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 10 monclient: shutdown 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr: -163> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 10 monclient: build_initial_monmap 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr: -162> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 1 build_initial for_mkfs: 0 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr: -161> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 10 monclient: monmap: 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:34:30.596 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr: -160> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding auth protocol: cephx 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr: -159> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding auth protocol: cephx 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr: -158> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding auth protocol: cephx 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr: -157> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr: -156> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr: -155> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr: -154> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr: -153> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr: -152> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.597 INFO:tasks.workunit.client.0.smithi131.stderr: -151> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -150> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -149> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -148> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -147> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: crc 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -146> 2023-12-03T11:34:30.285+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd64c60) adding con mode: secure 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -145> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -144> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 1 librados: starting msgr at 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -143> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 1 librados: starting objecter 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -142> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command objecter_requests cmddesc objecter_requests hook 0x55c48fd3b260 EEXIST 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -141> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 1 librados: setting wanted keys 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -140> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 1 librados: calling monclient init 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -139> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient: init 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -138> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding auth protocol: cephx 2023-12-03T11:34:30.598 INFO:tasks.workunit.client.0.smithi131.stderr: -137> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding auth protocol: cephx 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -136> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding auth protocol: cephx 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -135> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -134> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -133> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -132> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -131> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -130> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -129> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -128> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -127> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -126> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -125> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: crc 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -124> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 AuthRegistry(0x55c48fd719c8) adding con mode: secure 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -123> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.599 INFO:tasks.workunit.client.0.smithi131.stderr: -122> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -121> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command rotate-key cmddesc rotate-key hook 0x55c48fd71b10 EEXIST 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -120> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient: _reopen_session rank -1 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -119> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -118> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-b con 0x55c48fd709f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -117> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-a con 0x55c48fd710e0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -116> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): picked mon.noname-c con 0x55c48fd74340 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -115> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -114> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -113> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -112> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): _renew_subs 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -111> 2023-12-03T11:34:30.286+0000 7f8b0bf1e800 10 monclient(hunting): authenticate will time out at 1561.665273s 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -110> 2023-12-03T11:34:30.286+0000 7f8b09a25640 10 monclient(hunting): get_auth_request con 0x55c48fd710e0 auth_method 0 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -109> 2023-12-03T11:34:30.286+0000 7f8b09a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -108> 2023-12-03T11:34:30.286+0000 7f8b09a25640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.600 INFO:tasks.workunit.client.0.smithi131.stderr: -107> 2023-12-03T11:34:30.286+0000 7f8b09a25640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -106> 2023-12-03T11:34:30.286+0000 7f8b01224640 10 monclient(hunting): get_auth_request con 0x55c48fd74340 auth_method 0 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -105> 2023-12-03T11:34:30.286+0000 7f8b01224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -104> 2023-12-03T11:34:30.286+0000 7f8b01224640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -103> 2023-12-03T11:34:30.286+0000 7f8b01224640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -102> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -101> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -100> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -99> 2023-12-03T11:34:30.287+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -98> 2023-12-03T11:34:30.287+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -97> 2023-12-03T11:34:30.287+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -96> 2023-12-03T11:34:30.287+0000 7f8b0a226640 10 monclient(hunting): get_auth_request con 0x55c48fd709f0 auth_method 0 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -95> 2023-12-03T11:34:30.287+0000 7f8b0a226640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -94> 2023-12-03T11:34:30.287+0000 7f8b0a226640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.601 INFO:tasks.workunit.client.0.smithi131.stderr: -93> 2023-12-03T11:34:30.287+0000 7f8b0a226640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -92> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient(hunting): handle_auth_done global_id 6744 payload 824 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -91> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient: _finish_hunting 0 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -90> 2023-12-03T11:34:30.287+0000 7f8b09a25640 1 monclient: found mon.noname-a 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -89> 2023-12-03T11:34:30.287+0000 7f8b09a25640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -88> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient: get_auth_request con 0x55c48fd710e0 auth_method 0 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -87> 2023-12-03T11:34:30.488+0000 7f8b09a25640 0 --2- 172.21.15.131:0/580534104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c48fd710e0 0x55c48fd7a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -86> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: ms_handle_reset current mon [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -85> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: _reopen_session rank -1 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -84> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -83> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): picked mon.noname-b con 0x55c48fd709f0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -82> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): picked mon.noname-a con 0x7f8a44004900 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -81> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): picked mon.noname-c con 0x55c48fd74340 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -80> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.602 INFO:tasks.workunit.client.0.smithi131.stderr: -79> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -78> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): start opening mon connection 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -77> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient(hunting): _renew_subs 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -76> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): get_auth_request con 0x7f8a44004900 auth_method 0 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -75> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -74> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -73> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): _init_auth already have auth, reseting 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -72> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -71> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -70> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -69> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): get_auth_request con 0x55c48fd74340 auth_method 0 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -68> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -67> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -66> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): _init_auth already have auth, reseting 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -65> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -64> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:34:30.603 INFO:tasks.workunit.client.0.smithi131.stderr: -63> 2023-12-03T11:34:30.488+0000 7f8b01224640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr: -62> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient(hunting): handle_auth_done global_id 6744 payload 293 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr: -61> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient: _finish_hunting 0 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr: -60> 2023-12-03T11:34:30.488+0000 7f8b09a25640 1 monclient: found mon.noname-a 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr: -59> 2023-12-03T11:34:30.488+0000 7f8b09a25640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr: -58> 2023-12-03T11:34:30.488+0000 7f8b0a226640 10 monclient: get_auth_request con 0x55c48fd709f0 auth_method 0 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr: -57> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr: -56> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr: -55> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: dump: 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.604 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr: -54> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: _finish_auth 0 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr: -53> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: _check_auth_tickets 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr: -52> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr: -51> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr: -50> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr: -49> 2023-12-03T11:34:30.488+0000 7f8acd7e2640 10 monclient: dump: 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:34:30.605 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr: -48> 2023-12-03T11:34:30.488+0000 7f8b0bf1e800 5 monclient: authenticate success, global_id 6744 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr: -47> 2023-12-03T11:34:30.488+0000 7f8b0bf1e800 10 monclient: _renew_subs 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr: -46> 2023-12-03T11:34:30.488+0000 7f8acefe5640 4 set_mon_vals no callback set 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr: -45> 2023-12-03T11:34:30.488+0000 7f8b0bf1e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr: -44> 2023-12-03T11:34:30.489+0000 7f8b0bf1e800 10 monclient: _renew_subs 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr: -43> 2023-12-03T11:34:30.489+0000 7f8b0bf1e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr: -42> 2023-12-03T11:34:30.489+0000 7f8b0bf1e800 1 librados: init done 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr: -41> 2023-12-03T11:34:30.489+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command cr dump hook 0x55c48fd74ed8 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr: -40> 2023-12-03T11:34:30.490+0000 7f8acd7e2640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:34:30.606 INFO:tasks.workunit.client.0.smithi131.stderr: -39> 2023-12-03T11:34:30.490+0000 7f8acd7e2640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -38> 2023-12-03T11:34:30.490+0000 7f8acd7e2640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -37> 2023-12-03T11:34:30.490+0000 7f8b0bf1e800 5 note: GC not initialized 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -36> 2023-12-03T11:34:30.490+0000 7f8b0a226640 10 monclient: get_auth_request con 0x55c48fd710e0 auth_method 0 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -35> 2023-12-03T11:34:30.491+0000 7f8a3e7fc640 20 reqs_thread_entry: start 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -34> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command sync trace show hook 0x7f8af40043a0 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -33> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command sync trace history hook 0x7f8af40043a0 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -32> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command sync trace active hook 0x7f8af40043a0 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -31> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 5 asok(0x55c48fad2a10) register_command sync trace active_short hook 0x7f8af40043a0 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -30> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -29> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 Filter name: none 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -28> 2023-12-03T11:34:30.491+0000 7f8a2ffff640 20 reqs_thread_entry: start 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -27> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -26> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -25> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:30.607 INFO:tasks.workunit.client.0.smithi131.stderr: -24> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -23> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -22> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 : miss 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -21> 2023-12-03T11:34:30.491+0000 7f8b0bf1e800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -20> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -19> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -18> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -17> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -16> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -15> 2023-12-03T11:34:30.492+0000 7f8b0bf1e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -14> 2023-12-03T11:34:30.492+0000 7f8b01224640 10 monclient: get_auth_request con 0x55c48fdb7dc0 auth_method 0 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -13> 2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -12> 2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -11> 2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:30.608 INFO:tasks.workunit.client.0.smithi131.stderr: -10> 2023-12-03T11:34:30.496+0000 7f8b0bf1e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22, ofs0, ns] 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: -9> 2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791324 cookie 94302714950208 notifier 6419 bl.length()=877 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: -8> 2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: -7> 2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: -6> 2023-12-03T11:34:30.497+0000 7f8aeb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: -5> 2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): orig_sources= new_sources= 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: -4> 2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): potential sources added=[] removed=[] 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: -3> 2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): orig_dests= new_dests= 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: -2> 2023-12-03T11:34:30.497+0000 7f8b0bf1e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): potential dests added=[] removed=[] 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: -1> 2023-12-03T11:34:30.498+0000 7f8b0bf1e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8b0bf1e800 time 2023-12-03T11:34:30.498501+0000 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8b1096eef8] 2023-12-03T11:34:30.609 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8b1096f0b6] 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c48e5d4a71] 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55c48e5e0ec4] 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f8b0e23feb0] 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 0> 2023-12-03T11:34:30.498+0000 7f8b0bf1e800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f8b0bf1e800 thread_name:radosgw-admin 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f8b0e254db0] 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f8b0e2a154c] 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:34:30.610 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8b1096ef52] 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f8b1096f0b6] 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55c48e5d4a71] 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a4) [0x55c48e5e0ec4] 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f8b0e23feb0] 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr:--- logging levels --- 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 none 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 lockdep 2023-12-03T11:34:30.611 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 context 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 crush 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_balancer 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_locker 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log_expire 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_migrator 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 buffer 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 timer 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 filer 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 striper 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 objecter 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rados 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd 2023-12-03T11:34:30.612 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_mirror 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_replay 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_pwl 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 journaler 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objectcacher 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 client 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 osd 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 optracker 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objclass 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 filestore 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 journal 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 ms 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mon 2023-12-03T11:34:30.613 INFO:tasks.workunit.client.0.smithi131.stderr: 0/10 monc 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 paxos 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 tp 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 auth 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 crypto 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 finisher 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 reserver 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 heartbeatmap 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 perfcounter 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 20/20 rgw 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_sync 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_datacache 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_access 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_flight 2023-12-03T11:34:30.614 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 javaclient 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 asok 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 throttle 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 refs 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 compressor 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluestore 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluefs 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 bdev 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 kstore 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 4/ 5 rocksdb 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 fuse 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 2/ 5 mgr 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mgrc 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 dpdk 2023-12-03T11:34:30.615 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 eventtrace 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 prioritycache 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 test 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephsqlite 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_onode 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_odata 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_omap 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_tm 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_t 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_epm 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_lba 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:34:30.616 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cache 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_journal 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_device 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_backref 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 alienstore 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mclock 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cyanstore 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 ceph_exporter 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 memstore 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 trace 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: -2/-2 (syslog threshold) 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 99/99 (stderr threshold) 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8a2ffff640 / http_manager 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8a3e7fc640 / http_manager 2023-12-03T11:34:30.617 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8acd7e2640 / ms_dispatch 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8acefe5640 / io_context_pool 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8acf7e6640 / rgw_dt_lg_renew 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8aea7fc640 / ms_dispatch 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8aeb7fe640 / io_context_pool 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8aebfff640 / io_context_pool 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8b01224640 / msgr-worker-2 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8b037fe640 / ms_dispatch 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8b09a25640 / msgr-worker-1 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8b0a226640 / msgr-worker-0 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: 7f8b0bf1e800 / radosgw-admin 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: max_recent 500 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: max_new 1000 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:34:30.499822Z_d78035cb-156e-4d61-8823-b8e1359e189d/log 2023-12-03T11:34:30.618 INFO:tasks.workunit.client.0.smithi131.stderr:--- end dump of recent events --- 2023-12-03T11:34:30.619 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-12-03T11:34:30.623 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.546+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.548+0000 7f2596faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.548+0000 7f2596faf800 20 realm 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.548+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.548+0000 7f2596faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.548+0000 7f2596faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.548+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.548+0000 7f2596faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.548+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.549+0000 7f2596faf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.549+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.624 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.549+0000 7f2596faf800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.549+0000 7f2596faf800 20 searching for the correct realm 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.559+0000 7f2594aaf640 0 -- 172.21.15.131:0/1985648588 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55688c5b60f0 msgr2=0x55688c5b8500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.560+0000 7f2596faf800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.560+0000 7f2596faf800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.560+0000 7f2596faf800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.560+0000 7f2596faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.560+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.560+0000 7f2596faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.560+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.560+0000 7f2596faf800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.560+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 20 zone default found 2023-12-03T11:34:30.625 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 4 Realm: () 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 20 zonegroup default 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.561+0000 7f2596faf800 20 started sync module instance, tier type = 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.562+0000 7f2596faf800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.568+0000 7f25952b0640 0 -- 172.21.15.131:0/1985648588 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f2580080970 msgr2=0x7f258005f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.571+0000 7f2596faf800 20 add_watcher() i=0 2023-12-03T11:34:30.626 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.571+0000 7f2596faf800 20 add_watcher() i=1 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.571+0000 7f2596faf800 20 add_watcher() i=2 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.571+0000 7f2596faf800 20 add_watcher() i=3 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.571+0000 7f2596faf800 20 add_watcher() i=4 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.571+0000 7f2596faf800 20 add_watcher() i=5 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.571+0000 7f2596faf800 20 add_watcher() i=6 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.572+0000 7f2596faf800 20 add_watcher() i=7 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.572+0000 7f2596faf800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.573+0000 7f255a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.573+0000 7f2596faf800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.573+0000 7f2596faf800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.579+0000 7f2596faf800 5 note: GC not initialized 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.579+0000 7f24c97fa640 20 reqs_thread_entry: start 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.579+0000 7f2596faf800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.580+0000 7f2596faf800 20 Filter name: none 2023-12-03T11:34:30.627 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.580+0000 7f24c2ffd640 20 reqs_thread_entry: start 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.580+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.580+0000 7f2596faf800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.580+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.581+0000 7f2596faf800 20 rados_obj.operate() r=0 bl.length=405 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.581+0000 7f2596faf800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.581+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.581+0000 7f2596faf800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.581+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.581+0000 7f2596faf800 20 rados_obj.operate() r=0 bl.length=405 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.581+0000 7f2596faf800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.582+0000 7f2596faf800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.582+0000 7f2596faf800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.583+0000 7f255a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:30.628 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.584+0000 7f2596faf800 20 remove_watcher() i=0 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.584+0000 7f2596faf800 2 removed watcher, disabling cache 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.585+0000 7f2596faf800 20 remove_watcher() i=1 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.586+0000 7f2596faf800 20 remove_watcher() i=2 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.587+0000 7f2596faf800 20 remove_watcher() i=3 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.588+0000 7f2596faf800 20 remove_watcher() i=4 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.589+0000 7f2596faf800 20 remove_watcher() i=5 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.590+0000 7f2596faf800 20 remove_watcher() i=6 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.591+0000 7f2596faf800 20 remove_watcher() i=7 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-block-writes id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:34:30.629 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:34:30.648 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:34:30.677 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:34:30.677 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:34:30.690 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.689+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.691+0000 7fde2d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.691+0000 7fde2d922800 20 realm 2023-12-03T11:34:30.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.691+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.691+0000 7fde2d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.692 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.691+0000 7fde2d922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:34:30.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.691+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.691+0000 7fde2d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.691+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.692+0000 7fde2d922800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:30.693 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.692+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.694 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.692+0000 7fde2d922800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:34:30.694 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.692+0000 7fde2d922800 20 searching for the correct realm 2023-12-03T11:34:30.703 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.701+0000 7fde295a6640 0 -- 172.21.15.131:0/791911219 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5624a5778810 msgr2=0x5624a577ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.703+0000 7fde2d922800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:34:30.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.703+0000 7fde2d922800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:34:30.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.703+0000 7fde2d922800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:34:30.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.703+0000 7fde2d922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:34:30.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.703+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.703+0000 7fde2d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.703+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:34:30.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:34:30.706 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 20 zone default found 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 4 Realm: () 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 20 zonegroup default 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.704+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.705+0000 7fde2d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.705+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.705+0000 7fde2d922800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.705+0000 7fde2d922800 20 started sync module instance, tier type = 2023-12-03T11:34:30.707 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.705+0000 7fde2d922800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:34:30.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.710+0000 7fde295a6640 0 -- 172.21.15.131:0/791911219 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7fde2405e040 msgr2=0x7fde2405f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:34:30.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.714+0000 7fde2d922800 20 add_watcher() i=0 2023-12-03T11:34:30.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.714+0000 7fde2d922800 20 add_watcher() i=1 2023-12-03T11:34:30.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.714+0000 7fde2d922800 20 add_watcher() i=2 2023-12-03T11:34:30.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.714+0000 7fde2d922800 20 add_watcher() i=3 2023-12-03T11:34:30.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.714+0000 7fde2d922800 20 add_watcher() i=4 2023-12-03T11:34:30.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.714+0000 7fde2d922800 20 add_watcher() i=5 2023-12-03T11:34:30.715 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.714+0000 7fde2d922800 20 add_watcher() i=6 2023-12-03T11:34:30.716 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.715+0000 7fde2d922800 20 add_watcher() i=7 2023-12-03T11:34:30.716 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.715+0000 7fde2d922800 2 all 8 watchers are set, enabling cache 2023-12-03T11:34:30.718 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.717+0000 7fddeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:30.718 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.717+0000 7fde2d922800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:34:30.718 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.717+0000 7fde2d922800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:34:30.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.723+0000 7fde2d922800 5 note: GC not initialized 2023-12-03T11:34:30.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.723+0000 7fdd5dffb640 20 reqs_thread_entry: start 2023-12-03T11:34:30.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.723+0000 7fde2d922800 20 init_complete bucket index max shards: 1 2023-12-03T11:34:30.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.723+0000 7fde2d922800 20 Filter name: none 2023-12-03T11:34:30.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.723+0000 7fdd4f7fe640 20 reqs_thread_entry: start 2023-12-03T11:34:30.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.723+0000 7fde2d922800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:34:30.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.723+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.726 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.724+0000 7fde2d922800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:34:30.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.724+0000 7fde2d922800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:34:30.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.724+0000 7fde2d922800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:34:30.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.724+0000 7fde2d922800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 : miss 2023-12-03T11:34:30.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.724+0000 7fde2d922800 20 rados->read ofs=0 len=0 2023-12-03T11:34:30.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.724+0000 7fde2d922800 20 rados_obj.operate() r=0 bl.length=405 2023-12-03T11:34:30.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.724+0000 7fde2d922800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:34:30.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.724+0000 7fde2d922800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:34:30.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.724+0000 7fde2d922800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:34:30.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.724+0000 7fde2d922800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:34:30.727 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.724+0000 7fde2d922800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 2023-12-03T11:34:30.728 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.725+0000 7fde2d922800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to be held by another RGW process; skipping for now 2023-12-03T11:34:30.728 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.726+0000 7fddeefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:34:30.729 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.728+0000 7fde2d922800 20 remove_watcher() i=0 2023-12-03T11:34:30.729 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.728+0000 7fde2d922800 2 removed watcher, disabling cache 2023-12-03T11:34:30.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.729+0000 7fde2d922800 20 remove_watcher() i=1 2023-12-03T11:34:30.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.730+0000 7fde2d922800 20 remove_watcher() i=2 2023-12-03T11:34:30.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.732+0000 7fde2d922800 20 remove_watcher() i=3 2023-12-03T11:34:30.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.732+0000 7fde2d922800 20 remove_watcher() i=4 2023-12-03T11:34:30.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.733+0000 7fde2d922800 20 remove_watcher() i=5 2023-12-03T11:34:30.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.734+0000 7fde2d922800 20 remove_watcher() i=6 2023-12-03T11:34:30.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:34:30.735+0000 7fde2d922800 20 remove_watcher() i=7 2023-12-03T11:34:30.741 INFO:tasks.workunit.client.0.smithi131.stderr:waiting 30 seconds for reshard lock to expire... 2023-12-03T11:35:00.758 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:35:00.795 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:00.795 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:00.810 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.809+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.812 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.811+0000 7fe9d611e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.812 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.811+0000 7fe9d611e800 20 realm 2023-12-03T11:35:00.812 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.811+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.811+0000 7fe9d611e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.811+0000 7fe9d611e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:00.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.811+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.811+0000 7fe9d611e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.813 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.811+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.812+0000 7fe9d611e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:00.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.812+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.813+0000 7fe9d611e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:00.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.813+0000 7fe9d611e800 20 searching for the correct realm 2023-12-03T11:35:00.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.824+0000 7fe9d3c25640 0 -- 172.21.15.131:0/74345464 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55f60be9f050 msgr2=0x55f60bea1440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:00.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.826+0000 7fe9d611e800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:00.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.826+0000 7fe9d611e800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:00.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.826+0000 7fe9d611e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:00.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.826+0000 7fe9d611e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:00.827 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.826+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.826+0000 7fe9d611e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.826+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 20 zone default found 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 4 Realm: () 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 20 zonegroup default 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.827+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.828+0000 7fe9d611e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.828+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.828+0000 7fe9d611e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.828+0000 7fe9d611e800 20 started sync module instance, tier type = 2023-12-03T11:35:00.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.828+0000 7fe9d611e800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:00.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.836+0000 7fe9d4426640 0 -- 172.21.15.131:0/74345464 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7fe9c8033040 msgr2=0x7fe9c8032410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:00.839 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.838+0000 7fe9d611e800 20 add_watcher() i=0 2023-12-03T11:35:00.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.838+0000 7fe9d611e800 20 add_watcher() i=1 2023-12-03T11:35:00.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.838+0000 7fe9d611e800 20 add_watcher() i=2 2023-12-03T11:35:00.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.838+0000 7fe9d611e800 20 add_watcher() i=3 2023-12-03T11:35:00.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.838+0000 7fe9d611e800 20 add_watcher() i=4 2023-12-03T11:35:00.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.838+0000 7fe9d611e800 20 add_watcher() i=5 2023-12-03T11:35:00.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.838+0000 7fe9d611e800 20 add_watcher() i=6 2023-12-03T11:35:00.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.839+0000 7fe9d611e800 20 add_watcher() i=7 2023-12-03T11:35:00.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.839+0000 7fe9d611e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:00.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.841+0000 7fe999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:00.843 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.841+0000 7fe9d611e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:00.843 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.841+0000 7fe9d611e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:00.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.848+0000 7fe9d611e800 5 note: GC not initialized 2023-12-03T11:35:00.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.848+0000 7fe910ff9640 20 reqs_thread_entry: start 2023-12-03T11:35:00.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.848+0000 7fe9d611e800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:00.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.848+0000 7fe9d611e800 20 Filter name: none 2023-12-03T11:35:00.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.848+0000 7fe9067fc640 20 reqs_thread_entry: start 2023-12-03T11:35:00.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.848+0000 7fe9d611e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2023-12-03T11:35:00.850 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.848+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.849+0000 7fe9d611e800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:35:00.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.849+0000 7fe9d611e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2023-12-03T11:35:00.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.849+0000 7fe9d611e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2023-12-03T11:35:00.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.849+0000 7fe9d611e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 : miss 2023-12-03T11:35:00.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.849+0000 7fe9d611e800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.849+0000 7fe9d611e800 20 rados_obj.operate() r=0 bl.length=405 2023-12-03T11:35:00.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.849+0000 7fe9d611e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:35:00.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.849+0000 7fe9d611e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:35:00.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.849+0000 7fe9d611e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:00.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.849+0000 7fe9d611e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:00.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.849+0000 7fe9d611e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 2023-12-03T11:35:00.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.851+0000 7fe9d611e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2023-12-03T11:35:00.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9d611e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:35:00.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9d611e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:35:00.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9d611e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:00.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9d611e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22, ofs0, ns] 2023-12-03T11:35:00.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791325 cookie 94515250235072 notifier 6482 bl.length()=877 2023-12-03T11:35:00.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:35:00.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9ba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:35:00.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9ba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:00.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9d611e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): orig_sources= new_sources= 2023-12-03T11:35:00.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9d611e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): potential sources added=[] removed=[] 2023-12-03T11:35:00.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9d611e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): orig_dests= new_dests= 2023-12-03T11:35:00.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.855+0000 7fe9d611e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): potential dests added=[] removed=[] 2023-12-03T11:35:00.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.857+0000 7fe9d611e800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22.2.0 2023-12-03T11:35:00.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.857+0000 7fe9d611e800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22.2.0 2023-12-03T11:35:00.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.857+0000 7fe9d611e800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22.2.1 2023-12-03T11:35:00.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.857+0000 7fe9d611e800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22.2.1 2023-12-03T11:35:00.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.857+0000 7fe9d611e800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22.0 2023-12-03T11:35:00.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.859+0000 7fe9d611e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 : hit (requested=0x17, cached=0x17) 2023-12-03T11:35:00.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.859+0000 7fe9d611e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 2023-12-03T11:35:00.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.860+0000 7fe9d611e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:35:00.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.860+0000 7fe9d611e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:35:00.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.860+0000 7fe9d611e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:00.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.860+0000 7fe9d611e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22, ofs0, ns] 2023-12-03T11:35:00.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.861+0000 7fe9b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791326 cookie 94515250235072 notifier 6482 bl.length()=845 2023-12-03T11:35:00.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.861+0000 7fe9b9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 info.flags=0x17 2023-12-03T11:35:00.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.861+0000 7fe9b9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 to cache LRU end 2023-12-03T11:35:00.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.861+0000 7fe9b9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:00.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.861+0000 7fe9d611e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): orig_sources= new_sources= 2023-12-03T11:35:00.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.861+0000 7fe9d611e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): potential sources added=[] removed=[] 2023-12-03T11:35:00.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.861+0000 7fe9d611e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): orig_dests= new_dests= 2023-12-03T11:35:00.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.861+0000 7fe9d611e800 20 handle_bi_update(): bucket=:abort-at-block-writes[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22]): potential dests added=[] removed=[] 2023-12-03T11:35:00.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.862+0000 7fe9d611e800 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2023-12-03T11:35:00.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.864+0000 7fe999fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:00.867 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.866+0000 7fe9d611e800 20 remove_watcher() i=0 2023-12-03T11:35:00.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.866+0000 7fe9d611e800 2 removed watcher, disabling cache 2023-12-03T11:35:00.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.867+0000 7fe9d611e800 20 remove_watcher() i=1 2023-12-03T11:35:00.870 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.869+0000 7fe9d611e800 20 remove_watcher() i=2 2023-12-03T11:35:00.871 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.870+0000 7fe9d611e800 20 remove_watcher() i=3 2023-12-03T11:35:00.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.871+0000 7fe9d611e800 20 remove_watcher() i=4 2023-12-03T11:35:00.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.872+0000 7fe9d611e800 20 remove_watcher() i=5 2023-12-03T11:35:00.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.873+0000 7fe9d611e800 20 remove_watcher() i=6 2023-12-03T11:35:00.875 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.874+0000 7fe9d611e800 20 remove_watcher() i=7 2023-12-03T11:35:00.881 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2023-12-03T11:35:00.909 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:00.909 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:00.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.922+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.923+0000 7fc37a0e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.923+0000 7fc37a0e4800 20 realm 2023-12-03T11:35:00.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.923+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.924+0000 7fc37a0e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.924+0000 7fc37a0e4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:00.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.924+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.924+0000 7fc37a0e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.924+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.925+0000 7fc37a0e4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:00.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.925+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.925+0000 7fc37a0e4800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:00.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.925+0000 7fc37a0e4800 20 searching for the correct realm 2023-12-03T11:35:00.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.935+0000 7fc37a0e4800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:00.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.935+0000 7fc37a0e4800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:00.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.935+0000 7fc37a0e4800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:00.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.935+0000 7fc37a0e4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:00.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.935+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc3773e3640 0 -- 172.21.15.131:0/1732874337 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x5646437fe170 msgr2=0x564643800560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:00.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:00.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:00.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 20 zone default found 2023-12-03T11:35:00.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 4 Realm: () 2023-12-03T11:35:00.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:00.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:00.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:00.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 20 zonegroup default 2023-12-03T11:35:00.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.936+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.937+0000 7fc37a0e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.937+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.937+0000 7fc37a0e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.937+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.937+0000 7fc37a0e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.937+0000 7fc37a0e4800 20 started sync module instance, tier type = 2023-12-03T11:35:00.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.937+0000 7fc37a0e4800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:00.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.945+0000 7fc37a0e4800 20 add_watcher() i=0 2023-12-03T11:35:00.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.945+0000 7fc37a0e4800 20 add_watcher() i=1 2023-12-03T11:35:00.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.945+0000 7fc37a0e4800 20 add_watcher() i=2 2023-12-03T11:35:00.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.945+0000 7fc37a0e4800 20 add_watcher() i=3 2023-12-03T11:35:00.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.945+0000 7fc37a0e4800 20 add_watcher() i=4 2023-12-03T11:35:00.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.945+0000 7fc37a0e4800 20 add_watcher() i=5 2023-12-03T11:35:00.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.946+0000 7fc3773e3640 0 -- 172.21.15.131:0/1732874337 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x564643807030 msgr2=0x564643809420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:00.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.946+0000 7fc37a0e4800 20 add_watcher() i=6 2023-12-03T11:35:00.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.947+0000 7fc37a0e4800 20 add_watcher() i=7 2023-12-03T11:35:00.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.947+0000 7fc37a0e4800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:00.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.948+0000 7fc33dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:00.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.949+0000 7fc37a0e4800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:00.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.949+0000 7fc37a0e4800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:00.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.954+0000 7fc37a0e4800 5 note: GC not initialized 2023-12-03T11:35:00.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.954+0000 7fc2b4ff9640 20 reqs_thread_entry: start 2023-12-03T11:35:00.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.954+0000 7fc37a0e4800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:00.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.955+0000 7fc37a0e4800 20 Filter name: none 2023-12-03T11:35:00.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.955+0000 7fc2aa7fc640 20 reqs_thread_entry: start 2023-12-03T11:35:00.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.955+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.955+0000 7fc37a0e4800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:35:00.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.955+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.956+0000 7fc37a0e4800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:35:00.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.956+0000 7fc37a0e4800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:00.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.956+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.956+0000 7fc37a0e4800 20 rados_obj.operate() r=0 bl.length=189 2023-12-03T11:35:00.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.956+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.956+0000 7fc37a0e4800 20 rados_obj.operate() r=0 bl.length=373 2023-12-03T11:35:00.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.956+0000 7fc37a0e4800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:00.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.957+0000 7fc37a0e4800 20 rados->read ofs=0 len=0 2023-12-03T11:35:00.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.957+0000 7fc37a0e4800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:00.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.958+0000 7fc33dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:00.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.960+0000 7fc37a0e4800 20 remove_watcher() i=0 2023-12-03T11:35:00.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.960+0000 7fc37a0e4800 2 removed watcher, disabling cache 2023-12-03T11:35:00.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.961+0000 7fc37a0e4800 20 remove_watcher() i=1 2023-12-03T11:35:00.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.962+0000 7fc37a0e4800 20 remove_watcher() i=2 2023-12-03T11:35:00.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.963+0000 7fc37a0e4800 20 remove_watcher() i=3 2023-12-03T11:35:00.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.963+0000 7fc37a0e4800 20 remove_watcher() i=4 2023-12-03T11:35:00.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.964+0000 7fc37a0e4800 20 remove_watcher() i=5 2023-12-03T11:35:00.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.965+0000 7fc37a0e4800 20 remove_watcher() i=6 2023-12-03T11:35:00.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:00.966+0000 7fc37a0e4800 20 remove_watcher() i=7 2023-12-03T11:35:00.972 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:00.972 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:00.972 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-block-writes id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.22 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:35:00.973 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:01.043 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2023-12-03T11:35:01.043 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:01.213 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:35:01.241 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:01.242 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:01.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.254+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.255+0000 7f16d0f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.255+0000 7f16d0f33800 20 realm 2023-12-03T11:35:01.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.255+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.255+0000 7f16d0f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.255+0000 7f16d0f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:01.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.255+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.256+0000 7f16d0f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.256+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.258 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.256+0000 7f16d0f33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:01.258 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.256+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.258 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.257+0000 7f16d0f33800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:01.258 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.257+0000 7f16d0f33800 20 searching for the correct realm 2023-12-03T11:35:01.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.266+0000 7f16d0f33800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:01.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.266+0000 7f16d0f33800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:01.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.266+0000 7f16d0f33800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:01.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.266+0000 7f16d0f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:01.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.266+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16cd3d8640 0 -- 172.21.15.131:0/2746036999 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55fd8302a340 msgr2=0x55fd8302c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:01.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:01.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:01.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 20 zone default found 2023-12-03T11:35:01.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 4 Realm: () 2023-12-03T11:35:01.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:01.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:01.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:01.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 20 zonegroup default 2023-12-03T11:35:01.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.267+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.268+0000 7f16d0f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.268+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.268+0000 7f16d0f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.268+0000 7f16d0f33800 20 started sync module instance, tier type = 2023-12-03T11:35:01.273 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.268+0000 7f16d0f33800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:01.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.276+0000 7f16ccbd7640 0 -- 172.21.15.131:0/2746036999 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7f16c006a8b0 msgr2=0x7f16c006c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:01.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.276+0000 7f16d0f33800 20 add_watcher() i=0 2023-12-03T11:35:01.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.276+0000 7f16d0f33800 20 add_watcher() i=1 2023-12-03T11:35:01.278 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.276+0000 7f16d0f33800 20 add_watcher() i=2 2023-12-03T11:35:01.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.276+0000 7f16d0f33800 20 add_watcher() i=3 2023-12-03T11:35:01.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.276+0000 7f16d0f33800 20 add_watcher() i=4 2023-12-03T11:35:01.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.276+0000 7f16d0f33800 20 add_watcher() i=5 2023-12-03T11:35:01.279 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.276+0000 7f16d0f33800 20 add_watcher() i=6 2023-12-03T11:35:01.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.279+0000 7f16d0f33800 20 add_watcher() i=7 2023-12-03T11:35:01.280 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.279+0000 7f16d0f33800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:01.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.280+0000 7f1692fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:01.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.280+0000 7f16d0f33800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:01.282 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.280+0000 7f16d0f33800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:01.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.286+0000 7f16d0f33800 5 note: GC not initialized 2023-12-03T11:35:01.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.286+0000 7f1601ffb640 20 reqs_thread_entry: start 2023-12-03T11:35:01.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.286+0000 7f16d0f33800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:01.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.286+0000 7f16d0f33800 20 Filter name: none 2023-12-03T11:35:01.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.287+0000 7f15f37fe640 20 reqs_thread_entry: start 2023-12-03T11:35:01.288 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.287+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.287+0000 7f16d0f33800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:01.289 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.287+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.288+0000 7f16d0f33800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:01.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.288+0000 7f16d0f33800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:01.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.288+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.288+0000 7f16d0f33800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:01.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.288+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.288+0000 7f16d0f33800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:01.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.288+0000 7f16d0f33800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:01.290 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.289+0000 7f16d0f33800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.291 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.289+0000 7f16d0f33800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.291 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.290+0000 7f1692fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:01.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.292+0000 7f16d0f33800 20 remove_watcher() i=0 2023-12-03T11:35:01.293 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.292+0000 7f16d0f33800 2 removed watcher, disabling cache 2023-12-03T11:35:01.294 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.293+0000 7f16d0f33800 20 remove_watcher() i=1 2023-12-03T11:35:01.295 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.294+0000 7f16d0f33800 20 remove_watcher() i=2 2023-12-03T11:35:01.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.294+0000 7f16d0f33800 20 remove_watcher() i=3 2023-12-03T11:35:01.296 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.295+0000 7f16d0f33800 20 remove_watcher() i=4 2023-12-03T11:35:01.297 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.296+0000 7f16d0f33800 20 remove_watcher() i=5 2023-12-03T11:35:01.299 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.297+0000 7f16d0f33800 20 remove_watcher() i=6 2023-12-03T11:35:01.300 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.299+0000 7f16d0f33800 20 remove_watcher() i=7 2023-12-03T11:35:01.305 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:01.305 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:01.305 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-commit-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:35:01.305 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:01.306 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2023-12-03T11:35:01.338 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:01.338 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:01.352 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.351+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.352+0000 7fad27533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.352+0000 7fad27533800 20 realm 2023-12-03T11:35:01.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.352+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.352+0000 7fad27533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.352+0000 7fad27533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:01.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.352+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.353+0000 7fad27533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.354 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.353+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.353+0000 7fad27533800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:01.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.353+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.354+0000 7fad27533800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:01.355 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.354+0000 7fad27533800 20 searching for the correct realm 2023-12-03T11:35:01.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.363+0000 7fad231d7640 0 -- 172.21.15.131:0/1273224602 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5567f9742d30 msgr2=0x5567f9745120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:35:01.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.364+0000 7fad27533800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:01.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.364+0000 7fad27533800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:01.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.364+0000 7fad27533800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:01.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.364+0000 7fad27533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:01.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.364+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.366 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.364+0000 7fad27533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.366 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.364+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.364+0000 7fad27533800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.364+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 20 zone default found 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 4 Realm: () 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 20 zonegroup default 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.365+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.366+0000 7fad27533800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.366+0000 7fad27533800 20 started sync module instance, tier type = 2023-12-03T11:35:01.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.366+0000 7fad27533800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:01.373 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.372+0000 7fad239d8640 0 -- 172.21.15.131:0/1273224602 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7fad18026910 msgr2=0x7fad1800a440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:01.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.374+0000 7fad27533800 20 add_watcher() i=0 2023-12-03T11:35:01.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.374+0000 7fad27533800 20 add_watcher() i=1 2023-12-03T11:35:01.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.374+0000 7fad27533800 20 add_watcher() i=2 2023-12-03T11:35:01.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.374+0000 7fad27533800 20 add_watcher() i=3 2023-12-03T11:35:01.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.374+0000 7fad27533800 20 add_watcher() i=4 2023-12-03T11:35:01.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.374+0000 7fad27533800 20 add_watcher() i=5 2023-12-03T11:35:01.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.374+0000 7fad27533800 20 add_watcher() i=6 2023-12-03T11:35:01.377 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.375+0000 7fad27533800 20 add_watcher() i=7 2023-12-03T11:35:01.377 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.375+0000 7fad27533800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:01.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.377+0000 7face97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:01.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.377+0000 7fad27533800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:01.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.377+0000 7fad27533800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:01.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.383+0000 7fad27533800 5 note: GC not initialized 2023-12-03T11:35:01.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.383+0000 7fac57fff640 20 reqs_thread_entry: start 2023-12-03T11:35:01.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.383+0000 7fad27533800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:01.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 20 Filter name: none 2023-12-03T11:35:01.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fac55ffb640 20 reqs_thread_entry: start 2023-12-03T11:35:01.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-12-03T11:35:01.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:01.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-12-03T11:35:01.386 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-12-03T11:35:01.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 : miss 2023-12-03T11:35:01.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:01.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 info.flags=0x17 2023-12-03T11:35:01.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 to cache LRU end 2023-12-03T11:35:01.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:01.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:01.387 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.384+0000 7fad27533800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 2023-12-03T11:35:01.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.388+0000 7fad27533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 info.flags=0x17 2023-12-03T11:35:01.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.388+0000 7fad27533800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 to cache LRU end 2023-12-03T11:35:01.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.388+0000 7fad27533800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:01.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.388+0000 7fad27533800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23, ofs0, ns] 2023-12-03T11:35:01.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.388+0000 7fad09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791316 cookie 93905055187184 notifier 6542 bl.length()=893 2023-12-03T11:35:01.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.388+0000 7fad09ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 info.flags=0x17 2023-12-03T11:35:01.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.388+0000 7fad09ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 to cache LRU end 2023-12-03T11:35:01.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.388+0000 7fad09ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:01.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.389+0000 7fad27533800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): orig_sources= new_sources= 2023-12-03T11:35:01.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.389+0000 7fad27533800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): potential sources added=[] removed=[] 2023-12-03T11:35:01.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.389+0000 7fad27533800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): orig_dests= new_dests= 2023-12-03T11:35:01.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.389+0000 7fad27533800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): potential dests added=[] removed=[] 2023-12-03T11:35:01.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.390+0000 7fad27533800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23.1.0 2023-12-03T11:35:01.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.390+0000 7fad27533800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23.1.0 2023-12-03T11:35:01.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.390+0000 7fad27533800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23.1.1 2023-12-03T11:35:01.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.390+0000 7fad27533800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23.1.1 2023-12-03T11:35:01.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.390+0000 7fad27533800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23.0 2023-12-03T11:35:01.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.392+0000 7fad27533800 -1 Injecting error=-5 at location=commit_target_layout 2023-12-03T11:35:01.393 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.392+0000 7fad27533800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2023-12-03T11:35:01.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.395+0000 7face97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:01.398 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.397+0000 7fad27533800 20 remove_watcher() i=0 2023-12-03T11:35:01.398 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.397+0000 7fad27533800 2 removed watcher, disabling cache 2023-12-03T11:35:01.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.398+0000 7fad27533800 20 remove_watcher() i=1 2023-12-03T11:35:01.400 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.399+0000 7fad27533800 20 remove_watcher() i=2 2023-12-03T11:35:01.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.400+0000 7fad27533800 20 remove_watcher() i=3 2023-12-03T11:35:01.402 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.401+0000 7fad27533800 20 remove_watcher() i=4 2023-12-03T11:35:01.403 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.402+0000 7fad27533800 20 remove_watcher() i=5 2023-12-03T11:35:01.404 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.403+0000 7fad27533800 20 remove_watcher() i=6 2023-12-03T11:35:01.405 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.404+0000 7fad27533800 20 remove_watcher() i=7 2023-12-03T11:35:01.413 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:35:01.439 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:01.439 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:01.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.452+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.453+0000 7f52f7325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.453+0000 7f52f7325800 20 realm 2023-12-03T11:35:01.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.453+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.453+0000 7f52f7325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.453+0000 7f52f7325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:01.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.453+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.454+0000 7f52f7325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.454+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.454+0000 7f52f7325800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:01.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.454+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.455+0000 7f52f7325800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:01.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.455+0000 7f52f7325800 20 searching for the correct realm 2023-12-03T11:35:01.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.463+0000 7f52f30e5640 0 -- 172.21.15.131:0/1681676538 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f52ec082040 msgr2=0x7f52ec05bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:01.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.465+0000 7f52f7325800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:01.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.465+0000 7f52f7325800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:01.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.465+0000 7f52f7325800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:01.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.465+0000 7f52f7325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:01.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.465+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.465+0000 7f52f7325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.465+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:01.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:01.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 20 zone default found 2023-12-03T11:35:01.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 4 Realm: () 2023-12-03T11:35:01.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:01.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:01.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:01.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 20 zonegroup default 2023-12-03T11:35:01.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.466+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.467+0000 7f52f7325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.467+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.467+0000 7f52f7325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.467+0000 7f52f7325800 20 started sync module instance, tier type = 2023-12-03T11:35:01.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.467+0000 7f52f7325800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:01.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.472+0000 7f52f38e6640 0 -- 172.21.15.131:0/1681676538 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f52e803b950 msgr2=0x7f52e803a3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:01.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.476+0000 7f52f7325800 20 add_watcher() i=0 2023-12-03T11:35:01.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.476+0000 7f52f7325800 20 add_watcher() i=1 2023-12-03T11:35:01.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.476+0000 7f52f7325800 20 add_watcher() i=2 2023-12-03T11:35:01.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.476+0000 7f52f7325800 20 add_watcher() i=3 2023-12-03T11:35:01.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.476+0000 7f52f7325800 20 add_watcher() i=4 2023-12-03T11:35:01.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.476+0000 7f52f7325800 20 add_watcher() i=5 2023-12-03T11:35:01.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.476+0000 7f52f7325800 20 add_watcher() i=6 2023-12-03T11:35:01.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.477+0000 7f52f7325800 20 add_watcher() i=7 2023-12-03T11:35:01.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.477+0000 7f52f7325800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:01.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.478+0000 7f52b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:01.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.478+0000 7f52f7325800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:01.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.478+0000 7f52f7325800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:01.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.484+0000 7f52f7325800 5 note: GC not initialized 2023-12-03T11:35:01.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.484+0000 7f5227fff640 20 reqs_thread_entry: start 2023-12-03T11:35:01.486 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.484+0000 7f52f7325800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:01.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.485+0000 7f52f7325800 20 Filter name: none 2023-12-03T11:35:01.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.485+0000 7f5225ffb640 20 reqs_thread_entry: start 2023-12-03T11:35:01.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.485+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.485+0000 7f52f7325800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:01.487 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.485+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.486+0000 7f52f7325800 20 rados_obj.operate() r=0 bl.length=413 2023-12-03T11:35:01.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.486+0000 7f52f7325800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:01.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.486+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.486+0000 7f52f7325800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:01.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.486+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.486+0000 7f52f7325800 20 rados_obj.operate() r=0 bl.length=413 2023-12-03T11:35:01.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.486+0000 7f52f7325800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:01.488 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.487+0000 7f52f7325800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.487+0000 7f52f7325800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.489 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.488+0000 7f52b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:01.491 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.490+0000 7f52f7325800 20 remove_watcher() i=0 2023-12-03T11:35:01.491 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.490+0000 7f52f7325800 2 removed watcher, disabling cache 2023-12-03T11:35:01.492 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.491+0000 7f52f7325800 20 remove_watcher() i=1 2023-12-03T11:35:01.493 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.492+0000 7f52f7325800 20 remove_watcher() i=2 2023-12-03T11:35:01.494 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.493+0000 7f52f7325800 20 remove_watcher() i=3 2023-12-03T11:35:01.495 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.494+0000 7f52f7325800 20 remove_watcher() i=4 2023-12-03T11:35:01.496 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.495+0000 7f52f7325800 20 remove_watcher() i=5 2023-12-03T11:35:01.497 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.496+0000 7f52f7325800 20 remove_watcher() i=6 2023-12-03T11:35:01.498 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.497+0000 7f52f7325800 20 remove_watcher() i=7 2023-12-03T11:35:01.503 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:01.503 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:01.503 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-commit-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:35:01.503 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:01.553 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:35:01.583 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:01.583 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:01.596 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.595+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.597+0000 7f4220b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.597+0000 7f4220b22800 20 realm 2023-12-03T11:35:01.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.597+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.598 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.597+0000 7f4220b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.597+0000 7f4220b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:01.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.597+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.597+0000 7f4220b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.599 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.597+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.598+0000 7f4220b22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:01.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.598+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.598+0000 7f4220b22800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:01.600 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.598+0000 7f4220b22800 20 searching for the correct realm 2023-12-03T11:35:01.608 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.607+0000 7f421c87e640 0 -- 172.21.15.131:0/703612482 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f421805e040 msgr2=0x7f421805e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:35:01.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.609+0000 7f4220b22800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:01.611 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.609+0000 7f4220b22800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.609+0000 7f4220b22800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.609+0000 7f4220b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.609+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.609+0000 7f4220b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.609+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.609+0000 7f4220b22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.609+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 20 zone default found 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 4 Realm: () 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:01.612 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 20 zonegroup default 2023-12-03T11:35:01.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 20 started sync module instance, tier type = 2023-12-03T11:35:01.613 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.610+0000 7f4220b22800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:01.616 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.615+0000 7f421c87e640 0 -- 172.21.15.131:0/703612482 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f41f4079640 msgr2=0x7f41f407ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:35:01.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.619+0000 7f4220b22800 20 add_watcher() i=0 2023-12-03T11:35:01.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.619+0000 7f4220b22800 20 add_watcher() i=1 2023-12-03T11:35:01.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.619+0000 7f4220b22800 20 add_watcher() i=2 2023-12-03T11:35:01.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.619+0000 7f4220b22800 20 add_watcher() i=3 2023-12-03T11:35:01.620 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.619+0000 7f4220b22800 20 add_watcher() i=4 2023-12-03T11:35:01.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.619+0000 7f4220b22800 20 add_watcher() i=5 2023-12-03T11:35:01.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.619+0000 7f4220b22800 20 add_watcher() i=6 2023-12-03T11:35:01.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.620+0000 7f4220b22800 20 add_watcher() i=7 2023-12-03T11:35:01.621 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.620+0000 7f4220b22800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:01.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.622+0000 7f41e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:01.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.622+0000 7f4220b22800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:01.623 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.622+0000 7f4220b22800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:01.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.628+0000 7f4220b22800 5 note: GC not initialized 2023-12-03T11:35:01.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.628+0000 7f41517fa640 20 reqs_thread_entry: start 2023-12-03T11:35:01.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.628+0000 7f4220b22800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:01.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.628+0000 7f4220b22800 20 Filter name: none 2023-12-03T11:35:01.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.628+0000 7f414affd640 20 reqs_thread_entry: start 2023-12-03T11:35:01.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.628+0000 7f4220b22800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-12-03T11:35:01.630 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.628+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.629+0000 7f4220b22800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:01.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.629+0000 7f4220b22800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-12-03T11:35:01.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.629+0000 7f4220b22800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-12-03T11:35:01.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.629+0000 7f4220b22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 : miss 2023-12-03T11:35:01.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.629+0000 7f4220b22800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.629+0000 7f4220b22800 20 rados_obj.operate() r=0 bl.length=413 2023-12-03T11:35:01.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.629+0000 7f4220b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 info.flags=0x17 2023-12-03T11:35:01.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.629+0000 7f4220b22800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 to cache LRU end 2023-12-03T11:35:01.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.629+0000 7f4220b22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:01.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.629+0000 7f4220b22800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:01.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.629+0000 7f4220b22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 2023-12-03T11:35:01.632 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.631+0000 7f4220b22800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2023-12-03T11:35:01.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.634+0000 7f4220b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 info.flags=0x17 2023-12-03T11:35:01.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.634+0000 7f4220b22800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 to cache LRU end 2023-12-03T11:35:01.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.634+0000 7f4220b22800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:01.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.634+0000 7f4220b22800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23, ofs0, ns] 2023-12-03T11:35:01.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.635+0000 7f42067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791317 cookie 94579326616624 notifier 6912 bl.length()=893 2023-12-03T11:35:01.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.635+0000 7f42067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 info.flags=0x17 2023-12-03T11:35:01.636 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.635+0000 7f42067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 to cache LRU end 2023-12-03T11:35:01.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.635+0000 7f42067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:01.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.635+0000 7f4220b22800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): orig_sources= new_sources= 2023-12-03T11:35:01.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.635+0000 7f4220b22800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): potential sources added=[] removed=[] 2023-12-03T11:35:01.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.635+0000 7f4220b22800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): orig_dests= new_dests= 2023-12-03T11:35:01.637 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.635+0000 7f4220b22800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): potential dests added=[] removed=[] 2023-12-03T11:35:01.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.637+0000 7f4220b22800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23.2.0 2023-12-03T11:35:01.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.637+0000 7f4220b22800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23.2.0 2023-12-03T11:35:01.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.637+0000 7f4220b22800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23.2.1 2023-12-03T11:35:01.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.637+0000 7f4220b22800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23.2.1 2023-12-03T11:35:01.638 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.637+0000 7f4220b22800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23.0 2023-12-03T11:35:01.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.639+0000 7f4220b22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 : hit (requested=0x17, cached=0x17) 2023-12-03T11:35:01.640 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.639+0000 7f4220b22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 2023-12-03T11:35:01.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.640+0000 7f4220b22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 info.flags=0x17 2023-12-03T11:35:01.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.640+0000 7f4220b22800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 to cache LRU end 2023-12-03T11:35:01.641 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.640+0000 7f4220b22800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:01.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.640+0000 7f4220b22800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23, ofs0, ns] 2023-12-03T11:35:01.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.640+0000 7f42067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791318 cookie 94579326616624 notifier 6912 bl.length()=861 2023-12-03T11:35:01.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.640+0000 7f42067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 info.flags=0x17 2023-12-03T11:35:01.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.640+0000 7f42067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 to cache LRU end 2023-12-03T11:35:01.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.640+0000 7f42067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:01.642 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.641+0000 7f4220b22800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): orig_sources= new_sources= 2023-12-03T11:35:01.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.641+0000 7f4220b22800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): potential sources added=[] removed=[] 2023-12-03T11:35:01.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.641+0000 7f4220b22800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): orig_dests= new_dests= 2023-12-03T11:35:01.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.641+0000 7f4220b22800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23]): potential dests added=[] removed=[] 2023-12-03T11:35:01.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.642+0000 7f4220b22800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2023-12-03T11:35:01.644 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.643+0000 7f41e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:01.646 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.645+0000 7f4220b22800 20 remove_watcher() i=0 2023-12-03T11:35:01.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.645+0000 7f4220b22800 2 removed watcher, disabling cache 2023-12-03T11:35:01.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.646+0000 7f4220b22800 20 remove_watcher() i=1 2023-12-03T11:35:01.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.647+0000 7f4220b22800 20 remove_watcher() i=2 2023-12-03T11:35:01.649 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.648+0000 7f4220b22800 20 remove_watcher() i=3 2023-12-03T11:35:01.650 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.649+0000 7f4220b22800 20 remove_watcher() i=4 2023-12-03T11:35:01.651 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.650+0000 7f4220b22800 20 remove_watcher() i=5 2023-12-03T11:35:01.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.651+0000 7f4220b22800 20 remove_watcher() i=6 2023-12-03T11:35:01.653 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.652+0000 7f4220b22800 20 remove_watcher() i=7 2023-12-03T11:35:01.659 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:35:01.687 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:01.687 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:01.702 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.700+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.702+0000 7f931d337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.702+0000 7f931d337800 20 realm 2023-12-03T11:35:01.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.702+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.702+0000 7f931d337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.702+0000 7f931d337800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:01.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.702+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.702+0000 7f931d337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.704 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.703+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.703+0000 7f931d337800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:01.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.703+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.703+0000 7f931d337800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:01.705 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.703+0000 7f931d337800 20 searching for the correct realm 2023-12-03T11:35:01.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.710+0000 7f93190cd640 0 -- 172.21.15.131:0/921645873 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7f930403a8d0 msgr2=0x7f930401d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:35:01.917 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.915+0000 7f931d337800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:01.917 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.915+0000 7f931d337800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:01.917 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.915+0000 7f931d337800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:01.917 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.915+0000 7f931d337800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:01.917 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.915+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f93198ce640 0 -- 172.21.15.131:0/921645873 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x56291f4ed710 msgr2=0x56291f4efb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:01.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:01.918 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:01.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 20 zone default found 2023-12-03T11:35:01.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 4 Realm: () 2023-12-03T11:35:01.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:01.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:01.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:01.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 20 zonegroup default 2023-12-03T11:35:01.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.916+0000 7f931d337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.917+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.917+0000 7f931d337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.917+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.917+0000 7f931d337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.917+0000 7f931d337800 20 started sync module instance, tier type = 2023-12-03T11:35:01.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.917+0000 7f931d337800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:01.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.926+0000 7f931d337800 20 add_watcher() i=0 2023-12-03T11:35:01.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.926+0000 7f931d337800 20 add_watcher() i=1 2023-12-03T11:35:01.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.926+0000 7f931d337800 20 add_watcher() i=2 2023-12-03T11:35:01.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.926+0000 7f931d337800 20 add_watcher() i=3 2023-12-03T11:35:01.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.926+0000 7f931d337800 20 add_watcher() i=4 2023-12-03T11:35:01.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.926+0000 7f931d337800 20 add_watcher() i=5 2023-12-03T11:35:01.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.926+0000 7f931d337800 20 add_watcher() i=6 2023-12-03T11:35:01.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.927+0000 7f931d337800 20 add_watcher() i=7 2023-12-03T11:35:01.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.927+0000 7f931d337800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:01.930 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.929+0000 7f92defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:01.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.929+0000 7f931d337800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:01.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.929+0000 7f931d337800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:01.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.935+0000 7f931d337800 5 note: GC not initialized 2023-12-03T11:35:01.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.935+0000 7f924dffb640 20 reqs_thread_entry: start 2023-12-03T11:35:01.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.935+0000 7f931d337800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:01.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.935+0000 7f931d337800 20 Filter name: none 2023-12-03T11:35:01.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.935+0000 7f923f7fe640 20 reqs_thread_entry: start 2023-12-03T11:35:01.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.936+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.936+0000 7f931d337800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:01.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.936+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.937+0000 7f931d337800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:01.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.937+0000 7f931d337800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:01.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.937+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.937+0000 7f931d337800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:01.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.937+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.937+0000 7f931d337800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:01.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.937+0000 7f931d337800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:01.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.938+0000 7f931d337800 20 rados->read ofs=0 len=0 2023-12-03T11:35:01.939 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.938+0000 7f931d337800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:01.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.939+0000 7f92defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:01.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.941+0000 7f931d337800 20 remove_watcher() i=0 2023-12-03T11:35:01.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.941+0000 7f931d337800 2 removed watcher, disabling cache 2023-12-03T11:35:01.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.942+0000 7f931d337800 20 remove_watcher() i=1 2023-12-03T11:35:01.944 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.943+0000 7f931d337800 20 remove_watcher() i=2 2023-12-03T11:35:01.945 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.944+0000 7f931d337800 20 remove_watcher() i=3 2023-12-03T11:35:01.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.945+0000 7f931d337800 20 remove_watcher() i=4 2023-12-03T11:35:01.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.946+0000 7f931d337800 20 remove_watcher() i=5 2023-12-03T11:35:01.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.948+0000 7f931d337800 20 remove_watcher() i=6 2023-12-03T11:35:01.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:01.949+0000 7f931d337800 20 remove_watcher() i=7 2023-12-03T11:35:01.954 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:01.955 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:01.955 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-commit-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.23 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:35:01.955 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:02.028 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2023-12-03T11:35:02.028 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:02.188 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:35:02.214 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:02.214 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:02.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.227+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.229+0000 7fb563e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.229+0000 7fb563e16800 20 realm 2023-12-03T11:35:02.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.229+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.229+0000 7fb563e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.229+0000 7fb563e16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:02.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.229+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.229+0000 7fb563e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.229+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.230+0000 7fb563e16800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:02.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.230+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.230+0000 7fb563e16800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:02.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.230+0000 7fb563e16800 20 searching for the correct realm 2023-12-03T11:35:02.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.238+0000 7fb55f493640 0 -- 172.21.15.131:0/2234821867 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7fb55805e050 msgr2=0x7fb55809e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:02.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.240+0000 7fb563e16800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:02.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.240+0000 7fb563e16800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:02.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.240+0000 7fb563e16800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:02.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.240+0000 7fb563e16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:02.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.240+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.240+0000 7fb563e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.240+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.240+0000 7fb563e16800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:02.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.240+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:02.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 20 zone default found 2023-12-03T11:35:02.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 4 Realm: () 2023-12-03T11:35:02.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:02.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:02.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:02.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 20 zonegroup default 2023-12-03T11:35:02.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 20 started sync module instance, tier type = 2023-12-03T11:35:02.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.241+0000 7fb563e16800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:02.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.247+0000 7fb55f493640 0 -- 172.21.15.131:0/2234821867 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7fb538079670 msgr2=0x7fb53807baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:02.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.250+0000 7fb563e16800 20 add_watcher() i=0 2023-12-03T11:35:02.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.250+0000 7fb563e16800 20 add_watcher() i=1 2023-12-03T11:35:02.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.250+0000 7fb563e16800 20 add_watcher() i=2 2023-12-03T11:35:02.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.250+0000 7fb563e16800 20 add_watcher() i=3 2023-12-03T11:35:02.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.250+0000 7fb563e16800 20 add_watcher() i=4 2023-12-03T11:35:02.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.250+0000 7fb563e16800 20 add_watcher() i=5 2023-12-03T11:35:02.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.250+0000 7fb563e16800 20 add_watcher() i=6 2023-12-03T11:35:02.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.251+0000 7fb563e16800 20 add_watcher() i=7 2023-12-03T11:35:02.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.251+0000 7fb563e16800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:02.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.253+0000 7fb5257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:02.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.253+0000 7fb563e16800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:02.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.253+0000 7fb563e16800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:02.260 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.259+0000 7fb563e16800 5 note: GC not initialized 2023-12-03T11:35:02.261 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.259+0000 7fb493fff640 20 reqs_thread_entry: start 2023-12-03T11:35:02.261 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.259+0000 7fb563e16800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:02.261 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.259+0000 7fb563e16800 20 Filter name: none 2023-12-03T11:35:02.261 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.259+0000 7fb491ffb640 20 reqs_thread_entry: start 2023-12-03T11:35:02.261 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.259+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.260+0000 7fb563e16800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:02.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.260+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.260+0000 7fb563e16800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:02.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.260+0000 7fb563e16800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:02.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.260+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.261+0000 7fb563e16800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:02.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.261+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.261+0000 7fb563e16800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:02.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.261+0000 7fb563e16800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:02.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.261+0000 7fb563e16800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.262+0000 7fb563e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.262+0000 7fb5257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:02.265 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.264+0000 7fb563e16800 20 remove_watcher() i=0 2023-12-03T11:35:02.265 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.264+0000 7fb563e16800 2 removed watcher, disabling cache 2023-12-03T11:35:02.267 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.265+0000 7fb563e16800 20 remove_watcher() i=1 2023-12-03T11:35:02.267 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.266+0000 7fb563e16800 20 remove_watcher() i=2 2023-12-03T11:35:02.269 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.267+0000 7fb563e16800 20 remove_watcher() i=3 2023-12-03T11:35:02.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.268+0000 7fb563e16800 20 remove_watcher() i=4 2023-12-03T11:35:02.270 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.269+0000 7fb563e16800 20 remove_watcher() i=5 2023-12-03T11:35:02.271 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.270+0000 7fb563e16800 20 remove_watcher() i=6 2023-12-03T11:35:02.272 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.271+0000 7fb563e16800 20 remove_watcher() i=7 2023-12-03T11:35:02.277 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:02.277 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:02.277 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-commit-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:35:02.277 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:02.279 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2023-12-03T11:35:02.312 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:02.313 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:02.327 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.325+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.327+0000 7f947adab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.327+0000 7f947adab800 20 realm 2023-12-03T11:35:02.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.327+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.327+0000 7f947adab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.327+0000 7f947adab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:02.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.327+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.328+0000 7f947adab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.328+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.328+0000 7f947adab800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:02.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.328+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.329+0000 7f947adab800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:02.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.329+0000 7f947adab800 20 searching for the correct realm 2023-12-03T11:35:02.337 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.335+0000 7f94790ac640 0 -- 172.21.15.131:0/2343273059 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7f946805c040 msgr2=0x7f946805c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:02.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.338+0000 7f947adab800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:02.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.338+0000 7f947adab800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:02.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.338+0000 7f947adab800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:02.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.338+0000 7f947adab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:02.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.338+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.340 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:02.341 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:02.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 20 zone default found 2023-12-03T11:35:02.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 4 Realm: () 2023-12-03T11:35:02.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:02.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:02.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:02.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 20 zonegroup default 2023-12-03T11:35:02.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.339+0000 7f947adab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.342 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.340+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.340+0000 7f94780aa640 0 -- 172.21.15.131:0/2343273059 >> [v2:172.21.15.148:6800/4184359357,v1:172.21.15.148:6801/4184359357] conn(0x7f9460002440 msgr2=0x7f946c0583a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:35:02.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.340+0000 7f947adab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.340+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.340+0000 7f947adab800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.340+0000 7f947adab800 20 started sync module instance, tier type = 2023-12-03T11:35:02.343 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.340+0000 7f947adab800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:02.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.349+0000 7f947adab800 20 add_watcher() i=0 2023-12-03T11:35:02.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.349+0000 7f947adab800 20 add_watcher() i=1 2023-12-03T11:35:02.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.349+0000 7f947adab800 20 add_watcher() i=2 2023-12-03T11:35:02.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.349+0000 7f947adab800 20 add_watcher() i=3 2023-12-03T11:35:02.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.349+0000 7f947adab800 20 add_watcher() i=4 2023-12-03T11:35:02.350 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.349+0000 7f947adab800 20 add_watcher() i=5 2023-12-03T11:35:02.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.349+0000 7f947adab800 20 add_watcher() i=6 2023-12-03T11:35:02.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.350+0000 7f947adab800 20 add_watcher() i=7 2023-12-03T11:35:02.351 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.350+0000 7f947adab800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:02.352 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.351+0000 7f943efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:02.353 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.351+0000 7f947adab800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:02.353 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.351+0000 7f947adab800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:02.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.357+0000 7f947adab800 5 note: GC not initialized 2023-12-03T11:35:02.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.357+0000 7f947adab800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:02.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.357+0000 7f93adffb640 20 reqs_thread_entry: start 2023-12-03T11:35:02.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.357+0000 7f947adab800 20 Filter name: none 2023-12-03T11:35:02.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f939f7fe640 20 reqs_thread_entry: start 2023-12-03T11:35:02.360 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 : miss 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 info.flags=0x17 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 to cache LRU end 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:02.361 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.358+0000 7f947adab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 2023-12-03T11:35:02.363 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.362+0000 7f947adab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 info.flags=0x17 2023-12-03T11:35:02.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.362+0000 7f947adab800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 to cache LRU end 2023-12-03T11:35:02.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.362+0000 7f947adab800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:02.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.362+0000 7f947adab800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24, ofs0, ns] 2023-12-03T11:35:02.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.362+0000 7f945f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791321 cookie 93894131082736 notifier 6641 bl.length()=893 2023-12-03T11:35:02.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.362+0000 7f945f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 info.flags=0x17 2023-12-03T11:35:02.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.362+0000 7f945f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 to cache LRU end 2023-12-03T11:35:02.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.362+0000 7f945f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:02.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.363+0000 7f947adab800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24]): orig_sources= new_sources= 2023-12-03T11:35:02.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.363+0000 7f947adab800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24]): potential sources added=[] removed=[] 2023-12-03T11:35:02.364 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.363+0000 7f947adab800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24]): orig_dests= new_dests= 2023-12-03T11:35:02.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.363+0000 7f947adab800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24]): potential dests added=[] removed=[] 2023-12-03T11:35:02.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.364+0000 7f947adab800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24.1.0 2023-12-03T11:35:02.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.364+0000 7f947adab800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24.1.0 2023-12-03T11:35:02.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.364+0000 7f947adab800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24.1.1 2023-12-03T11:35:02.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.364+0000 7f947adab800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24.1.1 2023-12-03T11:35:02.365 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.364+0000 7f947adab800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24.0 2023-12-03T11:35:02.367 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.366+0000 7f947adab800 -1 Injecting error=-125 at location=commit_target_layout 2023-12-03T11:35:02.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.366+0000 7f947adab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 : hit (requested=0x17, cached=0x17) 2023-12-03T11:35:02.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.366+0000 7f947adab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 2023-12-03T11:35:02.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f947adab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 info.flags=0x17 2023-12-03T11:35:02.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f947adab800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 to cache LRU end 2023-12-03T11:35:02.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f947adab800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:02.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f947adab800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24, ofs0, ns] 2023-12-03T11:35:02.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f945f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791322 cookie 93894131082736 notifier 6641 bl.length()=861 2023-12-03T11:35:02.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f945f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 info.flags=0x17 2023-12-03T11:35:02.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f945f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 to cache LRU end 2023-12-03T11:35:02.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f945f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:02.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f947adab800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24]): orig_sources= new_sources= 2023-12-03T11:35:02.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f947adab800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24]): potential sources added=[] removed=[] 2023-12-03T11:35:02.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f947adab800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24]): orig_dests= new_dests= 2023-12-03T11:35:02.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.369+0000 7f947adab800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24]): potential dests added=[] removed=[] 2023-12-03T11:35:02.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.370+0000 7f947adab800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2023-12-03T11:35:02.373 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.372+0000 7f943efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:02.375 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.374+0000 7f947adab800 20 remove_watcher() i=0 2023-12-03T11:35:02.375 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.374+0000 7f947adab800 2 removed watcher, disabling cache 2023-12-03T11:35:02.376 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.375+0000 7f947adab800 20 remove_watcher() i=1 2023-12-03T11:35:02.377 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.376+0000 7f947adab800 20 remove_watcher() i=2 2023-12-03T11:35:02.378 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.377+0000 7f947adab800 20 remove_watcher() i=3 2023-12-03T11:35:02.379 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.378+0000 7f947adab800 20 remove_watcher() i=4 2023-12-03T11:35:02.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.379+0000 7f947adab800 20 remove_watcher() i=5 2023-12-03T11:35:02.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.380+0000 7f947adab800 20 remove_watcher() i=6 2023-12-03T11:35:02.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.381+0000 7f947adab800 20 remove_watcher() i=7 2023-12-03T11:35:02.388 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2023-12-03T11:35:02.415 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:02.415 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:02.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.427+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.429+0000 7fe719612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.429+0000 7fe719612800 20 realm 2023-12-03T11:35:02.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.429+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.429+0000 7fe719612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.429+0000 7fe719612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:02.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.429+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.429+0000 7fe719612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.429+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.430+0000 7fe719612800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:02.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.430+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.430+0000 7fe719612800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:02.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.430+0000 7fe719612800 20 searching for the correct realm 2023-12-03T11:35:02.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.441+0000 7fe719612800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:02.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.441+0000 7fe719612800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:02.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.441+0000 7fe719612800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:02.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.441+0000 7fe719612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:02.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.441+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.441+0000 7fe719612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.441+0000 7fe71552b640 0 -- 172.21.15.131:0/2268521314 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55e4100fb940 msgr2=0x55e4100fdd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:02.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.441+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:02.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:02.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 20 zone default found 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 4 Realm: () 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 20 zonegroup default 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.442+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.443+0000 7fe719612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.443+0000 7fe719612800 20 started sync module instance, tier type = 2023-12-03T11:35:02.445 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.443+0000 7fe719612800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:02.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.451+0000 7fe719612800 20 add_watcher() i=0 2023-12-03T11:35:02.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.451+0000 7fe719612800 20 add_watcher() i=1 2023-12-03T11:35:02.452 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.451+0000 7fe719612800 20 add_watcher() i=2 2023-12-03T11:35:02.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.451+0000 7fe719612800 20 add_watcher() i=3 2023-12-03T11:35:02.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.451+0000 7fe719612800 20 add_watcher() i=4 2023-12-03T11:35:02.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.451+0000 7fe719612800 20 add_watcher() i=5 2023-12-03T11:35:02.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.451+0000 7fe714529640 0 -- 172.21.15.131:0/2268521314 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55e4101046b0 msgr2=0x55e410106b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:02.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.451+0000 7fe719612800 20 add_watcher() i=6 2023-12-03T11:35:02.453 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.452+0000 7fe719612800 20 add_watcher() i=7 2023-12-03T11:35:02.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.452+0000 7fe719612800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:02.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.454+0000 7fe6dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:02.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.454+0000 7fe719612800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:02.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.454+0000 7fe719612800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:02.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.460+0000 7fe719612800 5 note: GC not initialized 2023-12-03T11:35:02.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.460+0000 7fe649ffb640 20 reqs_thread_entry: start 2023-12-03T11:35:02.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.460+0000 7fe719612800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:02.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.460+0000 7fe719612800 20 Filter name: none 2023-12-03T11:35:02.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.460+0000 7fe63b7fe640 20 reqs_thread_entry: start 2023-12-03T11:35:02.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.460+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.461+0000 7fe719612800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:02.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.461+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.461+0000 7fe719612800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:02.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.461+0000 7fe719612800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:02.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.461+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.461+0000 7fe719612800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:02.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.461+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.462+0000 7fe719612800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:02.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.462+0000 7fe719612800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:02.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.462+0000 7fe719612800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.462+0000 7fe719612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.463+0000 7fe6dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:02.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.465+0000 7fe719612800 20 remove_watcher() i=0 2023-12-03T11:35:02.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.465+0000 7fe719612800 2 removed watcher, disabling cache 2023-12-03T11:35:02.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.466+0000 7fe719612800 20 remove_watcher() i=1 2023-12-03T11:35:02.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.467+0000 7fe719612800 20 remove_watcher() i=2 2023-12-03T11:35:02.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.468+0000 7fe719612800 20 remove_watcher() i=3 2023-12-03T11:35:02.470 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.469+0000 7fe719612800 20 remove_watcher() i=4 2023-12-03T11:35:02.471 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.470+0000 7fe719612800 20 remove_watcher() i=5 2023-12-03T11:35:02.472 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.471+0000 7fe719612800 20 remove_watcher() i=6 2023-12-03T11:35:02.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.472+0000 7fe719612800 20 remove_watcher() i=7 2023-12-03T11:35:02.478 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:02.478 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:02.478 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-commit-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.24 num_objects: 20 size_kb: 1 num_shards: 2 2023-12-03T11:35:02.478 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:02.554 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard bucket with abort at commit_target_layout 2023-12-03T11:35:02.555 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:02.804 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-12-03T11:35:02.832 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:02.832 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:02.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.845+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.846+0000 7f367b32b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.847+0000 7f367b32b800 20 realm 2023-12-03T11:35:02.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.847+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.847+0000 7f367b32b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.847+0000 7f367b32b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:02.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.847+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.847+0000 7f367b32b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:02.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.847+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.848+0000 7f367b32b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:02.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.848+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:02.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.848+0000 7f367b32b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:02.849 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.848+0000 7f367b32b800 20 searching for the correct realm 2023-12-03T11:35:02.858 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:02.857+0000 7f36767d3640 0 -- 172.21.15.131:0/2706724515 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x7f3650079640 msgr2=0x7f365007ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:03.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.060+0000 7f367b32b800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:03.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.060+0000 7f367b32b800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:03.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.060+0000 7f367b32b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:03.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.060+0000 7f367b32b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:03.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.060+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.060+0000 7f367b32b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.060+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.062 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.060+0000 7f367b32b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:03.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.060+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 20 zone default found 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 4 Realm: () 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 20 zonegroup default 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 20 started sync module instance, tier type = 2023-12-03T11:35:03.065 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.061+0000 7f367b32b800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:03.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.066+0000 7f3676fd4640 0 -- 172.21.15.131:0/2706724515 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f367001f060 msgr2=0x7f36700807b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:03.071 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.070+0000 7f367b32b800 20 add_watcher() i=0 2023-12-03T11:35:03.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.070+0000 7f367b32b800 20 add_watcher() i=1 2023-12-03T11:35:03.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.070+0000 7f367b32b800 20 add_watcher() i=2 2023-12-03T11:35:03.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.070+0000 7f367b32b800 20 add_watcher() i=3 2023-12-03T11:35:03.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.070+0000 7f367b32b800 20 add_watcher() i=4 2023-12-03T11:35:03.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.070+0000 7f367b32b800 20 add_watcher() i=5 2023-12-03T11:35:03.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.070+0000 7f367b32b800 20 add_watcher() i=6 2023-12-03T11:35:03.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.071+0000 7f367b32b800 20 add_watcher() i=7 2023-12-03T11:35:03.072 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.071+0000 7f367b32b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:03.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.073+0000 7f35b7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:03.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.073+0000 7f367b32b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:03.074 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.073+0000 7f367b32b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:03.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.079+0000 7f367b32b800 5 note: GC not initialized 2023-12-03T11:35:03.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.079+0000 7f35a6ffd640 20 reqs_thread_entry: start 2023-12-03T11:35:03.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.079+0000 7f367b32b800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:03.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.079+0000 7f367b32b800 20 Filter name: none 2023-12-03T11:35:03.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.079+0000 7f35a4ff9640 20 reqs_thread_entry: start 2023-12-03T11:35:03.081 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.079+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.080+0000 7f367b32b800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:03.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.080+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.080+0000 7f367b32b800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:03.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.080+0000 7f367b32b800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:03.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.080+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.081+0000 7f367b32b800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:03.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.081+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.081+0000 7f367b32b800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:03.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.081+0000 7f367b32b800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:03.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.082+0000 7f367b32b800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.082+0000 7f367b32b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.082+0000 7f35b7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:03.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.084+0000 7f367b32b800 20 remove_watcher() i=0 2023-12-03T11:35:03.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.084+0000 7f367b32b800 2 removed watcher, disabling cache 2023-12-03T11:35:03.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.085+0000 7f367b32b800 20 remove_watcher() i=1 2023-12-03T11:35:03.088 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.087+0000 7f367b32b800 20 remove_watcher() i=2 2023-12-03T11:35:03.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.088+0000 7f367b32b800 20 remove_watcher() i=3 2023-12-03T11:35:03.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.089+0000 7f367b32b800 20 remove_watcher() i=4 2023-12-03T11:35:03.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.090+0000 7f367b32b800 20 remove_watcher() i=5 2023-12-03T11:35:03.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.091+0000 7f367b32b800 20 remove_watcher() i=6 2023-12-03T11:35:03.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.091+0000 7f367b32b800 20 remove_watcher() i=7 2023-12-03T11:35:03.097 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.097 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:03.098 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-commit-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:35:03.098 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.099 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2023-12-03T11:35:03.131 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:03.131 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:03.145 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.144+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.147 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.147 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.146+0000 7f6fff311800 20 realm 2023-12-03T11:35:03.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.146+0000 7f6fff311800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:03.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.148 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.147+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:03.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.147+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.147+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:03.149 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.147+0000 7f6fff311800 20 searching for the correct realm 2023-12-03T11:35:03.157 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.155+0000 7f6ff7fff640 0 -- 172.21.15.131:0/669958773 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55578598da70 msgr2=0x55578598fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:03.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:03.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:03.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:03.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:03.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:03.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:03.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 zone default found 2023-12-03T11:35:03.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 4 Realm: () 2023-12-03T11:35:03.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:03.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:03.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:03.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 zonegroup default 2023-12-03T11:35:03.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.159+0000 7f6fff311800 20 started sync module instance, tier type = 2023-12-03T11:35:03.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.159+0000 7f6fff311800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:03.164 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.162+0000 7f6ffd612640 0 -- 172.21.15.131:0/669958773 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7f6fec0030b0 msgr2=0x7f6fe8057240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:03.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=0 2023-12-03T11:35:03.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=1 2023-12-03T11:35:03.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=2 2023-12-03T11:35:03.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=3 2023-12-03T11:35:03.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=4 2023-12-03T11:35:03.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=5 2023-12-03T11:35:03.169 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=6 2023-12-03T11:35:03.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.169+0000 7f6fff311800 20 add_watcher() i=7 2023-12-03T11:35:03.170 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.169+0000 7f6fff311800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:03.172 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.170+0000 7f6fc27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:03.172 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.171+0000 7f6fff311800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:03.172 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.171+0000 7f6fff311800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:03.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.176+0000 7f6fff311800 5 note: GC not initialized 2023-12-03T11:35:03.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.177+0000 7f6f317fa640 20 reqs_thread_entry: start 2023-12-03T11:35:03.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.177+0000 7f6fff311800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:03.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.177+0000 7f6fff311800 20 Filter name: none 2023-12-03T11:35:03.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.177+0000 7f6f2affd640 20 reqs_thread_entry: start 2023-12-03T11:35:03.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.177+0000 7f6fff311800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:35:03.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.177+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.179 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.177+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:03.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.177+0000 7f6fff311800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:35:03.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.177+0000 7f6fff311800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:35:03.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.177+0000 7f6fff311800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 : miss 2023-12-03T11:35:03.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.177+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.178+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:03.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.178+0000 7f6fff311800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:03.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.178+0000 7f6fff311800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:03.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.178+0000 7f6fff311800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:03.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.178+0000 7f6fff311800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:03.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.178+0000 7f6fff311800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 2023-12-03T11:35:03.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.182+0000 7f6fff311800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:03.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.182+0000 7f6fff311800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:03.183 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.182+0000 7f6fff311800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:03.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.182+0000 7f6fff311800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25, ofs0, ns] 2023-12-03T11:35:03.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791393 cookie 93834391969744 notifier 7032 bl.length()=893 2023-12-03T11:35:03.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:03.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:03.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:03.184 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): orig_sources= new_sources= 2023-12-03T11:35:03.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): potential sources added=[] removed=[] 2023-12-03T11:35:03.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): orig_dests= new_dests= 2023-12-03T11:35:03.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): potential dests added=[] removed=[] 2023-12-03T11:35:03.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.184+0000 7f6fff311800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.0 2023-12-03T11:35:03.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.184+0000 7f6fff311800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.0 2023-12-03T11:35:03.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.184+0000 7f6fff311800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.1 2023-12-03T11:35:03.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.184+0000 7f6fff311800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.1 2023-12-03T11:35:03.185 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.184+0000 7f6fff311800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.0 2023-12-03T11:35:03.187 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6fff311800 time 2023-12-03T11:35:03.187549+0000 2023-12-03T11:35:03.187 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:35:03.188 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:03.188 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7003d6eef8] 2023-12-03T11:35:03.188 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7003d6f0b6] 2023-12-03T11:35:03.188 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555783409a71] 2023-12-03T11:35:03.188 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5557834161d8] 2023-12-03T11:35:03.188 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:35:03.188 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f700163feb0] 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.187+0000 7f6fff311800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6fff311800 time 2023-12-03T11:35:03.187549+0000 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7003d6eef8] 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7003d6f0b6] 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555783409a71] 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5557834161d8] 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f700163feb0] 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:35:03.189 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:35:03.190 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.190 INFO:tasks.workunit.client.0.smithi131.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:35:03.190 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f6fff311800 thread_name:radosgw-admin 2023-12-03T11:35:03.205 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:03.205 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7001654db0] 2023-12-03T11:35:03.205 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f70016a154c] 2023-12-03T11:35:03.205 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:35:03.205 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:35:03.205 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7003d6ef52] 2023-12-03T11:35:03.205 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7003d6f0b6] 2023-12-03T11:35:03.205 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555783409a71] 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5557834161d8] 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f700163feb0] 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.187+0000 7f6fff311800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f6fff311800 thread_name:radosgw-admin 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7001654db0] 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f70016a154c] 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:35:03.206 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:35:03.207 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7003d6ef52] 2023-12-03T11:35:03.207 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7003d6f0b6] 2023-12-03T11:35:03.207 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555783409a71] 2023-12-03T11:35:03.207 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5557834161d8] 2023-12-03T11:35:03.207 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:35:03.207 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f700163feb0] 2023-12-03T11:35:03.207 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:35:03.207 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:35:03.207 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:35:03.207 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.208 INFO:tasks.workunit.client.0.smithi131.stderr:--- begin dump of recent events --- 2023-12-03T11:35:03.208 INFO:tasks.workunit.client.0.smithi131.stderr: -499> 2023-12-03T11:35:03.139+0000 7f6ff5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.208 INFO:tasks.workunit.client.0.smithi131.stderr: -498> 2023-12-03T11:35:03.139+0000 7f6ff5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:35:03.208 INFO:tasks.workunit.client.0.smithi131.stderr: -497> 2023-12-03T11:35:03.139+0000 7f6ff6ffd640 4 set_mon_vals no callback set 2023-12-03T11:35:03.208 INFO:tasks.workunit.client.0.smithi131.stderr: -496> 2023-12-03T11:35:03.139+0000 7f6ff5ffb640 10 monclient: dump: 2023-12-03T11:35:03.208 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.208 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.208 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.208 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.208 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.208 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr: -495> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 monclient: authenticate success, global_id 7026 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr: -494> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr: -493> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr: -492> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr: -491> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr: -490> 2023-12-03T11:35:03.139+0000 7f6fff311800 1 librados: init done 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr: -489> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: get_monmap_and_config 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr: -488> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: build_initial_monmap 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr: -487> 2023-12-03T11:35:03.139+0000 7f6fff311800 1 build_initial for_mkfs: 0 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr: -486> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: monmap: 2023-12-03T11:35:03.209 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr: -485> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding auth protocol: cephx 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr: -484> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding auth protocol: cephx 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr: -483> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding auth protocol: cephx 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr: -482> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr: -481> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.210 INFO:tasks.workunit.client.0.smithi131.stderr: -480> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -479> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -478> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -477> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -476> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -475> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -474> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -473> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -472> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -471> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -470> 2023-12-03T11:35:03.140+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -469> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient: init 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -468> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding auth protocol: cephx 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -467> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding auth protocol: cephx 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -466> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding auth protocol: cephx 2023-12-03T11:35:03.211 INFO:tasks.workunit.client.0.smithi131.stderr: -465> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -464> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -463> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -462> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -461> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -460> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -459> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -458> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -457> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -456> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -455> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -454> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -453> 2023-12-03T11:35:03.140+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -452> 2023-12-03T11:35:03.140+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.212 INFO:tasks.workunit.client.0.smithi131.stderr: -451> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 asok(0x555785736a10) register_command rotate-key cmddesc rotate-key hook 0x7ffee7047698 EEXIST 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -450> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -449> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -448> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-c con 0x5557859713b0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -447> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-b con 0x55578596ff40 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -446> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-a con 0x55578596ed50 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -445> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -444> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -443> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -442> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -441> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): authenticate will time out at 1594.519249s 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -440> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): get_auth_request con 0x5557859713b0 auth_method 0 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -439> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -438> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -437> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.213 INFO:tasks.workunit.client.0.smithi131.stderr: -436> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request con 0x55578596ed50 auth_method 0 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -435> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -434> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -433> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -432> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -431> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -430> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -429> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -428> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -427> 2023-12-03T11:35:03.141+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -426> 2023-12-03T11:35:03.141+0000 7f6ffce11640 10 monclient(hunting): get_auth_request con 0x55578596ff40 auth_method 0 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -425> 2023-12-03T11:35:03.141+0000 7f6ffce11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -424> 2023-12-03T11:35:03.141+0000 7f6ffce11640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.214 INFO:tasks.workunit.client.0.smithi131.stderr: -423> 2023-12-03T11:35:03.141+0000 7f6ffce11640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr: -422> 2023-12-03T11:35:03.141+0000 7f6ffd612640 10 monclient(hunting): handle_auth_done global_id 6695 payload 274 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr: -421> 2023-12-03T11:35:03.141+0000 7f6ffd612640 10 monclient: _finish_hunting 0 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr: -420> 2023-12-03T11:35:03.141+0000 7f6ffd612640 1 monclient: found mon.noname-c 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr: -419> 2023-12-03T11:35:03.141+0000 7f6ffd612640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr: -418> 2023-12-03T11:35:03.141+0000 7f6ff5ffb640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr: -417> 2023-12-03T11:35:03.141+0000 7f6ff5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr: -416> 2023-12-03T11:35:03.141+0000 7f6ff5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr: -415> 2023-12-03T11:35:03.141+0000 7f6ffce11640 10 monclient: get_auth_request con 0x7f6fe0069820 auth_method 0 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr: -414> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr: -413> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr: -412> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: dump: 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.215 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr: -411> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: _finish_auth 0 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr: -410> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: _check_auth_tickets 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr: -409> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 monclient: authenticate success, global_id 6695 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr: -408> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr: -407> 2023-12-03T11:35:03.141+0000 7f6fff311800 10 monclient: get_monmap_and_config success 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr: -406> 2023-12-03T11:35:03.141+0000 7f6fff311800 4 set_mon_vals no callback set 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr: -405> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr: -404> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr: -403> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: dump: 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.216 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr: -402> 2023-12-03T11:35:03.141+0000 7f6fff311800 10 monclient: shutdown 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr: -401> 2023-12-03T11:35:03.141+0000 7f6fff311800 10 monclient: build_initial_monmap 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr: -400> 2023-12-03T11:35:03.141+0000 7f6fff311800 1 build_initial for_mkfs: 0 2023-12-03T11:35:03.217 INFO:tasks.workunit.client.0.smithi131.stderr: -399> 2023-12-03T11:35:03.141+0000 7f6fff311800 10 monclient: monmap: 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr: -398> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding auth protocol: cephx 2023-12-03T11:35:03.218 INFO:tasks.workunit.client.0.smithi131.stderr: -397> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding auth protocol: cephx 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -396> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding auth protocol: cephx 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -395> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -394> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -393> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -392> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -391> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -390> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -389> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -388> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -387> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -386> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -385> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -384> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -383> 2023-12-03T11:35:03.142+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -382> 2023-12-03T11:35:03.142+0000 7f6fff311800 1 librados: starting msgr at 2023-12-03T11:35:03.219 INFO:tasks.workunit.client.0.smithi131.stderr: -381> 2023-12-03T11:35:03.142+0000 7f6fff311800 1 librados: starting objecter 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -380> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 asok(0x555785736a10) register_command objecter_requests cmddesc objecter_requests hook 0x555785946410 EEXIST 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -379> 2023-12-03T11:35:03.142+0000 7f6fff311800 1 librados: setting wanted keys 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -378> 2023-12-03T11:35:03.142+0000 7f6fff311800 1 librados: calling monclient init 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -377> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient: init 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -376> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding auth protocol: cephx 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -375> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding auth protocol: cephx 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -374> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding auth protocol: cephx 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -373> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -372> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -371> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -370> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -369> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -368> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.220 INFO:tasks.workunit.client.0.smithi131.stderr: -367> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -366> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -365> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -364> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -363> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -362> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -361> 2023-12-03T11:35:03.142+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -360> 2023-12-03T11:35:03.142+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -359> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 asok(0x555785736a10) register_command rotate-key cmddesc rotate-key hook 0x55578593f420 EEXIST 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -358> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -357> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -356> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-b con 0x55578596ed50 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -355> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-c con 0x55578596ff40 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -354> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-a con 0x5557859713b0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -353> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.221 INFO:tasks.workunit.client.0.smithi131.stderr: -352> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -351> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -350> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -349> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): authenticate will time out at 1594.521327s 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -348> 2023-12-03T11:35:03.142+0000 7f6ffd612640 10 monclient(hunting): get_auth_request con 0x5557859713b0 auth_method 0 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -347> 2023-12-03T11:35:03.142+0000 7f6ffd612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -346> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -345> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -344> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request con 0x55578596ff40 auth_method 0 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -343> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -342> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -341> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -340> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -339> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -338> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.222 INFO:tasks.workunit.client.0.smithi131.stderr: -337> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): get_auth_request con 0x55578596ed50 auth_method 0 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -336> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -335> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -334> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -333> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -332> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -331> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -330> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -329> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -328> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -327> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): handle_auth_done global_id 7032 payload 824 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -326> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient: _finish_hunting 0 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -325> 2023-12-03T11:35:03.143+0000 7f6ffd612640 1 monclient: found mon.noname-a 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -324> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -323> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.223 INFO:tasks.workunit.client.0.smithi131.stderr: -322> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr: -321> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: dump: 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr: -320> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: _finish_auth 0 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr: -319> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: _check_auth_tickets 2023-12-03T11:35:03.224 INFO:tasks.workunit.client.0.smithi131.stderr: -318> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr: -317> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr: -316> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr: -315> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: dump: 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.225 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -314> 2023-12-03T11:35:03.143+0000 7f6fff311800 5 monclient: authenticate success, global_id 7032 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -313> 2023-12-03T11:35:03.143+0000 7f6fdeffd640 4 set_mon_vals no callback set 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -312> 2023-12-03T11:35:03.143+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -311> 2023-12-03T11:35:03.143+0000 7f6fff311800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -310> 2023-12-03T11:35:03.143+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -309> 2023-12-03T11:35:03.143+0000 7f6fff311800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -308> 2023-12-03T11:35:03.143+0000 7f6fff311800 1 librados: init done 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -307> 2023-12-03T11:35:03.144+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -306> 2023-12-03T11:35:03.145+0000 7f6fdd7fa640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -305> 2023-12-03T11:35:03.145+0000 7f6fdd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -304> 2023-12-03T11:35:03.145+0000 7f6fdd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -303> 2023-12-03T11:35:03.145+0000 7f6ffce11640 10 monclient: get_auth_request con 0x7f6fd8069820 auth_method 0 2023-12-03T11:35:03.226 INFO:tasks.workunit.client.0.smithi131.stderr: -302> 2023-12-03T11:35:03.145+0000 7f6ff7fff640 10 monclient: get_auth_request con 0x55578598da70 auth_method 0 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -301> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -300> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 realm 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -299> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -298> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -297> 2023-12-03T11:35:03.146+0000 7f6fff311800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -296> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -295> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -294> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -293> 2023-12-03T11:35:03.147+0000 7f6ffce11640 10 monclient: get_auth_request con 0x5557859918c0 auth_method 0 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -292> 2023-12-03T11:35:03.147+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -291> 2023-12-03T11:35:03.147+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -290> 2023-12-03T11:35:03.147+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -289> 2023-12-03T11:35:03.147+0000 7f6fff311800 20 searching for the correct realm 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -288> 2023-12-03T11:35:03.148+0000 7f6ff7fff640 10 monclient: get_auth_request con 0x555785996900 auth_method 0 2023-12-03T11:35:03.227 INFO:tasks.workunit.client.0.smithi131.stderr: -287> 2023-12-03T11:35:03.148+0000 7f6ffd612640 10 monclient: get_auth_request con 0x7f6fec0030b0 auth_method 0 2023-12-03T11:35:03.228 INFO:tasks.workunit.client.0.smithi131.stderr: -286> 2023-12-03T11:35:03.149+0000 7f6ffce11640 10 monclient: get_auth_request con 0x7f6ff802e060 auth_method 0 2023-12-03T11:35:03.228 INFO:tasks.workunit.client.0.smithi131.stderr: -285> 2023-12-03T11:35:03.149+0000 7f6ff7fff640 10 monclient: get_auth_request con 0x7f6ff0071070 auth_method 0 2023-12-03T11:35:03.228 INFO:tasks.workunit.client.0.smithi131.stderr: -284> 2023-12-03T11:35:03.151+0000 7f6ffd612640 10 monclient: get_auth_request con 0x7f6fe8058540 auth_method 0 2023-12-03T11:35:03.228 INFO:tasks.workunit.client.0.smithi131.stderr: -283> 2023-12-03T11:35:03.153+0000 7f6ffce11640 10 monclient: get_auth_request con 0x7f6fe80577d0 auth_method 0 2023-12-03T11:35:03.228 INFO:tasks.workunit.client.0.smithi131.stderr: -282> 2023-12-03T11:35:03.155+0000 7f6ff7fff640 0 -- 172.21.15.131:0/669958773 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55578598da70 msgr2=0x55578598fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:03.228 INFO:tasks.workunit.client.0.smithi131.stderr: -281> 2023-12-03T11:35:03.156+0000 7f6fdd7fa640 1 client.7032.objecter ms_handle_reset 0x55578598da70 session 0x55578575e3a0 osd.1 2023-12-03T11:35:03.228 INFO:tasks.workunit.client.0.smithi131.stderr: -280> 2023-12-03T11:35:03.156+0000 7f6fdd7fa640 10 monclient: _renew_subs 2023-12-03T11:35:03.228 INFO:tasks.workunit.client.0.smithi131.stderr: -279> 2023-12-03T11:35:03.156+0000 7f6fdd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.228 INFO:tasks.workunit.client.0.smithi131.stderr: -278> 2023-12-03T11:35:03.156+0000 7f6ff7fff640 10 monclient: get_auth_request con 0x7f6fd8079640 auth_method 0 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -277> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -276> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -275> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -274> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -273> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -272> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -271> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -270> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -269> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -268> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -267> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 zone default found 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -266> 2023-12-03T11:35:03.158+0000 7f6fff311800 4 Realm: () 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -265> 2023-12-03T11:35:03.158+0000 7f6fff311800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -264> 2023-12-03T11:35:03.158+0000 7f6fff311800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:03.229 INFO:tasks.workunit.client.0.smithi131.stderr: -263> 2023-12-03T11:35:03.158+0000 7f6fff311800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -262> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 zonegroup default 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -261> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -260> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -259> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -258> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -257> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -256> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -255> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 started sync module instance, tier type = 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -254> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -253> 2023-12-03T11:35:03.162+0000 7f6ffd612640 0 -- 172.21.15.131:0/669958773 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7f6fec0030b0 msgr2=0x7f6fe8057240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -252> 2023-12-03T11:35:03.163+0000 7f6fdd7fa640 1 client.7032.objecter ms_handle_reset 0x7f6fec0030b0 session 0x7f6fe8057e20 osd.7 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -251> 2023-12-03T11:35:03.163+0000 7f6ffd612640 10 monclient: get_auth_request con 0x55578598da70 auth_method 0 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -250> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=0 2023-12-03T11:35:03.230 INFO:tasks.workunit.client.0.smithi131.stderr: -249> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=1 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -248> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=2 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -247> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=3 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -246> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=4 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -245> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=5 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -244> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=6 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -243> 2023-12-03T11:35:03.169+0000 7f6fff311800 20 add_watcher() i=7 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -242> 2023-12-03T11:35:03.169+0000 7f6fff311800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -241> 2023-12-03T11:35:03.170+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding auth protocol: cephx 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -240> 2023-12-03T11:35:03.170+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding auth protocol: cephx 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -239> 2023-12-03T11:35:03.170+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding auth protocol: cephx 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -238> 2023-12-03T11:35:03.170+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -237> 2023-12-03T11:35:03.170+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -236> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -235> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.231 INFO:tasks.workunit.client.0.smithi131.stderr: -234> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -233> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -232> 2023-12-03T11:35:03.170+0000 7f6fc27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -231> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -230> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -229> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -228> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -227> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -226> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -225> 2023-12-03T11:35:03.171+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -224> 2023-12-03T11:35:03.171+0000 7f6fff311800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -223> 2023-12-03T11:35:03.171+0000 7f6fff311800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -222> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 asok(0x555785736a10) register_command cache list hook 0x555785913fd0 2023-12-03T11:35:03.232 INFO:tasks.workunit.client.0.smithi131.stderr: -221> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 asok(0x555785736a10) register_command cache inspect hook 0x555785913fd0 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr: -220> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 asok(0x555785736a10) register_command cache erase hook 0x555785913fd0 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr: -219> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 asok(0x555785736a10) register_command cache zap hook 0x555785913fd0 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr: -218> 2023-12-03T11:35:03.171+0000 7f6fff311800 10 monclient: get_monmap_and_config 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr: -217> 2023-12-03T11:35:03.171+0000 7f6fff311800 10 monclient: build_initial_monmap 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr: -216> 2023-12-03T11:35:03.171+0000 7f6fff311800 1 build_initial for_mkfs: 0 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr: -215> 2023-12-03T11:35:03.171+0000 7f6fff311800 10 monclient: monmap: 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:03.233 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -214> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -213> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -212> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -211> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -210> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -209> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -208> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -207> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -206> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -205> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -204> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.234 INFO:tasks.workunit.client.0.smithi131.stderr: -203> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -202> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -201> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -200> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -199> 2023-12-03T11:35:03.171+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -198> 2023-12-03T11:35:03.171+0000 7f6fff311800 10 monclient: init 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -197> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding auth protocol: cephx 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -196> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding auth protocol: cephx 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -195> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding auth protocol: cephx 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -194> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -193> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -192> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -191> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.235 INFO:tasks.workunit.client.0.smithi131.stderr: -190> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -189> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -188> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -187> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -186> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -185> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -184> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -183> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -182> 2023-12-03T11:35:03.171+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -181> 2023-12-03T11:35:03.172+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -180> 2023-12-03T11:35:03.172+0000 7f6fff311800 5 asok(0x555785736a10) register_command rotate-key cmddesc rotate-key hook 0x7ffee7047c18 EEXIST 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -179> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -178> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient: _add_conns ranks=[0,1,2] 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -177> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-a con 0x5557859d4d90 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -176> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-b con 0x5557859d3fb0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:03.236 INFO:tasks.workunit.client.0.smithi131.stderr: -175> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-c con 0x5557859a38e0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -174> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -173> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -172> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -171> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -170> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): authenticate will time out at 1594.550669s 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -169> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): get_auth_request con 0x5557859d4d90 auth_method 0 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -168> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -167> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -166> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -165> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request con 0x5557859a38e0 auth_method 0 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -164> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -163> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -162> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.237 INFO:tasks.workunit.client.0.smithi131.stderr: -161> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.238 INFO:tasks.workunit.client.0.smithi131.stderr: -160> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.238 INFO:tasks.workunit.client.0.smithi131.stderr: -159> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.238 INFO:tasks.workunit.client.0.smithi131.stderr: -158> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.238 INFO:tasks.workunit.client.0.smithi131.stderr: -157> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.238 INFO:tasks.workunit.client.0.smithi131.stderr: -156> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.238 INFO:tasks.workunit.client.0.smithi131.stderr: -155> 2023-12-03T11:35:03.172+0000 7f6ffce11640 10 monclient(hunting): get_auth_request con 0x5557859d3fb0 auth_method 0 2023-12-03T11:35:03.238 INFO:tasks.workunit.client.0.smithi131.stderr: -154> 2023-12-03T11:35:03.172+0000 7f6ffce11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.238 INFO:tasks.workunit.client.0.smithi131.stderr: -153> 2023-12-03T11:35:03.172+0000 7f6ffce11640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.238 INFO:tasks.workunit.client.0.smithi131.stderr: -152> 2023-12-03T11:35:03.172+0000 7f6ffce11640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.238 INFO:tasks.workunit.client.0.smithi131.stderr: -151> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): handle_auth_done global_id 7035 payload 274 2023-12-03T11:35:03.238 INFO:tasks.workunit.client.0.smithi131.stderr: -150> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient: _finish_hunting 0 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr: -149> 2023-12-03T11:35:03.172+0000 7f6ffd612640 1 monclient: found mon.noname-a 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr: -148> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr: -147> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr: -146> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr: -145> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: dump: 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.239 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr: -144> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: _finish_auth 0 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr: -143> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: _check_auth_tickets 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr: -142> 2023-12-03T11:35:03.172+0000 7f6fff311800 5 monclient: authenticate success, global_id 7035 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr: -141> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr: -140> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient: get_monmap_and_config success 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr: -139> 2023-12-03T11:35:03.172+0000 7f6fff311800 4 set_mon_vals no callback set 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr: -138> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr: -137> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr: -136> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: dump: 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.240 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr: -135> 2023-12-03T11:35:03.173+0000 7f6fff311800 10 monclient: shutdown 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr: -134> 2023-12-03T11:35:03.173+0000 7f6fff311800 10 monclient: build_initial_monmap 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr: -133> 2023-12-03T11:35:03.173+0000 7f6fff311800 1 build_initial for_mkfs: 0 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr: -132> 2023-12-03T11:35:03.173+0000 7f6fff311800 10 monclient: monmap: 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:03.241 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr: -131> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr: -130> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr: -129> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr: -128> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr: -127> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr: -126> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr: -125> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr: -124> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.242 INFO:tasks.workunit.client.0.smithi131.stderr: -123> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -122> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -121> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -120> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -119> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -118> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -117> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -116> 2023-12-03T11:35:03.173+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -115> 2023-12-03T11:35:03.173+0000 7f6fff311800 1 librados: starting msgr at 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -114> 2023-12-03T11:35:03.173+0000 7f6fff311800 1 librados: starting objecter 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -113> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 asok(0x555785736a10) register_command objecter_requests cmddesc objecter_requests hook 0x5557859cd9a0 EEXIST 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -112> 2023-12-03T11:35:03.174+0000 7f6fff311800 1 librados: setting wanted keys 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -111> 2023-12-03T11:35:03.174+0000 7f6fff311800 1 librados: calling monclient init 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -110> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient: init 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -109> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding auth protocol: cephx 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -108> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding auth protocol: cephx 2023-12-03T11:35:03.243 INFO:tasks.workunit.client.0.smithi131.stderr: -107> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding auth protocol: cephx 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -106> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -105> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -104> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -103> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -102> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -101> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -100> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -99> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -98> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -97> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -96> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -95> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -94> 2023-12-03T11:35:03.174+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.244 INFO:tasks.workunit.client.0.smithi131.stderr: -93> 2023-12-03T11:35:03.174+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -92> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 asok(0x555785736a10) register_command rotate-key cmddesc rotate-key hook 0x5557859d5610 EEXIST 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -91> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -90> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -89> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-b con 0x5557859a38e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -88> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-c con 0x5557859d3fb0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -87> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-a con 0x5557859d4d90 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -86> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -85> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -84> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -83> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -82> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): authenticate will time out at 1594.553025s 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -81> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): get_auth_request con 0x5557859d3fb0 auth_method 0 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -80> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.245 INFO:tasks.workunit.client.0.smithi131.stderr: -79> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -78> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -77> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request con 0x5557859d4d90 auth_method 0 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -76> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -75> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -74> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -73> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -72> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -71> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -70> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -69> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -68> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -67> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2023-12-03T11:35:03.246 INFO:tasks.workunit.client.0.smithi131.stderr: -66> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient: _finish_hunting 0 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr: -65> 2023-12-03T11:35:03.174+0000 7f6ffce11640 1 monclient: found mon.noname-c 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr: -64> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr: -63> 2023-12-03T11:35:03.174+0000 7f6ffd612640 10 monclient: get_auth_request con 0x5557859a38e0 auth_method 0 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr: -62> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr: -61> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr: -60> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: dump: 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.247 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr: -59> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: _finish_auth 0 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr: -58> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: _check_auth_tickets 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr: -57> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr: -56> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr: -55> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr: -54> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: dump: 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.248 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.249 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.249 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.249 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.249 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.249 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.249 INFO:tasks.workunit.client.0.smithi131.stderr: -53> 2023-12-03T11:35:03.175+0000 7f6fff311800 5 monclient: authenticate success, global_id 6704 2023-12-03T11:35:03.249 INFO:tasks.workunit.client.0.smithi131.stderr: -52> 2023-12-03T11:35:03.175+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.249 INFO:tasks.workunit.client.0.smithi131.stderr: -51> 2023-12-03T11:35:03.175+0000 7f6fff311800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:03.249 INFO:tasks.workunit.client.0.smithi131.stderr: -50> 2023-12-03T11:35:03.175+0000 7f6fc1fe3640 4 set_mon_vals no callback set 2023-12-03T11:35:03.249 INFO:tasks.workunit.client.0.smithi131.stderr: -49> 2023-12-03T11:35:03.175+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.249 INFO:tasks.workunit.client.0.smithi131.stderr: -48> 2023-12-03T11:35:03.175+0000 7f6fff311800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -47> 2023-12-03T11:35:03.175+0000 7f6fff311800 1 librados: init done 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -46> 2023-12-03T11:35:03.175+0000 7f6fff311800 5 asok(0x555785736a10) register_command cr dump hook 0x5557859e7058 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -45> 2023-12-03T11:35:03.176+0000 7f6f33fff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -44> 2023-12-03T11:35:03.176+0000 7f6f33fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -43> 2023-12-03T11:35:03.176+0000 7f6f33fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -42> 2023-12-03T11:35:03.176+0000 7f6fff311800 5 note: GC not initialized 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -41> 2023-12-03T11:35:03.177+0000 7f6f317fa640 20 reqs_thread_entry: start 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -40> 2023-12-03T11:35:03.177+0000 7f6ffd612640 10 monclient: get_auth_request con 0x7f6f38069820 auth_method 0 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -39> 2023-12-03T11:35:03.177+0000 7f6fff311800 5 asok(0x555785736a10) register_command sync trace show hook 0x7f6ff000b440 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -38> 2023-12-03T11:35:03.177+0000 7f6fff311800 5 asok(0x555785736a10) register_command sync trace history hook 0x7f6ff000b440 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -37> 2023-12-03T11:35:03.177+0000 7f6fff311800 5 asok(0x555785736a10) register_command sync trace active hook 0x7f6ff000b440 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -36> 2023-12-03T11:35:03.177+0000 7f6fff311800 5 asok(0x555785736a10) register_command sync trace active_short hook 0x7f6ff000b440 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -35> 2023-12-03T11:35:03.177+0000 7f6fff311800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:03.250 INFO:tasks.workunit.client.0.smithi131.stderr: -34> 2023-12-03T11:35:03.177+0000 7f6fff311800 20 Filter name: none 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -33> 2023-12-03T11:35:03.177+0000 7f6f2affd640 20 reqs_thread_entry: start 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -32> 2023-12-03T11:35:03.177+0000 7f6fff311800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -31> 2023-12-03T11:35:03.177+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -30> 2023-12-03T11:35:03.177+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -29> 2023-12-03T11:35:03.177+0000 7f6fff311800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -28> 2023-12-03T11:35:03.177+0000 7f6fff311800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -27> 2023-12-03T11:35:03.177+0000 7f6fff311800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 : miss 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -26> 2023-12-03T11:35:03.177+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -25> 2023-12-03T11:35:03.178+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -24> 2023-12-03T11:35:03.178+0000 7f6fff311800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -23> 2023-12-03T11:35:03.178+0000 7f6fff311800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -22> 2023-12-03T11:35:03.178+0000 7f6fff311800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -21> 2023-12-03T11:35:03.178+0000 7f6fff311800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -20> 2023-12-03T11:35:03.178+0000 7f6fff311800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 2023-12-03T11:35:03.251 INFO:tasks.workunit.client.0.smithi131.stderr: -19> 2023-12-03T11:35:03.178+0000 7f6ff7fff640 10 monclient: get_auth_request con 0x555785a22690 auth_method 0 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -18> 2023-12-03T11:35:03.182+0000 7f6fff311800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -17> 2023-12-03T11:35:03.182+0000 7f6fff311800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -16> 2023-12-03T11:35:03.182+0000 7f6fff311800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -15> 2023-12-03T11:35:03.182+0000 7f6fff311800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25, ofs0, ns] 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -14> 2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791393 cookie 93834391969744 notifier 7032 bl.length()=893 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -13> 2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -12> 2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -11> 2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -10> 2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): orig_sources= new_sources= 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -9> 2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): potential sources added=[] removed=[] 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -8> 2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): orig_dests= new_dests= 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -7> 2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): potential dests added=[] removed=[] 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -6> 2023-12-03T11:35:03.184+0000 7f6fff311800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.0 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -5> 2023-12-03T11:35:03.184+0000 7f6fff311800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.0 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -4> 2023-12-03T11:35:03.184+0000 7f6fff311800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.1 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -3> 2023-12-03T11:35:03.184+0000 7f6fff311800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.1 2023-12-03T11:35:03.252 INFO:tasks.workunit.client.0.smithi131.stderr: -2> 2023-12-03T11:35:03.184+0000 7f6fff311800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.0 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: -1> 2023-12-03T11:35:03.187+0000 7f6fff311800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6fff311800 time 2023-12-03T11:35:03.187549+0000 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7003d6eef8] 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7003d6f0b6] 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555783409a71] 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5557834161d8] 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f700163feb0] 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 0> 2023-12-03T11:35:03.187+0000 7f6fff311800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f6fff311800 thread_name:radosgw-admin 2023-12-03T11:35:03.253 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7001654db0] 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f70016a154c] 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7003d6ef52] 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7003d6f0b6] 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555783409a71] 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5557834161d8] 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f700163feb0] 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:35:03.254 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr:--- logging levels --- 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 none 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 lockdep 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 context 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 crush 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_balancer 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_locker 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log_expire 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_migrator 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 buffer 2023-12-03T11:35:03.255 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 timer 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 filer 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 striper 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 objecter 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rados 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_mirror 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_replay 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_pwl 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 journaler 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objectcacher 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 client 2023-12-03T11:35:03.256 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 osd 2023-12-03T11:35:03.257 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 optracker 2023-12-03T11:35:03.257 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objclass 2023-12-03T11:35:03.257 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 filestore 2023-12-03T11:35:03.257 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 journal 2023-12-03T11:35:03.257 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 ms 2023-12-03T11:35:03.257 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mon 2023-12-03T11:35:03.257 INFO:tasks.workunit.client.0.smithi131.stderr: 0/10 monc 2023-12-03T11:35:03.257 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 paxos 2023-12-03T11:35:03.257 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 tp 2023-12-03T11:35:03.257 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 auth 2023-12-03T11:35:03.257 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 crypto 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 finisher 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 reserver 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 heartbeatmap 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 perfcounter 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 20/20 rgw 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_sync 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_datacache 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_access 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_flight 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 javaclient 2023-12-03T11:35:03.258 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 asok 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 throttle 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 refs 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 compressor 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluestore 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluefs 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 bdev 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 kstore 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 4/ 5 rocksdb 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 fuse 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 2/ 5 mgr 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mgrc 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 dpdk 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 eventtrace 2023-12-03T11:35:03.259 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 prioritycache 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 test 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephsqlite 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_onode 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_odata 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_omap 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_tm 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_t 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:35:03.260 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_epm 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_lba 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cache 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_journal 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_device 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_backref 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 alienstore 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mclock 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cyanstore 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 ceph_exporter 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 memstore 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 trace 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: -2/-2 (syslog threshold) 2023-12-03T11:35:03.261 INFO:tasks.workunit.client.0.smithi131.stderr: 99/99 (stderr threshold) 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6f2affd640 / http_manager 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6f317fa640 / http_manager 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6f33fff640 / ms_dispatch 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6fc1fe3640 / io_context_pool 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6fc27e4640 / rgw_dt_lg_renew 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6fdd7fa640 / ms_dispatch 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6fdeffd640 / io_context_pool 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6ff5ffb640 / ms_dispatch 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6ff6ffd640 / io_context_pool 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6ff7fff640 / msgr-worker-2 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6ffce11640 / msgr-worker-1 2023-12-03T11:35:03.262 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6ffd612640 / msgr-worker-0 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6fff311800 / radosgw-admin 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr: max_recent 500 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr: max_new 1000 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr: log_file /var/log/ceph/ceph-client.admin.103889.log 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr:--- end dump of recent events --- 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr:--- begin dump of recent events --- 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr: -499> 2023-12-03T11:35:03.139+0000 7f6ff5ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr: -498> 2023-12-03T11:35:03.139+0000 7f6ff5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr: -497> 2023-12-03T11:35:03.139+0000 7f6ff6ffd640 4 set_mon_vals no callback set 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr: -496> 2023-12-03T11:35:03.139+0000 7f6ff5ffb640 10 monclient: dump: 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.263 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr: -495> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 monclient: authenticate success, global_id 7026 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr: -494> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr: -493> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr: -492> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr: -491> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr: -490> 2023-12-03T11:35:03.139+0000 7f6fff311800 1 librados: init done 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr: -489> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: get_monmap_and_config 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr: -488> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: build_initial_monmap 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr: -487> 2023-12-03T11:35:03.139+0000 7f6fff311800 1 build_initial for_mkfs: 0 2023-12-03T11:35:03.264 INFO:tasks.workunit.client.0.smithi131.stderr: -486> 2023-12-03T11:35:03.139+0000 7f6fff311800 10 monclient: monmap: 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr: -485> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding auth protocol: cephx 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr: -484> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding auth protocol: cephx 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr: -483> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding auth protocol: cephx 2023-12-03T11:35:03.265 INFO:tasks.workunit.client.0.smithi131.stderr: -482> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -481> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -480> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -479> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -478> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -477> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -476> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -475> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -474> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -473> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -472> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: crc 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -471> 2023-12-03T11:35:03.139+0000 7f6fff311800 5 AuthRegistry(0x555785940ee0) adding con mode: secure 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -470> 2023-12-03T11:35:03.140+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -469> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient: init 2023-12-03T11:35:03.266 INFO:tasks.workunit.client.0.smithi131.stderr: -468> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding auth protocol: cephx 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -467> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding auth protocol: cephx 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -466> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding auth protocol: cephx 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -465> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -464> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -463> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -462> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -461> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -460> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -459> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -458> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -457> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -456> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.267 INFO:tasks.workunit.client.0.smithi131.stderr: -455> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: crc 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -454> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047550) adding con mode: secure 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -453> 2023-12-03T11:35:03.140+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -452> 2023-12-03T11:35:03.140+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -451> 2023-12-03T11:35:03.140+0000 7f6fff311800 5 asok(0x555785736a10) register_command rotate-key cmddesc rotate-key hook 0x7ffee7047698 EEXIST 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -450> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -449> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -448> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-c con 0x5557859713b0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -447> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-b con 0x55578596ff40 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -446> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-a con 0x55578596ed50 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -445> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -444> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -443> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -442> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:03.268 INFO:tasks.workunit.client.0.smithi131.stderr: -441> 2023-12-03T11:35:03.140+0000 7f6fff311800 10 monclient(hunting): authenticate will time out at 1594.519249s 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -440> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): get_auth_request con 0x5557859713b0 auth_method 0 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -439> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -438> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -437> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -436> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request con 0x55578596ed50 auth_method 0 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -435> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -434> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -433> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -432> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -431> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -430> 2023-12-03T11:35:03.140+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -429> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.269 INFO:tasks.workunit.client.0.smithi131.stderr: -428> 2023-12-03T11:35:03.140+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -427> 2023-12-03T11:35:03.141+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -426> 2023-12-03T11:35:03.141+0000 7f6ffce11640 10 monclient(hunting): get_auth_request con 0x55578596ff40 auth_method 0 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -425> 2023-12-03T11:35:03.141+0000 7f6ffce11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -424> 2023-12-03T11:35:03.141+0000 7f6ffce11640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -423> 2023-12-03T11:35:03.141+0000 7f6ffce11640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -422> 2023-12-03T11:35:03.141+0000 7f6ffd612640 10 monclient(hunting): handle_auth_done global_id 6695 payload 274 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -421> 2023-12-03T11:35:03.141+0000 7f6ffd612640 10 monclient: _finish_hunting 0 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -420> 2023-12-03T11:35:03.141+0000 7f6ffd612640 1 monclient: found mon.noname-c 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -419> 2023-12-03T11:35:03.141+0000 7f6ffd612640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -418> 2023-12-03T11:35:03.141+0000 7f6ff5ffb640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -417> 2023-12-03T11:35:03.141+0000 7f6ff5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -416> 2023-12-03T11:35:03.141+0000 7f6ff5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.270 INFO:tasks.workunit.client.0.smithi131.stderr: -415> 2023-12-03T11:35:03.141+0000 7f6ffce11640 10 monclient: get_auth_request con 0x7f6fe0069820 auth_method 0 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr: -414> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr: -413> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr: -412> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: dump: 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr: -411> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: _finish_auth 0 2023-12-03T11:35:03.271 INFO:tasks.workunit.client.0.smithi131.stderr: -410> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: _check_auth_tickets 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr: -409> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 monclient: authenticate success, global_id 6695 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr: -408> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr: -407> 2023-12-03T11:35:03.141+0000 7f6fff311800 10 monclient: get_monmap_and_config success 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr: -406> 2023-12-03T11:35:03.141+0000 7f6fff311800 4 set_mon_vals no callback set 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr: -405> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr: -404> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr: -403> 2023-12-03T11:35:03.141+0000 7f6fdeffd640 10 monclient: dump: 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.272 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr: -402> 2023-12-03T11:35:03.141+0000 7f6fff311800 10 monclient: shutdown 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr: -401> 2023-12-03T11:35:03.141+0000 7f6fff311800 10 monclient: build_initial_monmap 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr: -400> 2023-12-03T11:35:03.141+0000 7f6fff311800 1 build_initial for_mkfs: 0 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr: -399> 2023-12-03T11:35:03.141+0000 7f6fff311800 10 monclient: monmap: 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:03.273 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -398> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding auth protocol: cephx 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -397> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding auth protocol: cephx 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -396> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding auth protocol: cephx 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -395> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -394> 2023-12-03T11:35:03.141+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -393> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -392> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -391> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -390> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -389> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -388> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -387> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -386> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -385> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: crc 2023-12-03T11:35:03.274 INFO:tasks.workunit.client.0.smithi131.stderr: -384> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x555785945570) adding con mode: secure 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -383> 2023-12-03T11:35:03.142+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -382> 2023-12-03T11:35:03.142+0000 7f6fff311800 1 librados: starting msgr at 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -381> 2023-12-03T11:35:03.142+0000 7f6fff311800 1 librados: starting objecter 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -380> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 asok(0x555785736a10) register_command objecter_requests cmddesc objecter_requests hook 0x555785946410 EEXIST 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -379> 2023-12-03T11:35:03.142+0000 7f6fff311800 1 librados: setting wanted keys 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -378> 2023-12-03T11:35:03.142+0000 7f6fff311800 1 librados: calling monclient init 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -377> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient: init 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -376> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding auth protocol: cephx 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -375> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding auth protocol: cephx 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -374> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding auth protocol: cephx 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -373> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -372> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -371> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -370> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.275 INFO:tasks.workunit.client.0.smithi131.stderr: -369> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -368> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -367> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -366> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -365> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -364> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -363> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: crc 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -362> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 AuthRegistry(0x55578593f2d8) adding con mode: secure 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -361> 2023-12-03T11:35:03.142+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -360> 2023-12-03T11:35:03.142+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -359> 2023-12-03T11:35:03.142+0000 7f6fff311800 5 asok(0x555785736a10) register_command rotate-key cmddesc rotate-key hook 0x55578593f420 EEXIST 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -358> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -357> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -356> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-b con 0x55578596ed50 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -355> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-c con 0x55578596ff40 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -354> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-a con 0x5557859713b0 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:03.276 INFO:tasks.workunit.client.0.smithi131.stderr: -353> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -352> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -351> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -350> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -349> 2023-12-03T11:35:03.142+0000 7f6fff311800 10 monclient(hunting): authenticate will time out at 1594.521327s 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -348> 2023-12-03T11:35:03.142+0000 7f6ffd612640 10 monclient(hunting): get_auth_request con 0x5557859713b0 auth_method 0 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -347> 2023-12-03T11:35:03.142+0000 7f6ffd612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -346> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -345> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -344> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request con 0x55578596ff40 auth_method 0 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -343> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -342> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -341> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -340> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.277 INFO:tasks.workunit.client.0.smithi131.stderr: -339> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -338> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -337> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): get_auth_request con 0x55578596ed50 auth_method 0 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -336> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -335> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -334> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -333> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -332> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -331> 2023-12-03T11:35:03.143+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -330> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -329> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -328> 2023-12-03T11:35:03.143+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -327> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient(hunting): handle_auth_done global_id 7032 payload 824 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -326> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient: _finish_hunting 0 2023-12-03T11:35:03.278 INFO:tasks.workunit.client.0.smithi131.stderr: -325> 2023-12-03T11:35:03.143+0000 7f6ffd612640 1 monclient: found mon.noname-a 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr: -324> 2023-12-03T11:35:03.143+0000 7f6ffd612640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr: -323> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr: -322> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr: -321> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: dump: 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.279 INFO:tasks.workunit.client.0.smithi131.stderr: -320> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: _finish_auth 0 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr: -319> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: _check_auth_tickets 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr: -318> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr: -317> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr: -316> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr: -315> 2023-12-03T11:35:03.143+0000 7f6fdd7fa640 10 monclient: dump: 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.280 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -314> 2023-12-03T11:35:03.143+0000 7f6fff311800 5 monclient: authenticate success, global_id 7032 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -313> 2023-12-03T11:35:03.143+0000 7f6fdeffd640 4 set_mon_vals no callback set 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -312> 2023-12-03T11:35:03.143+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -311> 2023-12-03T11:35:03.143+0000 7f6fff311800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -310> 2023-12-03T11:35:03.143+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -309> 2023-12-03T11:35:03.143+0000 7f6fff311800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -308> 2023-12-03T11:35:03.143+0000 7f6fff311800 1 librados: init done 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -307> 2023-12-03T11:35:03.144+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -306> 2023-12-03T11:35:03.145+0000 7f6fdd7fa640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -305> 2023-12-03T11:35:03.145+0000 7f6fdd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -304> 2023-12-03T11:35:03.145+0000 7f6fdd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -303> 2023-12-03T11:35:03.145+0000 7f6ffce11640 10 monclient: get_auth_request con 0x7f6fd8069820 auth_method 0 2023-12-03T11:35:03.281 INFO:tasks.workunit.client.0.smithi131.stderr: -302> 2023-12-03T11:35:03.145+0000 7f6ff7fff640 10 monclient: get_auth_request con 0x55578598da70 auth_method 0 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -301> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -300> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 realm 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -299> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -298> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -297> 2023-12-03T11:35:03.146+0000 7f6fff311800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -296> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -295> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -294> 2023-12-03T11:35:03.146+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -293> 2023-12-03T11:35:03.147+0000 7f6ffce11640 10 monclient: get_auth_request con 0x5557859918c0 auth_method 0 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -292> 2023-12-03T11:35:03.147+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -291> 2023-12-03T11:35:03.147+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -290> 2023-12-03T11:35:03.147+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:03.282 INFO:tasks.workunit.client.0.smithi131.stderr: -289> 2023-12-03T11:35:03.147+0000 7f6fff311800 20 searching for the correct realm 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -288> 2023-12-03T11:35:03.148+0000 7f6ff7fff640 10 monclient: get_auth_request con 0x555785996900 auth_method 0 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -287> 2023-12-03T11:35:03.148+0000 7f6ffd612640 10 monclient: get_auth_request con 0x7f6fec0030b0 auth_method 0 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -286> 2023-12-03T11:35:03.149+0000 7f6ffce11640 10 monclient: get_auth_request con 0x7f6ff802e060 auth_method 0 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -285> 2023-12-03T11:35:03.149+0000 7f6ff7fff640 10 monclient: get_auth_request con 0x7f6ff0071070 auth_method 0 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -284> 2023-12-03T11:35:03.151+0000 7f6ffd612640 10 monclient: get_auth_request con 0x7f6fe8058540 auth_method 0 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -283> 2023-12-03T11:35:03.153+0000 7f6ffce11640 10 monclient: get_auth_request con 0x7f6fe80577d0 auth_method 0 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -282> 2023-12-03T11:35:03.155+0000 7f6ff7fff640 0 -- 172.21.15.131:0/669958773 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55578598da70 msgr2=0x55578598fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -281> 2023-12-03T11:35:03.156+0000 7f6fdd7fa640 1 client.7032.objecter ms_handle_reset 0x55578598da70 session 0x55578575e3a0 osd.1 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -280> 2023-12-03T11:35:03.156+0000 7f6fdd7fa640 10 monclient: _renew_subs 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -279> 2023-12-03T11:35:03.156+0000 7f6fdd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -278> 2023-12-03T11:35:03.156+0000 7f6ff7fff640 10 monclient: get_auth_request con 0x7f6fd8079640 auth_method 0 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -277> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -276> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:03.283 INFO:tasks.workunit.client.0.smithi131.stderr: -275> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -274> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -273> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -272> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -271> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -270> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -269> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -268> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -267> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 zone default found 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -266> 2023-12-03T11:35:03.158+0000 7f6fff311800 4 Realm: () 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -265> 2023-12-03T11:35:03.158+0000 7f6fff311800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -264> 2023-12-03T11:35:03.158+0000 7f6fff311800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -263> 2023-12-03T11:35:03.158+0000 7f6fff311800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -262> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 zonegroup default 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -261> 2023-12-03T11:35:03.158+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.284 INFO:tasks.workunit.client.0.smithi131.stderr: -260> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -259> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -258> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -257> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -256> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -255> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 started sync module instance, tier type = 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -254> 2023-12-03T11:35:03.159+0000 7f6fff311800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -253> 2023-12-03T11:35:03.162+0000 7f6ffd612640 0 -- 172.21.15.131:0/669958773 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7f6fec0030b0 msgr2=0x7f6fe8057240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -252> 2023-12-03T11:35:03.163+0000 7f6fdd7fa640 1 client.7032.objecter ms_handle_reset 0x7f6fec0030b0 session 0x7f6fe8057e20 osd.7 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -251> 2023-12-03T11:35:03.163+0000 7f6ffd612640 10 monclient: get_auth_request con 0x55578598da70 auth_method 0 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -250> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=0 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -249> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=1 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -248> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=2 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -247> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=3 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -246> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=4 2023-12-03T11:35:03.285 INFO:tasks.workunit.client.0.smithi131.stderr: -245> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=5 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -244> 2023-12-03T11:35:03.168+0000 7f6fff311800 20 add_watcher() i=6 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -243> 2023-12-03T11:35:03.169+0000 7f6fff311800 20 add_watcher() i=7 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -242> 2023-12-03T11:35:03.169+0000 7f6fff311800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -241> 2023-12-03T11:35:03.170+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding auth protocol: cephx 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -240> 2023-12-03T11:35:03.170+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding auth protocol: cephx 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -239> 2023-12-03T11:35:03.170+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding auth protocol: cephx 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -238> 2023-12-03T11:35:03.170+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -237> 2023-12-03T11:35:03.170+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -236> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -235> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -234> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -233> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -232> 2023-12-03T11:35:03.170+0000 7f6fc27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -231> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.286 INFO:tasks.workunit.client.0.smithi131.stderr: -230> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -229> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -228> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -227> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: crc 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -226> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047f80) adding con mode: secure 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -225> 2023-12-03T11:35:03.171+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -224> 2023-12-03T11:35:03.171+0000 7f6fff311800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -223> 2023-12-03T11:35:03.171+0000 7f6fff311800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -222> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 asok(0x555785736a10) register_command cache list hook 0x555785913fd0 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -221> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 asok(0x555785736a10) register_command cache inspect hook 0x555785913fd0 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -220> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 asok(0x555785736a10) register_command cache erase hook 0x555785913fd0 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -219> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 asok(0x555785736a10) register_command cache zap hook 0x555785913fd0 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -218> 2023-12-03T11:35:03.171+0000 7f6fff311800 10 monclient: get_monmap_and_config 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -217> 2023-12-03T11:35:03.171+0000 7f6fff311800 10 monclient: build_initial_monmap 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -216> 2023-12-03T11:35:03.171+0000 7f6fff311800 1 build_initial for_mkfs: 0 2023-12-03T11:35:03.287 INFO:tasks.workunit.client.0.smithi131.stderr: -215> 2023-12-03T11:35:03.171+0000 7f6fff311800 10 monclient: monmap: 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr: -214> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr: -213> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr: -212> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr: -211> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.288 INFO:tasks.workunit.client.0.smithi131.stderr: -210> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -209> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -208> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -207> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -206> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -205> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -204> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -203> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -202> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -201> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -200> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -199> 2023-12-03T11:35:03.171+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -198> 2023-12-03T11:35:03.171+0000 7f6fff311800 10 monclient: init 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -197> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding auth protocol: cephx 2023-12-03T11:35:03.289 INFO:tasks.workunit.client.0.smithi131.stderr: -196> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding auth protocol: cephx 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -195> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding auth protocol: cephx 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -194> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -193> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -192> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -191> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -190> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -189> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -188> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -187> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -186> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -185> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -184> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: crc 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -183> 2023-12-03T11:35:03.171+0000 7f6fff311800 5 AuthRegistry(0x7ffee7047ad0) adding con mode: secure 2023-12-03T11:35:03.290 INFO:tasks.workunit.client.0.smithi131.stderr: -182> 2023-12-03T11:35:03.171+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -181> 2023-12-03T11:35:03.172+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -180> 2023-12-03T11:35:03.172+0000 7f6fff311800 5 asok(0x555785736a10) register_command rotate-key cmddesc rotate-key hook 0x7ffee7047c18 EEXIST 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -179> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -178> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient: _add_conns ranks=[0,1,2] 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -177> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-a con 0x5557859d4d90 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -176> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-b con 0x5557859d3fb0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -175> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-c con 0x5557859a38e0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -174> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -173> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -172> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -171> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -170> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient(hunting): authenticate will time out at 1594.550669s 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -169> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): get_auth_request con 0x5557859d4d90 auth_method 0 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -168> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.291 INFO:tasks.workunit.client.0.smithi131.stderr: -167> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -166> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -165> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request con 0x5557859a38e0 auth_method 0 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -164> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -163> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -162> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -161> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -160> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -159> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -158> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -157> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -156> 2023-12-03T11:35:03.172+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -155> 2023-12-03T11:35:03.172+0000 7f6ffce11640 10 monclient(hunting): get_auth_request con 0x5557859d3fb0 auth_method 0 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -154> 2023-12-03T11:35:03.172+0000 7f6ffce11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -153> 2023-12-03T11:35:03.172+0000 7f6ffce11640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -152> 2023-12-03T11:35:03.172+0000 7f6ffce11640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.292 INFO:tasks.workunit.client.0.smithi131.stderr: -151> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient(hunting): handle_auth_done global_id 7035 payload 274 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr: -150> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient: _finish_hunting 0 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr: -149> 2023-12-03T11:35:03.172+0000 7f6ffd612640 1 monclient: found mon.noname-a 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr: -148> 2023-12-03T11:35:03.172+0000 7f6ffd612640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr: -147> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr: -146> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr: -145> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: dump: 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.293 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr: -144> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: _finish_auth 0 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr: -143> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: _check_auth_tickets 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr: -142> 2023-12-03T11:35:03.172+0000 7f6fff311800 5 monclient: authenticate success, global_id 7035 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr: -141> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr: -140> 2023-12-03T11:35:03.172+0000 7f6fff311800 10 monclient: get_monmap_and_config success 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr: -139> 2023-12-03T11:35:03.172+0000 7f6fff311800 4 set_mon_vals no callback set 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr: -138> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr: -137> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr: -136> 2023-12-03T11:35:03.172+0000 7f6fc1fe3640 10 monclient: dump: 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.294 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr: -135> 2023-12-03T11:35:03.173+0000 7f6fff311800 10 monclient: shutdown 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr: -134> 2023-12-03T11:35:03.173+0000 7f6fff311800 10 monclient: build_initial_monmap 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr: -133> 2023-12-03T11:35:03.173+0000 7f6fff311800 1 build_initial for_mkfs: 0 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr: -132> 2023-12-03T11:35:03.173+0000 7f6fff311800 10 monclient: monmap: 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:03.295 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -131> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -130> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -129> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding auth protocol: cephx 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -128> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -127> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -126> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -125> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -124> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -123> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -122> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -121> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.296 INFO:tasks.workunit.client.0.smithi131.stderr: -120> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -119> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -118> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: crc 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -117> 2023-12-03T11:35:03.173+0000 7f6fff311800 5 AuthRegistry(0x5557859d2630) adding con mode: secure 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -116> 2023-12-03T11:35:03.173+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -115> 2023-12-03T11:35:03.173+0000 7f6fff311800 1 librados: starting msgr at 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -114> 2023-12-03T11:35:03.173+0000 7f6fff311800 1 librados: starting objecter 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -113> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 asok(0x555785736a10) register_command objecter_requests cmddesc objecter_requests hook 0x5557859cd9a0 EEXIST 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -112> 2023-12-03T11:35:03.174+0000 7f6fff311800 1 librados: setting wanted keys 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -111> 2023-12-03T11:35:03.174+0000 7f6fff311800 1 librados: calling monclient init 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -110> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient: init 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -109> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding auth protocol: cephx 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -108> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding auth protocol: cephx 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -107> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding auth protocol: cephx 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -106> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -105> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -104> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.297 INFO:tasks.workunit.client.0.smithi131.stderr: -103> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -102> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -101> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -100> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -99> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -98> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -97> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -96> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: crc 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -95> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 AuthRegistry(0x5557859d54c8) adding con mode: secure 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -94> 2023-12-03T11:35:03.174+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -93> 2023-12-03T11:35:03.174+0000 7f6fff311800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -92> 2023-12-03T11:35:03.174+0000 7f6fff311800 5 asok(0x555785736a10) register_command rotate-key cmddesc rotate-key hook 0x5557859d5610 EEXIST 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -91> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -90> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient: _add_conns ranks=[1,2,0] 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -89> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-b con 0x5557859a38e0 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:03.298 INFO:tasks.workunit.client.0.smithi131.stderr: -88> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-c con 0x5557859d3fb0 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -87> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): picked mon.noname-a con 0x5557859d4d90 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -86> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -85> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -84> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -83> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -82> 2023-12-03T11:35:03.174+0000 7f6fff311800 10 monclient(hunting): authenticate will time out at 1594.553025s 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -81> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): get_auth_request con 0x5557859d3fb0 auth_method 0 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -80> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -79> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -78> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -77> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request con 0x5557859d4d90 auth_method 0 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -76> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -75> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -74> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -73> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.299 INFO:tasks.workunit.client.0.smithi131.stderr: -72> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -71> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -70> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -69> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -68> 2023-12-03T11:35:03.174+0000 7f6ff7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -67> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -66> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient: _finish_hunting 0 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -65> 2023-12-03T11:35:03.174+0000 7f6ffce11640 1 monclient: found mon.noname-c 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -64> 2023-12-03T11:35:03.174+0000 7f6ffce11640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -63> 2023-12-03T11:35:03.174+0000 7f6ffd612640 10 monclient: get_auth_request con 0x5557859a38e0 auth_method 0 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -62> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -61> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr: -60> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: dump: 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.300 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr: -59> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: _finish_auth 0 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr: -58> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: _check_auth_tickets 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr: -57> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr: -56> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr: -55> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr: -54> 2023-12-03T11:35:03.175+0000 7f6f33fff640 10 monclient: dump: 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:03.301 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: -53> 2023-12-03T11:35:03.175+0000 7f6fff311800 5 monclient: authenticate success, global_id 6704 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: -52> 2023-12-03T11:35:03.175+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: -51> 2023-12-03T11:35:03.175+0000 7f6fff311800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: -50> 2023-12-03T11:35:03.175+0000 7f6fc1fe3640 4 set_mon_vals no callback set 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: -49> 2023-12-03T11:35:03.175+0000 7f6fff311800 10 monclient: _renew_subs 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: -48> 2023-12-03T11:35:03.175+0000 7f6fff311800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: -47> 2023-12-03T11:35:03.175+0000 7f6fff311800 1 librados: init done 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: -46> 2023-12-03T11:35:03.175+0000 7f6fff311800 5 asok(0x555785736a10) register_command cr dump hook 0x5557859e7058 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: -45> 2023-12-03T11:35:03.176+0000 7f6f33fff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: -44> 2023-12-03T11:35:03.176+0000 7f6f33fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.302 INFO:tasks.workunit.client.0.smithi131.stderr: -43> 2023-12-03T11:35:03.176+0000 7f6f33fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -42> 2023-12-03T11:35:03.176+0000 7f6fff311800 5 note: GC not initialized 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -41> 2023-12-03T11:35:03.177+0000 7f6f317fa640 20 reqs_thread_entry: start 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -40> 2023-12-03T11:35:03.177+0000 7f6ffd612640 10 monclient: get_auth_request con 0x7f6f38069820 auth_method 0 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -39> 2023-12-03T11:35:03.177+0000 7f6fff311800 5 asok(0x555785736a10) register_command sync trace show hook 0x7f6ff000b440 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -38> 2023-12-03T11:35:03.177+0000 7f6fff311800 5 asok(0x555785736a10) register_command sync trace history hook 0x7f6ff000b440 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -37> 2023-12-03T11:35:03.177+0000 7f6fff311800 5 asok(0x555785736a10) register_command sync trace active hook 0x7f6ff000b440 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -36> 2023-12-03T11:35:03.177+0000 7f6fff311800 5 asok(0x555785736a10) register_command sync trace active_short hook 0x7f6ff000b440 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -35> 2023-12-03T11:35:03.177+0000 7f6fff311800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -34> 2023-12-03T11:35:03.177+0000 7f6fff311800 20 Filter name: none 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -33> 2023-12-03T11:35:03.177+0000 7f6f2affd640 20 reqs_thread_entry: start 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -32> 2023-12-03T11:35:03.177+0000 7f6fff311800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -31> 2023-12-03T11:35:03.177+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -30> 2023-12-03T11:35:03.177+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -29> 2023-12-03T11:35:03.177+0000 7f6fff311800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -28> 2023-12-03T11:35:03.177+0000 7f6fff311800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:35:03.303 INFO:tasks.workunit.client.0.smithi131.stderr: -27> 2023-12-03T11:35:03.177+0000 7f6fff311800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 : miss 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -26> 2023-12-03T11:35:03.177+0000 7f6fff311800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -25> 2023-12-03T11:35:03.178+0000 7f6fff311800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -24> 2023-12-03T11:35:03.178+0000 7f6fff311800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -23> 2023-12-03T11:35:03.178+0000 7f6fff311800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -22> 2023-12-03T11:35:03.178+0000 7f6fff311800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -21> 2023-12-03T11:35:03.178+0000 7f6fff311800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -20> 2023-12-03T11:35:03.178+0000 7f6fff311800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -19> 2023-12-03T11:35:03.178+0000 7f6ff7fff640 10 monclient: get_auth_request con 0x555785a22690 auth_method 0 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -18> 2023-12-03T11:35:03.182+0000 7f6fff311800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -17> 2023-12-03T11:35:03.182+0000 7f6fff311800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -16> 2023-12-03T11:35:03.182+0000 7f6fff311800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -15> 2023-12-03T11:35:03.182+0000 7f6fff311800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25, ofs0, ns] 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -14> 2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791393 cookie 93834391969744 notifier 7032 bl.length()=893 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -13> 2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -12> 2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:03.304 INFO:tasks.workunit.client.0.smithi131.stderr: -11> 2023-12-03T11:35:03.182+0000 7f6fdeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: -10> 2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): orig_sources= new_sources= 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: -9> 2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): potential sources added=[] removed=[] 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: -8> 2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): orig_dests= new_dests= 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: -7> 2023-12-03T11:35:03.183+0000 7f6fff311800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): potential dests added=[] removed=[] 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: -6> 2023-12-03T11:35:03.184+0000 7f6fff311800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.0 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: -5> 2023-12-03T11:35:03.184+0000 7f6fff311800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.0 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: -4> 2023-12-03T11:35:03.184+0000 7f6fff311800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.1 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: -3> 2023-12-03T11:35:03.184+0000 7f6fff311800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.1 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: -2> 2023-12-03T11:35:03.184+0000 7f6fff311800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.0 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: -1> 2023-12-03T11:35:03.187+0000 7f6fff311800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f6fff311800 time 2023-12-03T11:35:03.187549+0000 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7003d6eef8] 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7003d6f0b6] 2023-12-03T11:35:03.305 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555783409a71] 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5557834161d8] 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7f700163feb0] 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 0> 2023-12-03T11:35:03.187+0000 7f6fff311800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7f6fff311800 thread_name:radosgw-admin 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f7001654db0] 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f70016a154c] 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:35:03.306 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7003d6ef52] 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7f7003d6f0b6] 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555783409a71] 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x5b8) [0x5557834161d8] 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7f700163feb0] 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr:--- logging levels --- 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 none 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 lockdep 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 context 2023-12-03T11:35:03.307 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 crush 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_balancer 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_locker 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log_expire 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_migrator 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 buffer 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 timer 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 filer 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 striper 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 objecter 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rados 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_mirror 2023-12-03T11:35:03.308 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_replay 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_pwl 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 journaler 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objectcacher 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 client 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 osd 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 optracker 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objclass 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 filestore 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 journal 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 ms 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mon 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 0/10 monc 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 paxos 2023-12-03T11:35:03.309 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 tp 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 auth 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 crypto 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 finisher 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 reserver 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 heartbeatmap 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 perfcounter 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 20/20 rgw 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_sync 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_datacache 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_access 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_flight 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 javaclient 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 asok 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 throttle 2023-12-03T11:35:03.310 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 refs 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 compressor 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluestore 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluefs 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 bdev 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 kstore 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 4/ 5 rocksdb 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 fuse 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 2/ 5 mgr 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mgrc 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 dpdk 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 eventtrace 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 prioritycache 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 test 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephsqlite 2023-12-03T11:35:03.311 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_onode 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_odata 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_omap 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_tm 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_t 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_epm 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_lba 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cache 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_journal 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_device 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_backref 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 alienstore 2023-12-03T11:35:03.312 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mclock 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cyanstore 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 ceph_exporter 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 memstore 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 trace 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: -2/-2 (syslog threshold) 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 99/99 (stderr threshold) 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6f2affd640 / http_manager 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6f317fa640 / http_manager 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6f33fff640 / ms_dispatch 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6fc1fe3640 / io_context_pool 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6fc27e4640 / rgw_dt_lg_renew 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6fdd7fa640 / ms_dispatch 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6fdeffd640 / io_context_pool 2023-12-03T11:35:03.313 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6ff5ffb640 / ms_dispatch 2023-12-03T11:35:03.314 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6ff6ffd640 / io_context_pool 2023-12-03T11:35:03.314 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6ff7fff640 / msgr-worker-2 2023-12-03T11:35:03.314 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6ffce11640 / msgr-worker-1 2023-12-03T11:35:03.314 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6ffd612640 / msgr-worker-0 2023-12-03T11:35:03.314 INFO:tasks.workunit.client.0.smithi131.stderr: 7f6fff311800 / radosgw-admin 2023-12-03T11:35:03.314 INFO:tasks.workunit.client.0.smithi131.stderr: max_recent 500 2023-12-03T11:35:03.314 INFO:tasks.workunit.client.0.smithi131.stderr: max_new 1000 2023-12-03T11:35:03.314 INFO:tasks.workunit.client.0.smithi131.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:35:03.188867Z_86061693-f921-4632-8c3f-0ac4dd7fbdbc/log 2023-12-03T11:35:03.314 INFO:tasks.workunit.client.0.smithi131.stderr:--- end dump of recent events --- 2023-12-03T11:35:03.314 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.234+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.236+0000 7f35e8d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.236+0000 7f35e8d24800 20 realm 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.236+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.236+0000 7f35e8d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.236+0000 7f35e8d24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.236+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.236+0000 7f35e8d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.236+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.237+0000 7f35e8d24800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.237+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.237+0000 7f35e8d24800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:03.320 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.237+0000 7f35e8d24800 20 searching for the correct realm 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.247+0000 7f35e4970640 0 -- 172.21.15.131:0/3962095650 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5601ba626800 msgr2=0x5601ba628c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.247+0000 7f35e8d24800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.247+0000 7f35e8d24800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.247+0000 7f35e8d24800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.247+0000 7f35e8d24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.247+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 20 zone default found 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 4 Realm: () 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:03.321 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 20 zonegroup default 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.248+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.249+0000 7f35e8d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.249+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.249+0000 7f35e8d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.249+0000 7f35e8d24800 20 started sync module instance, tier type = 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.249+0000 7f35e8d24800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.257+0000 7f35dffff640 0 -- 172.21.15.131:0/3962095650 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x5601ba62b850 msgr2=0x5601ba62dc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.258+0000 7f35e8d24800 20 add_watcher() i=0 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.258+0000 7f35e8d24800 20 add_watcher() i=1 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.258+0000 7f35e8d24800 20 add_watcher() i=2 2023-12-03T11:35:03.322 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.258+0000 7f35e8d24800 20 add_watcher() i=3 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.258+0000 7f35e8d24800 20 add_watcher() i=4 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.258+0000 7f35e8d24800 20 add_watcher() i=5 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.258+0000 7f35e8d24800 20 add_watcher() i=6 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.259+0000 7f35e8d24800 20 add_watcher() i=7 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.259+0000 7f35e8d24800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.260+0000 7f35aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.261+0000 7f35e8d24800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.261+0000 7f35e8d24800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.266+0000 7f35e8d24800 5 note: GC not initialized 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.267+0000 7f35197fa640 20 reqs_thread_entry: start 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.267+0000 7f35e8d24800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.267+0000 7f35e8d24800 20 Filter name: none 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.267+0000 7f3512ffd640 20 reqs_thread_entry: start 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.267+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.267+0000 7f35e8d24800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:03.323 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.267+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.268+0000 7f35e8d24800 20 rados_obj.operate() r=0 bl.length=413 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.268+0000 7f35e8d24800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.268+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.268+0000 7f35e8d24800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.268+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.268+0000 7f35e8d24800 20 rados_obj.operate() r=0 bl.length=413 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.268+0000 7f35e8d24800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.269+0000 7f35e8d24800 20 rados->read ofs=0 len=0 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.269+0000 7f35e8d24800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.270+0000 7f35aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.272+0000 7f35e8d24800 20 remove_watcher() i=0 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.272+0000 7f35e8d24800 2 removed watcher, disabling cache 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.273+0000 7f35e8d24800 20 remove_watcher() i=1 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.274+0000 7f35e8d24800 20 remove_watcher() i=2 2023-12-03T11:35:03.324 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.275+0000 7f35e8d24800 20 remove_watcher() i=3 2023-12-03T11:35:03.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.276+0000 7f35e8d24800 20 remove_watcher() i=4 2023-12-03T11:35:03.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.277+0000 7f35e8d24800 20 remove_watcher() i=5 2023-12-03T11:35:03.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.278+0000 7f35e8d24800 20 remove_watcher() i=6 2023-12-03T11:35:03.325 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:03.278+0000 7f35e8d24800 20 remove_watcher() i=7 2023-12-03T11:35:03.325 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:03.325 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:03.325 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-commit-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:35:03.325 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:33.364 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:35:33.396 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:33.397 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:33.412 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.411+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.413+0000 7efc1f937800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.413+0000 7efc1f937800 20 realm 2023-12-03T11:35:33.414 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.413+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.413+0000 7efc1f937800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.413+0000 7efc1f937800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:33.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.413+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.413+0000 7efc1f937800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.415 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.413+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.414+0000 7efc1f937800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:33.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.414+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.414+0000 7efc1f937800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:33.416 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.414+0000 7efc1f937800 20 searching for the correct realm 2023-12-03T11:35:33.426 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.425+0000 7efc1b66f640 0 -- 172.21.15.131:0/3992301281 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x555a7ae83b30 msgr2=0x555a7ae85f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:33.428 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.427+0000 7efc1f937800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:33.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.427+0000 7efc1f937800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:33.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.427+0000 7efc1f937800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:33.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.427+0000 7efc1f937800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:33.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.427+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.427+0000 7efc1f937800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.429 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.427+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:33.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:33.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 20 zone default found 2023-12-03T11:35:33.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 4 Realm: () 2023-12-03T11:35:33.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:33.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:33.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:33.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 20 zonegroup default 2023-12-03T11:35:33.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.428+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.429+0000 7efc1f937800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.429+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.429+0000 7efc1f937800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.429+0000 7efc1f937800 20 started sync module instance, tier type = 2023-12-03T11:35:33.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.429+0000 7efc1f937800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:33.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.443+0000 7efc1be70640 0 -- 172.21.15.131:0/3992301281 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7efc100393d0 msgr2=0x7efc10039850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:33.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.445+0000 7efc1f937800 20 add_watcher() i=0 2023-12-03T11:35:33.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.445+0000 7efc1f937800 20 add_watcher() i=1 2023-12-03T11:35:33.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.445+0000 7efc1f937800 20 add_watcher() i=2 2023-12-03T11:35:33.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.445+0000 7efc1f937800 20 add_watcher() i=3 2023-12-03T11:35:33.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.445+0000 7efc1f937800 20 add_watcher() i=4 2023-12-03T11:35:33.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.445+0000 7efc1f937800 20 add_watcher() i=5 2023-12-03T11:35:33.447 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.445+0000 7efc1f937800 20 add_watcher() i=6 2023-12-03T11:35:33.448 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.446+0000 7efc1f937800 20 add_watcher() i=7 2023-12-03T11:35:33.448 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.446+0000 7efc1f937800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:33.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.448+0000 7efbe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:33.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.448+0000 7efc1f937800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:33.449 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.448+0000 7efc1f937800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:33.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.454+0000 7efc1f937800 5 note: GC not initialized 2023-12-03T11:35:33.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.454+0000 7efb4ffff640 20 reqs_thread_entry: start 2023-12-03T11:35:33.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.455+0000 7efc1f937800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:33.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.455+0000 7efc1f937800 20 Filter name: none 2023-12-03T11:35:33.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.455+0000 7efb4dffb640 20 reqs_thread_entry: start 2023-12-03T11:35:33.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.455+0000 7efc1f937800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2023-12-03T11:35:33.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.455+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.455+0000 7efc1f937800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:33.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.455+0000 7efc1f937800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2023-12-03T11:35:33.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.455+0000 7efc1f937800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2023-12-03T11:35:33.457 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.455+0000 7efc1f937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 : miss 2023-12-03T11:35:33.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.455+0000 7efc1f937800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.456+0000 7efc1f937800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:33.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.456+0000 7efc1f937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:33.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.456+0000 7efc1f937800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:33.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.456+0000 7efc1f937800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:33.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.456+0000 7efc1f937800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:33.458 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.456+0000 7efc1f937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 2023-12-03T11:35:33.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.460+0000 7efc1f937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:33.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.460+0000 7efc1f937800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:33.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.460+0000 7efc1f937800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:33.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.460+0000 7efc1f937800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25, ofs0, ns] 2023-12-03T11:35:33.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.460+0000 7efc01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791395 cookie 93847097505456 notifier 7074 bl.length()=893 2023-12-03T11:35:33.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.460+0000 7efc01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:33.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.460+0000 7efc01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:33.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.460+0000 7efc01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:33.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.461+0000 7efc1f937800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): orig_sources= new_sources= 2023-12-03T11:35:33.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.461+0000 7efc1f937800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): potential sources added=[] removed=[] 2023-12-03T11:35:33.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.461+0000 7efc1f937800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): orig_dests= new_dests= 2023-12-03T11:35:33.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.461+0000 7efc1f937800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): potential dests added=[] removed=[] 2023-12-03T11:35:33.463 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.462+0000 7efc1f937800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.0 2023-12-03T11:35:33.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.462+0000 7efc1f937800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.0 2023-12-03T11:35:33.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.462+0000 7efc1f937800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.1 2023-12-03T11:35:33.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.462+0000 7efc1f937800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.1.1 2023-12-03T11:35:33.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.462+0000 7efc1f937800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25.0 2023-12-03T11:35:33.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.464+0000 7efc1f937800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 : hit (requested=0x17, cached=0x17) 2023-12-03T11:35:33.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.464+0000 7efc1f937800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 2023-12-03T11:35:33.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc1f937800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:33.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc1f937800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:33.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc1f937800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:33.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc1f937800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25, ofs0, ns] 2023-12-03T11:35:33.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791396 cookie 93847097505456 notifier 7074 bl.length()=861 2023-12-03T11:35:33.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 info.flags=0x17 2023-12-03T11:35:33.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 to cache LRU end 2023-12-03T11:35:33.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:33.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc1f937800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): orig_sources= new_sources= 2023-12-03T11:35:33.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc1f937800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): potential sources added=[] removed=[] 2023-12-03T11:35:33.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc1f937800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): orig_dests= new_dests= 2023-12-03T11:35:33.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.466+0000 7efc1f937800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25]): potential dests added=[] removed=[] 2023-12-03T11:35:33.469 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.468+0000 7efc1f937800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2023-12-03T11:35:33.471 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.470+0000 7efbe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:33.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.472+0000 7efc1f937800 20 remove_watcher() i=0 2023-12-03T11:35:33.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.472+0000 7efc1f937800 2 removed watcher, disabling cache 2023-12-03T11:35:33.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.473+0000 7efc1f937800 20 remove_watcher() i=1 2023-12-03T11:35:33.475 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.474+0000 7efc1f937800 20 remove_watcher() i=2 2023-12-03T11:35:33.476 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.475+0000 7efc1f937800 20 remove_watcher() i=3 2023-12-03T11:35:33.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.476+0000 7efc1f937800 20 remove_watcher() i=4 2023-12-03T11:35:33.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.477+0000 7efc1f937800 20 remove_watcher() i=5 2023-12-03T11:35:33.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.478+0000 7efc1f937800 20 remove_watcher() i=6 2023-12-03T11:35:33.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.479+0000 7efc1f937800 20 remove_watcher() i=7 2023-12-03T11:35:33.487 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2023-12-03T11:35:33.514 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:33.514 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:33.527 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.526+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.528+0000 7fb09232d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.528+0000 7fb09232d800 20 realm 2023-12-03T11:35:33.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.528+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.529+0000 7fb09232d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.529+0000 7fb09232d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:33.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.529+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.529+0000 7fb09232d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.529+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.529+0000 7fb09232d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:33.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.529+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.530+0000 7fb09232d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:33.531 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.530+0000 7fb09232d800 20 searching for the correct realm 2023-12-03T11:35:33.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.537+0000 7fb08e77f640 0 -- 172.21.15.131:0/3250218925 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7fb078038040 msgr2=0x7fb078028430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:33.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.540+0000 7fb09232d800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:33.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.540+0000 7fb09232d800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:33.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.540+0000 7fb09232d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:33.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.540+0000 7fb09232d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:33.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.540+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.541+0000 7fb09232d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.542 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.541+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.541+0000 7fb09232d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.541+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.541+0000 7fb09232d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 20 zone default found 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 4 Realm: () 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 20 zonegroup default 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb08df7e640 0 -- 172.21.15.131:0/3250218925 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7fb07801a400 msgr2=0x7fb07801a840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:33.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 20 started sync module instance, tier type = 2023-12-03T11:35:33.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.542+0000 7fb09232d800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:33.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.551+0000 7fb09232d800 20 add_watcher() i=0 2023-12-03T11:35:33.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.551+0000 7fb09232d800 20 add_watcher() i=1 2023-12-03T11:35:33.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.551+0000 7fb09232d800 20 add_watcher() i=2 2023-12-03T11:35:33.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.551+0000 7fb09232d800 20 add_watcher() i=3 2023-12-03T11:35:33.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.551+0000 7fb09232d800 20 add_watcher() i=4 2023-12-03T11:35:33.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.551+0000 7fb09232d800 20 add_watcher() i=5 2023-12-03T11:35:33.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.551+0000 7fb09232d800 20 add_watcher() i=6 2023-12-03T11:35:33.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.552+0000 7fb09232d800 20 add_watcher() i=7 2023-12-03T11:35:33.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.552+0000 7fb09232d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:33.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.554+0000 7fb0537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:33.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.554+0000 7fb09232d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:33.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.554+0000 7fb09232d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:33.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.560+0000 7fb09232d800 5 note: GC not initialized 2023-12-03T11:35:33.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.560+0000 7fafc27fc640 20 reqs_thread_entry: start 2023-12-03T11:35:33.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.560+0000 7fb09232d800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:33.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.560+0000 7fb09232d800 20 Filter name: none 2023-12-03T11:35:33.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.560+0000 7fafb3fff640 20 reqs_thread_entry: start 2023-12-03T11:35:33.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.560+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.561+0000 7fb09232d800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:33.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.561+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.561+0000 7fb09232d800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:33.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.561+0000 7fb09232d800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:33.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.561+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.562+0000 7fb09232d800 20 rados_obj.operate() r=0 bl.length=197 2023-12-03T11:35:33.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.562+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.562+0000 7fb09232d800 20 rados_obj.operate() r=0 bl.length=381 2023-12-03T11:35:33.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.562+0000 7fb09232d800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:33.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.562+0000 7fb09232d800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.563+0000 7fb09232d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.563+0000 7fb0537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:33.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.565+0000 7fb09232d800 20 remove_watcher() i=0 2023-12-03T11:35:33.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.565+0000 7fb09232d800 2 removed watcher, disabling cache 2023-12-03T11:35:33.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.566+0000 7fb09232d800 20 remove_watcher() i=1 2023-12-03T11:35:33.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.567+0000 7fb09232d800 20 remove_watcher() i=2 2023-12-03T11:35:33.569 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.568+0000 7fb09232d800 20 remove_watcher() i=3 2023-12-03T11:35:33.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.570+0000 7fb09232d800 20 remove_watcher() i=4 2023-12-03T11:35:33.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.572+0000 7fb09232d800 20 remove_watcher() i=5 2023-12-03T11:35:33.574 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.573+0000 7fb09232d800 20 remove_watcher() i=6 2023-12-03T11:35:33.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.574+0000 7fb09232d800 20 remove_watcher() i=7 2023-12-03T11:35:33.580 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:33.580 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:33.580 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-commit-target-layout id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.25 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:35:33.580 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:33.654 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard bucket with EIO injected at do_reshard 2023-12-03T11:35:33.654 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:33.825 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-12-03T11:35:33.852 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:33.852 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:33.866 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.865+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.866+0000 7f57e5f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.866+0000 7f57e5f37800 20 realm 2023-12-03T11:35:33.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.866+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.867+0000 7f57e5f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.867+0000 7f57e5f37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:33.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.867+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.867+0000 7f57e5f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.868 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.867+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.867+0000 7f57e5f37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:33.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.867+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.868+0000 7f57e5f37800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:33.869 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.868+0000 7f57e5f37800 20 searching for the correct realm 2023-12-03T11:35:33.878 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.877+0000 7f57e1ccd640 0 -- 172.21.15.131:0/1068787101 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55b62cdc5090 msgr2=0x55b62cdc7480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:33.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.878+0000 7f57e5f37800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:33.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.878+0000 7f57e5f37800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:33.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.878+0000 7f57e5f37800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:33.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.878+0000 7f57e5f37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:33.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.878+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:33.880 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:33.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 20 zone default found 2023-12-03T11:35:33.881 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 4 Realm: () 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 20 zonegroup default 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.879+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.880+0000 7f57e5f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.880+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.880+0000 7f57e5f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.880+0000 7f57e5f37800 20 started sync module instance, tier type = 2023-12-03T11:35:33.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.880+0000 7f57e5f37800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:33.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.886+0000 7f57e24ce640 0 -- 172.21.15.131:0/1068787101 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f57d8031420 msgr2=0x7f57d80318a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:33.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.889+0000 7f57e5f37800 20 add_watcher() i=0 2023-12-03T11:35:33.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.889+0000 7f57e5f37800 20 add_watcher() i=1 2023-12-03T11:35:33.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.889+0000 7f57e5f37800 20 add_watcher() i=2 2023-12-03T11:35:33.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.889+0000 7f57e5f37800 20 add_watcher() i=3 2023-12-03T11:35:33.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.889+0000 7f57e5f37800 20 add_watcher() i=4 2023-12-03T11:35:33.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.889+0000 7f57e5f37800 20 add_watcher() i=5 2023-12-03T11:35:33.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.889+0000 7f57e5f37800 20 add_watcher() i=6 2023-12-03T11:35:33.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.890+0000 7f57e5f37800 20 add_watcher() i=7 2023-12-03T11:35:33.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.890+0000 7f57e5f37800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:33.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.891+0000 7f57a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:33.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.892+0000 7f57e5f37800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:33.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.892+0000 7f57e5f37800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:33.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.897+0000 7f57e5f37800 5 note: GC not initialized 2023-12-03T11:35:33.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.897+0000 7f57167fc640 20 reqs_thread_entry: start 2023-12-03T11:35:33.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.898+0000 7f57e5f37800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:33.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.898+0000 7f57e5f37800 20 Filter name: none 2023-12-03T11:35:33.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.898+0000 7f5707fff640 20 reqs_thread_entry: start 2023-12-03T11:35:33.899 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.898+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.898+0000 7f57e5f37800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:33.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.898+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.899+0000 7f57e5f37800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:33.900 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.899+0000 7f57e5f37800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:33.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.899+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.899+0000 7f57e5f37800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:33.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.899+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.899+0000 7f57e5f37800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:33.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.899+0000 7f57e5f37800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:33.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.900+0000 7f57e5f37800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.900+0000 7f57e5f37800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.902 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.901+0000 7f57a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:33.904 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.903+0000 7f57e5f37800 20 remove_watcher() i=0 2023-12-03T11:35:33.904 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.903+0000 7f57e5f37800 2 removed watcher, disabling cache 2023-12-03T11:35:33.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.904+0000 7f57e5f37800 20 remove_watcher() i=1 2023-12-03T11:35:33.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.905+0000 7f57e5f37800 20 remove_watcher() i=2 2023-12-03T11:35:33.907 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.906+0000 7f57e5f37800 20 remove_watcher() i=3 2023-12-03T11:35:33.908 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.907+0000 7f57e5f37800 20 remove_watcher() i=4 2023-12-03T11:35:33.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.908+0000 7f57e5f37800 20 remove_watcher() i=5 2023-12-03T11:35:33.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.909+0000 7f57e5f37800 20 remove_watcher() i=6 2023-12-03T11:35:33.911 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.910+0000 7f57e5f37800 20 remove_watcher() i=7 2023-12-03T11:35:33.916 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:33.916 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:33.916 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-do-reshard id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:35:33.916 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:33.917 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2023-12-03T11:35:33.949 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:33.950 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:33.963 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.962+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.963+0000 7fe805526800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.963+0000 7fe805526800 20 realm 2023-12-03T11:35:33.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.963+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.963+0000 7fe805526800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.963+0000 7fe805526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:33.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.963+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.965 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.964+0000 7fe805526800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.964+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.965+0000 7fe805526800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:33.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.965+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.965+0000 7fe805526800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:33.966 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.965+0000 7fe805526800 20 searching for the correct realm 2023-12-03T11:35:33.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.975+0000 7fe801261640 0 -- 172.21.15.131:0/4070757638 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55821216cdb0 msgr2=0x55821216f200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:33.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.975+0000 7fe805526800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:33.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.975+0000 7fe805526800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:33.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.975+0000 7fe805526800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:33.977 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.975+0000 7fe805526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.975+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.975+0000 7fe805526800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.975+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.975+0000 7fe805526800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.975+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 20 zone default found 2023-12-03T11:35:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 4 Realm: () 2023-12-03T11:35:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:33.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 20 zonegroup default 2023-12-03T11:35:33.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:33.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 20 started sync module instance, tier type = 2023-12-03T11:35:33.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.976+0000 7fe805526800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:33.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.984+0000 7fe7f8a60640 0 -- 172.21.15.131:0/4070757638 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x558212171df0 msgr2=0x5582121741e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:35:33.986 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.985+0000 7fe805526800 20 add_watcher() i=0 2023-12-03T11:35:33.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.985+0000 7fe805526800 20 add_watcher() i=1 2023-12-03T11:35:33.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.985+0000 7fe805526800 20 add_watcher() i=2 2023-12-03T11:35:33.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.985+0000 7fe805526800 20 add_watcher() i=3 2023-12-03T11:35:33.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.985+0000 7fe805526800 20 add_watcher() i=4 2023-12-03T11:35:33.987 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.985+0000 7fe805526800 20 add_watcher() i=5 2023-12-03T11:35:33.988 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.987+0000 7fe805526800 20 add_watcher() i=6 2023-12-03T11:35:33.988 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.987+0000 7fe805526800 20 add_watcher() i=7 2023-12-03T11:35:33.988 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.987+0000 7fe805526800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:33.989 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.988+0000 7fe7c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:33.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.989+0000 7fe805526800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:33.990 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.989+0000 7fe805526800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:33.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.994+0000 7fe805526800 5 note: GC not initialized 2023-12-03T11:35:33.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.994+0000 7fe735ffb640 20 reqs_thread_entry: start 2023-12-03T11:35:33.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.995+0000 7fe805526800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:33.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.995+0000 7fe805526800 20 Filter name: none 2023-12-03T11:35:33.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.995+0000 7fe7277fe640 20 reqs_thread_entry: start 2023-12-03T11:35:33.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.995+0000 7fe805526800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2023-12-03T11:35:33.996 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.995+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.995+0000 7fe805526800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:33.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.995+0000 7fe805526800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2023-12-03T11:35:33.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.995+0000 7fe805526800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2023-12-03T11:35:33.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.995+0000 7fe805526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 : miss 2023-12-03T11:35:33.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.995+0000 7fe805526800 20 rados->read ofs=0 len=0 2023-12-03T11:35:33.997 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.996+0000 7fe805526800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:33.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.996+0000 7fe805526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 info.flags=0x17 2023-12-03T11:35:33.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.996+0000 7fe805526800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 to cache LRU end 2023-12-03T11:35:33.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.996+0000 7fe805526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:33.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.996+0000 7fe805526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:33.998 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:33.996+0000 7fe805526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 2023-12-03T11:35:34.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe805526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 info.flags=0x17 2023-12-03T11:35:34.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe805526800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 to cache LRU end 2023-12-03T11:35:34.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe805526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe805526800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26, ofs0, ns] 2023-12-03T11:35:34.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe7e37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791330 cookie 94017137634256 notifier 7140 bl.length()=873 2023-12-03T11:35:34.001 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe7e37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 info.flags=0x17 2023-12-03T11:35:34.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe7e37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 to cache LRU end 2023-12-03T11:35:34.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe7e37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe805526800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): orig_sources= new_sources= 2023-12-03T11:35:34.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe805526800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): potential sources added=[] removed=[] 2023-12-03T11:35:34.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe805526800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): orig_dests= new_dests= 2023-12-03T11:35:34.002 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.000+0000 7fe805526800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): potential dests added=[] removed=[] 2023-12-03T11:35:34.003 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.002+0000 7fe805526800 -1 Injecting error=-5 at location=do_reshard 2023-12-03T11:35:34.005 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.004+0000 7fe805526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 : hit (requested=0x17, cached=0x17) 2023-12-03T11:35:34.005 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.004+0000 7fe805526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 2023-12-03T11:35:34.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe805526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 info.flags=0x17 2023-12-03T11:35:34.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe805526800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 to cache LRU end 2023-12-03T11:35:34.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe805526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.006 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe805526800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26, ofs0, ns] 2023-12-03T11:35:34.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe7e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791331 cookie 94017137634256 notifier 7140 bl.length()=841 2023-12-03T11:35:34.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe7e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 info.flags=0x17 2023-12-03T11:35:34.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe7e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 to cache LRU end 2023-12-03T11:35:34.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe7e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe805526800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): orig_sources= new_sources= 2023-12-03T11:35:34.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe805526800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): potential sources added=[] removed=[] 2023-12-03T11:35:34.007 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe805526800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): orig_dests= new_dests= 2023-12-03T11:35:34.008 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe805526800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): potential dests added=[] removed=[] 2023-12-03T11:35:34.008 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.005+0000 7fe805526800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2023-12-03T11:35:34.008 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.007+0000 7fe7c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:34.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.009+0000 7fe805526800 20 remove_watcher() i=0 2023-12-03T11:35:34.010 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.009+0000 7fe805526800 2 removed watcher, disabling cache 2023-12-03T11:35:34.011 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.010+0000 7fe805526800 20 remove_watcher() i=1 2023-12-03T11:35:34.012 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.011+0000 7fe805526800 20 remove_watcher() i=2 2023-12-03T11:35:34.013 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.012+0000 7fe805526800 20 remove_watcher() i=3 2023-12-03T11:35:34.014 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.013+0000 7fe805526800 20 remove_watcher() i=4 2023-12-03T11:35:34.015 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.014+0000 7fe805526800 20 remove_watcher() i=5 2023-12-03T11:35:34.016 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.015+0000 7fe805526800 20 remove_watcher() i=6 2023-12-03T11:35:34.017 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.016+0000 7fe805526800 20 remove_watcher() i=7 2023-12-03T11:35:34.023 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-12-03T11:35:34.050 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:34.050 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:34.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.063+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.065+0000 7f1bba816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.065+0000 7f1bba816800 20 realm 2023-12-03T11:35:34.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.065+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.065+0000 7f1bba816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.065+0000 7f1bba816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:34.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.065+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.065+0000 7f1bba816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.065+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.066+0000 7f1bba816800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:34.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.066+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.066+0000 7f1bba816800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:34.067 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.066+0000 7f1bba816800 20 searching for the correct realm 2023-12-03T11:35:34.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.074+0000 7f1bb5e93640 0 -- 172.21.15.131:0/2785343264 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f1bb005e050 msgr2=0x7f1bb00950b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:35:34.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.076+0000 7f1bba816800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:34.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.076+0000 7f1bba816800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:34.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.076+0000 7f1bba816800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:34.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.076+0000 7f1bba816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:34.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.076+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.076+0000 7f1bba816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.076+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:34.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.079 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:34.079 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 20 zone default found 2023-12-03T11:35:34.079 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 4 Realm: () 2023-12-03T11:35:34.079 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:34.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:34.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:34.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 20 zonegroup default 2023-12-03T11:35:34.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.077+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.078+0000 7f1bba816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.078+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.078+0000 7f1bba816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.078+0000 7f1bba816800 20 started sync module instance, tier type = 2023-12-03T11:35:34.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.078+0000 7f1bba816800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:34.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.083+0000 7f1bb5e93640 0 -- 172.21.15.131:0/2785343264 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f1b90079640 msgr2=0x7f1b9007ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:35:34.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.088+0000 7f1bba816800 20 add_watcher() i=0 2023-12-03T11:35:34.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.088+0000 7f1bba816800 20 add_watcher() i=1 2023-12-03T11:35:34.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.088+0000 7f1bba816800 20 add_watcher() i=2 2023-12-03T11:35:34.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.088+0000 7f1bba816800 20 add_watcher() i=3 2023-12-03T11:35:34.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.088+0000 7f1bba816800 20 add_watcher() i=4 2023-12-03T11:35:34.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.088+0000 7f1bba816800 20 add_watcher() i=5 2023-12-03T11:35:34.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.088+0000 7f1bba816800 20 add_watcher() i=6 2023-12-03T11:35:34.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.089+0000 7f1bba816800 20 add_watcher() i=7 2023-12-03T11:35:34.090 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.089+0000 7f1bba816800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:34.091 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.090+0000 7f1b7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:34.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.091+0000 7f1bba816800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:34.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.091+0000 7f1bba816800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:34.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.097+0000 7f1bba816800 5 note: GC not initialized 2023-12-03T11:35:34.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.097+0000 7f1aea7fc640 20 reqs_thread_entry: start 2023-12-03T11:35:34.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.097+0000 7f1bba816800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:34.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.097+0000 7f1bba816800 20 Filter name: none 2023-12-03T11:35:34.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.097+0000 7f1adbfff640 20 reqs_thread_entry: start 2023-12-03T11:35:34.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.097+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.097+0000 7f1bba816800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:34.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.097+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.098+0000 7f1bba816800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:34.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.098+0000 7f1bba816800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:34.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.098+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.098+0000 7f1bba816800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:34.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.098+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.099+0000 7f1bba816800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:34.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.099+0000 7f1bba816800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:34.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.099+0000 7f1bba816800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.099+0000 7f1bba816800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.100+0000 7f1b7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:34.103 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.102+0000 7f1bba816800 20 remove_watcher() i=0 2023-12-03T11:35:34.103 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.102+0000 7f1bba816800 2 removed watcher, disabling cache 2023-12-03T11:35:34.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.103+0000 7f1bba816800 20 remove_watcher() i=1 2023-12-03T11:35:34.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.104+0000 7f1bba816800 20 remove_watcher() i=2 2023-12-03T11:35:34.106 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.105+0000 7f1bba816800 20 remove_watcher() i=3 2023-12-03T11:35:34.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.107+0000 7f1bba816800 20 remove_watcher() i=4 2023-12-03T11:35:34.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.108+0000 7f1bba816800 20 remove_watcher() i=5 2023-12-03T11:35:34.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.109+0000 7f1bba816800 20 remove_watcher() i=6 2023-12-03T11:35:34.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.110+0000 7f1bba816800 20 remove_watcher() i=7 2023-12-03T11:35:34.115 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:34.115 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:34.115 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-do-reshard id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:35:34.115 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:34.166 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:35:34.197 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:34.197 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:34.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.209+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.211+0000 7f15b9735800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.211+0000 7f15b9735800 20 realm 2023-12-03T11:35:34.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.211+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.211+0000 7f15b9735800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.211+0000 7f15b9735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:34.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.211+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.211+0000 7f15b9735800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.211+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.212+0000 7f15b9735800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:34.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.212+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.212+0000 7f15b9735800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:34.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.212+0000 7f15b9735800 20 searching for the correct realm 2023-12-03T11:35:34.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.221+0000 7f15b54cd640 0 -- 172.21.15.131:0/766474 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5582e3c242b0 msgr2=0x5582e3c266a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:34.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.222+0000 7f15b9735800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:34.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.222+0000 7f15b9735800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:34.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.222+0000 7f15b9735800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:34.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.222+0000 7f15b9735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:34.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.222+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:34.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:34.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 20 zone default found 2023-12-03T11:35:34.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 4 Realm: () 2023-12-03T11:35:34.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:34.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:34.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:34.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 20 zonegroup default 2023-12-03T11:35:34.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.223+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.224+0000 7f15b9735800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.224+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.224+0000 7f15b9735800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.224+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.224+0000 7f15b9735800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.224+0000 7f15b9735800 20 started sync module instance, tier type = 2023-12-03T11:35:34.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.224+0000 7f15b9735800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:34.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.231+0000 7f15b4ccc640 0 -- 172.21.15.131:0/766474 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x5582e3c292c0 msgr2=0x5582e3c2b6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:34.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.234+0000 7f15b9735800 20 add_watcher() i=0 2023-12-03T11:35:34.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.234+0000 7f15b9735800 20 add_watcher() i=1 2023-12-03T11:35:34.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.234+0000 7f15b9735800 20 add_watcher() i=2 2023-12-03T11:35:34.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.234+0000 7f15b9735800 20 add_watcher() i=3 2023-12-03T11:35:34.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.234+0000 7f15b9735800 20 add_watcher() i=4 2023-12-03T11:35:34.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.234+0000 7f15b9735800 20 add_watcher() i=5 2023-12-03T11:35:34.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.234+0000 7f15b9735800 20 add_watcher() i=6 2023-12-03T11:35:34.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.235+0000 7f15b9735800 20 add_watcher() i=7 2023-12-03T11:35:34.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.235+0000 7f15b9735800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:34.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.236+0000 7f157afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:34.238 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.237+0000 7f15b9735800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:34.238 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.237+0000 7f15b9735800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:34.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.242+0000 7f15b9735800 5 note: GC not initialized 2023-12-03T11:35:34.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.243+0000 7f14e9ffb640 20 reqs_thread_entry: start 2023-12-03T11:35:34.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.243+0000 7f15b9735800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:34.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.243+0000 7f15b9735800 20 Filter name: none 2023-12-03T11:35:34.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.243+0000 7f14db7fe640 20 reqs_thread_entry: start 2023-12-03T11:35:34.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.243+0000 7f15b9735800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2023-12-03T11:35:34.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.243+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.243+0000 7f15b9735800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:34.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.243+0000 7f15b9735800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2023-12-03T11:35:34.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.243+0000 7f15b9735800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2023-12-03T11:35:34.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.243+0000 7f15b9735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 : miss 2023-12-03T11:35:34.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.243+0000 7f15b9735800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.244+0000 7f15b9735800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:34.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.244+0000 7f15b9735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 info.flags=0x17 2023-12-03T11:35:34.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.244+0000 7f15b9735800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 to cache LRU end 2023-12-03T11:35:34.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.244+0000 7f15b9735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:34.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.244+0000 7f15b9735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.244+0000 7f15b9735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 2023-12-03T11:35:34.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15b9735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 info.flags=0x17 2023-12-03T11:35:34.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15b9735800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 to cache LRU end 2023-12-03T11:35:34.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15b9735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15b9735800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26, ofs0, ns] 2023-12-03T11:35:34.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791332 cookie 94020655310384 notifier 6839 bl.length()=873 2023-12-03T11:35:34.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 info.flags=0x17 2023-12-03T11:35:34.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 to cache LRU end 2023-12-03T11:35:34.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15b9735800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): orig_sources= new_sources= 2023-12-03T11:35:34.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15b9735800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): potential sources added=[] removed=[] 2023-12-03T11:35:34.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15b9735800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): orig_dests= new_dests= 2023-12-03T11:35:34.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.248+0000 7f15b9735800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): potential dests added=[] removed=[] 2023-12-03T11:35:34.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.250+0000 7f15b9735800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26.1.0 2023-12-03T11:35:34.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.250+0000 7f15b9735800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26.1.0 2023-12-03T11:35:34.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.250+0000 7f15b9735800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26.1.1 2023-12-03T11:35:34.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.250+0000 7f15b9735800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26.1.1 2023-12-03T11:35:34.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.250+0000 7f15b9735800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26.0 2023-12-03T11:35:34.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.252+0000 7f15b9735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 : hit (requested=0x17, cached=0x17) 2023-12-03T11:35:34.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.252+0000 7f15b9735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 2023-12-03T11:35:34.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.253+0000 7f15b9735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 info.flags=0x17 2023-12-03T11:35:34.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.253+0000 7f15b9735800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 to cache LRU end 2023-12-03T11:35:34.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.253+0000 7f15b9735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.253+0000 7f15b9735800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26, ofs0, ns] 2023-12-03T11:35:34.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.253+0000 7f15977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791333 cookie 94020655310384 notifier 6839 bl.length()=841 2023-12-03T11:35:34.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.253+0000 7f15977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 info.flags=0x17 2023-12-03T11:35:34.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.253+0000 7f15977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 to cache LRU end 2023-12-03T11:35:34.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.253+0000 7f15977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.254+0000 7f15b9735800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): orig_sources= new_sources= 2023-12-03T11:35:34.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.254+0000 7f15b9735800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): potential sources added=[] removed=[] 2023-12-03T11:35:34.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.254+0000 7f15b9735800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): orig_dests= new_dests= 2023-12-03T11:35:34.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.254+0000 7f15b9735800 20 handle_bi_update(): bucket=:error-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26]): potential dests added=[] removed=[] 2023-12-03T11:35:34.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.255+0000 7f15b9735800 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2023-12-03T11:35:34.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.256+0000 7f157afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:34.259 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.258+0000 7f15b9735800 20 remove_watcher() i=0 2023-12-03T11:35:34.260 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.258+0000 7f15b9735800 2 removed watcher, disabling cache 2023-12-03T11:35:34.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.260+0000 7f15b9735800 20 remove_watcher() i=1 2023-12-03T11:35:34.262 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.261+0000 7f15b9735800 20 remove_watcher() i=2 2023-12-03T11:35:34.263 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.262+0000 7f15b9735800 20 remove_watcher() i=3 2023-12-03T11:35:34.265 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.264+0000 7f15b9735800 20 remove_watcher() i=4 2023-12-03T11:35:34.266 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.265+0000 7f15b9735800 20 remove_watcher() i=5 2023-12-03T11:35:34.267 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.265+0000 7f15b9735800 20 remove_watcher() i=6 2023-12-03T11:35:34.267 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.266+0000 7f15b9735800 20 remove_watcher() i=7 2023-12-03T11:35:34.274 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2023-12-03T11:35:34.301 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:34.301 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:34.315 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.313+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.316 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.315+0000 7f54a831f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.315+0000 7f54a831f800 20 realm 2023-12-03T11:35:34.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.315+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.315+0000 7f54a831f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.315+0000 7f54a831f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:34.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.315+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.315+0000 7f54a831f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.317 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.315+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.316+0000 7f54a831f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:34.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.316+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.316+0000 7f54a831f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:34.318 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.316+0000 7f54a831f800 20 searching for the correct realm 2023-12-03T11:35:34.326 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.325+0000 7f54a3f95640 0 -- 172.21.15.131:0/1171537330 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55a52f547760 msgr2=0x55a52f549b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:35:34.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.327+0000 7f54a831f800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:34.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.327+0000 7f54a831f800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:34.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.327+0000 7f54a831f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:34.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.327+0000 7f54a831f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:34.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.327+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.328 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.327+0000 7f54a831f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.329 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.327+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.327+0000 7f54a831f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:34.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.327+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:34.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 20 zone default found 2023-12-03T11:35:34.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 4 Realm: () 2023-12-03T11:35:34.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:34.330 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:34.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:34.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 20 zonegroup default 2023-12-03T11:35:34.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.328+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.329+0000 7f54a831f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.329+0000 7f54a831f800 20 started sync module instance, tier type = 2023-12-03T11:35:34.331 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.329+0000 7f54a831f800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:34.334 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.333+0000 7f54a3f95640 0 -- 172.21.15.131:0/1171537330 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x55a52f547760 msgr2=0x7f547c07e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:34.338 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.337+0000 7f54a831f800 20 add_watcher() i=0 2023-12-03T11:35:34.339 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.337+0000 7f54a831f800 20 add_watcher() i=1 2023-12-03T11:35:34.339 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.337+0000 7f54a831f800 20 add_watcher() i=2 2023-12-03T11:35:34.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.535+0000 7f54a831f800 20 add_watcher() i=3 2023-12-03T11:35:34.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.535+0000 7f54a831f800 20 add_watcher() i=4 2023-12-03T11:35:34.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.535+0000 7f54a831f800 20 add_watcher() i=5 2023-12-03T11:35:34.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.535+0000 7f54a831f800 20 add_watcher() i=6 2023-12-03T11:35:34.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.535+0000 7f54a831f800 20 add_watcher() i=7 2023-12-03T11:35:34.537 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.535+0000 7f54a831f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:34.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.537+0000 7f5469fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:34.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.537+0000 7f54a831f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:34.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.537+0000 7f54a831f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:34.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.543+0000 7f54a831f800 5 note: GC not initialized 2023-12-03T11:35:34.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.543+0000 7f53e0ff9640 20 reqs_thread_entry: start 2023-12-03T11:35:34.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.543+0000 7f54a831f800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:34.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.543+0000 7f54a831f800 20 Filter name: none 2023-12-03T11:35:34.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.543+0000 7f53d67fc640 20 reqs_thread_entry: start 2023-12-03T11:35:34.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.543+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.544+0000 7f54a831f800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:34.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.544+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.544+0000 7f54a831f800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:34.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.544+0000 7f54a831f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:34.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.544+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.545+0000 7f54a831f800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:34.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.545+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.545+0000 7f54a831f800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:34.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.545+0000 7f54a831f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:34.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.545+0000 7f54a831f800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.546+0000 7f54a831f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.546+0000 7f5469fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:34.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.548+0000 7f54a831f800 20 remove_watcher() i=0 2023-12-03T11:35:34.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.548+0000 7f54a831f800 2 removed watcher, disabling cache 2023-12-03T11:35:34.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.549+0000 7f54a831f800 20 remove_watcher() i=1 2023-12-03T11:35:34.551 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.550+0000 7f54a831f800 20 remove_watcher() i=2 2023-12-03T11:35:34.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.551+0000 7f54a831f800 20 remove_watcher() i=3 2023-12-03T11:35:34.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.552+0000 7f54a831f800 20 remove_watcher() i=4 2023-12-03T11:35:34.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.553+0000 7f54a831f800 20 remove_watcher() i=5 2023-12-03T11:35:34.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.554+0000 7f54a831f800 20 remove_watcher() i=6 2023-12-03T11:35:34.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.555+0000 7f54a831f800 20 remove_watcher() i=7 2023-12-03T11:35:34.561 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:34.561 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:34.561 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: error-at-do-reshard id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.26 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:35:34.561 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:34.635 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: reshard bucket with abort at do_reshard 2023-12-03T11:35:34.636 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:34.807 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-12-03T11:35:34.835 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:34.835 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:34.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.847+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.849+0000 7fcff2729800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.849+0000 7fcff2729800 20 realm 2023-12-03T11:35:34.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.849+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.849+0000 7fcff2729800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.849+0000 7fcff2729800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:34.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.849+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.849+0000 7fcff2729800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.851 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.849+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.850+0000 7fcff2729800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:34.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.850+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.851+0000 7fcff2729800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:34.852 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.851+0000 7fcff2729800 20 searching for the correct realm 2023-12-03T11:35:34.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.859+0000 7fcfedcbe640 0 -- 172.21.15.131:0/3041050747 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x7fcfc8079640 msgr2=0x7fcfc807ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:34.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.861+0000 7fcff2729800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:34.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.861+0000 7fcff2729800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:34.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.861+0000 7fcff2729800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:34.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.861+0000 7fcff2729800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:34.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.861+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.861+0000 7fcff2729800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.861+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.861+0000 7fcff2729800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:34.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.861+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:34.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 20 zone default found 2023-12-03T11:35:34.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 4 Realm: () 2023-12-03T11:35:34.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:34.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:34.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:34.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 20 zonegroup default 2023-12-03T11:35:34.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 20 started sync module instance, tier type = 2023-12-03T11:35:34.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.862+0000 7fcff2729800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:34.867 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.866+0000 7fcfee4bf640 0 -- 172.21.15.131:0/3041050747 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55db85b7e7b0 msgr2=0x55db85b80ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:34.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.871+0000 7fcff2729800 20 add_watcher() i=0 2023-12-03T11:35:34.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.871+0000 7fcff2729800 20 add_watcher() i=1 2023-12-03T11:35:34.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.871+0000 7fcff2729800 20 add_watcher() i=2 2023-12-03T11:35:34.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.871+0000 7fcff2729800 20 add_watcher() i=3 2023-12-03T11:35:34.872 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.871+0000 7fcff2729800 20 add_watcher() i=4 2023-12-03T11:35:34.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.871+0000 7fcff2729800 20 add_watcher() i=5 2023-12-03T11:35:34.873 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.871+0000 7fcff2729800 20 add_watcher() i=6 2023-12-03T11:35:34.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.873+0000 7fcff2729800 20 add_watcher() i=7 2023-12-03T11:35:34.874 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.873+0000 7fcff2729800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:34.875 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.874+0000 7fcfb3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:34.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.874+0000 7fcff2729800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:34.876 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.874+0000 7fcff2729800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:34.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.880+0000 7fcff2729800 5 note: GC not initialized 2023-12-03T11:35:34.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.880+0000 7fcf22ffd640 20 reqs_thread_entry: start 2023-12-03T11:35:34.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.881+0000 7fcff2729800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:34.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.881+0000 7fcff2729800 20 Filter name: none 2023-12-03T11:35:34.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.881+0000 7fcf20ff9640 20 reqs_thread_entry: start 2023-12-03T11:35:34.882 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.881+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.881+0000 7fcff2729800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:34.883 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.881+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.882+0000 7fcff2729800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:34.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.882+0000 7fcff2729800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:34.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.882+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.882+0000 7fcff2729800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:34.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.882+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.883+0000 7fcff2729800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:34.884 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.883+0000 7fcff2729800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:34.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.883+0000 7fcff2729800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.884+0000 7fcff2729800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.885 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.884+0000 7fcfb3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:34.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.886+0000 7fcff2729800 20 remove_watcher() i=0 2023-12-03T11:35:34.887 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.886+0000 7fcff2729800 2 removed watcher, disabling cache 2023-12-03T11:35:34.888 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.887+0000 7fcff2729800 20 remove_watcher() i=1 2023-12-03T11:35:34.889 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.888+0000 7fcff2729800 20 remove_watcher() i=2 2023-12-03T11:35:34.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.889+0000 7fcff2729800 20 remove_watcher() i=3 2023-12-03T11:35:34.891 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.890+0000 7fcff2729800 20 remove_watcher() i=4 2023-12-03T11:35:34.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.891+0000 7fcff2729800 20 remove_watcher() i=5 2023-12-03T11:35:34.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.892+0000 7fcff2729800 20 remove_watcher() i=6 2023-12-03T11:35:34.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.893+0000 7fcff2729800 20 remove_watcher() i=7 2023-12-03T11:35:34.899 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:34.899 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:34.899 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-do-reshard id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:35:34.899 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:34.900 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2023-12-03T11:35:34.932 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:34.933 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:34.946 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.945+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.948 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.947+0000 7ff9d892c800 20 realm 2023-12-03T11:35:34.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.947+0000 7ff9d892c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:34.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.948+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:34.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.948+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.948+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:34.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.948+0000 7ff9d892c800 20 searching for the correct realm 2023-12-03T11:35:34.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.956+0000 7ff9d46f7640 0 -- 172.21.15.131:0/2108145607 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7ff9c800d3e0 msgr2=0x7ff9c800d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:34.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:34.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:34.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:34.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:34.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:34.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:34.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 20 zone default found 2023-12-03T11:35:34.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 4 Realm: () 2023-12-03T11:35:34.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:34.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:34.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:34.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 20 zonegroup default 2023-12-03T11:35:34.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:34.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 20 started sync module instance, tier type = 2023-12-03T11:35:34.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.959+0000 7ff9d892c800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:34.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.963+0000 7ff9d46f7640 0 -- 172.21.15.131:0/2108145607 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7ff9cc05eb30 msgr2=0x7ff9cc055cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:34.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=0 2023-12-03T11:35:34.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=1 2023-12-03T11:35:34.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=2 2023-12-03T11:35:34.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=3 2023-12-03T11:35:34.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=4 2023-12-03T11:35:34.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=5 2023-12-03T11:35:34.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=6 2023-12-03T11:35:34.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.968+0000 7ff9d892c800 20 add_watcher() i=7 2023-12-03T11:35:34.969 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.968+0000 7ff9d892c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:34.971 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.970+0000 7ff99a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:34.971 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.970+0000 7ff9d892c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:34.971 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.970+0000 7ff9d892c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:34.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.976+0000 7ff9d892c800 5 note: GC not initialized 2023-12-03T11:35:34.979 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.976+0000 7ff9097fa640 20 reqs_thread_entry: start 2023-12-03T11:35:34.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.976+0000 7ff9d892c800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:34.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.976+0000 7ff9d892c800 20 Filter name: none 2023-12-03T11:35:34.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.976+0000 7ff902ffd640 20 reqs_thread_entry: start 2023-12-03T11:35:34.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.976+0000 7ff9d892c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:35:34.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.976+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.976+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:34.980 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.977+0000 7ff9d892c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:35:34.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.977+0000 7ff9d892c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:35:34.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.977+0000 7ff9d892c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 : miss 2023-12-03T11:35:34.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.977+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:34.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.977+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:34.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.977+0000 7ff9d892c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:35:34.981 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.977+0000 7ff9d892c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:35:34.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.977+0000 7ff9d892c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:34.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.977+0000 7ff9d892c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.982 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.977+0000 7ff9d892c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 2023-12-03T11:35:34.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.981+0000 7ff9d892c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:35:34.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.981+0000 7ff9d892c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:35:34.983 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.981+0000 7ff9d892c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.981+0000 7ff9d892c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27, ofs0, ns] 2023-12-03T11:35:34.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791320 cookie 94563776135280 notifier 7251 bl.length()=873 2023-12-03T11:35:34.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:35:34.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:35:34.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:34.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): orig_sources= new_sources= 2023-12-03T11:35:34.984 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): potential sources added=[] removed=[] 2023-12-03T11:35:34.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): orig_dests= new_dests= 2023-12-03T11:35:34.985 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): potential dests added=[] removed=[] 2023-12-03T11:35:35.013 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff9d892c800 time 2023-12-03T11:35:34.984121+0000 2023-12-03T11:35:35.013 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:35:35.013 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:35.014 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff9db56eef8] 2023-12-03T11:35:35.014 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7ff9db56f0b6] 2023-12-03T11:35:35.014 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560156c0ca71] 2023-12-03T11:35:35.014 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x560156c18f34] 2023-12-03T11:35:35.014 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:35:35.015 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7ff9d8e3feb0] 2023-12-03T11:35:35.015 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:35:35.015 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:35:35.015 INFO:tasks.workunit.client.0.smithi131.stderr:*** Caught signal (Aborted) ** 2023-12-03T11:35:35.015 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7ff9d892c800 thread_name:radosgw-admin 2023-12-03T11:35:35.015 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.983+0000 7ff9d892c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff9d892c800 time 2023-12-03T11:35:34.984121+0000 2023-12-03T11:35:35.015 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:35:35.016 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.016 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:35.016 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff9db56eef8] 2023-12-03T11:35:35.016 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7ff9db56f0b6] 2023-12-03T11:35:35.016 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560156c0ca71] 2023-12-03T11:35:35.016 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x560156c18f34] 2023-12-03T11:35:35.016 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:35:35.017 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7ff9d8e3feb0] 2023-12-03T11:35:35.017 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:35:35.017 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:35:35.017 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.017 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:35.017 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff9d8e54db0] 2023-12-03T11:35:35.018 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff9d8ea154c] 2023-12-03T11:35:35.018 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:35:35.018 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:35:35.018 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff9db56ef52] 2023-12-03T11:35:35.018 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7ff9db56f0b6] 2023-12-03T11:35:35.018 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560156c0ca71] 2023-12-03T11:35:35.019 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x560156c18f34] 2023-12-03T11:35:35.019 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:35:35.019 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7ff9d8e3feb0] 2023-12-03T11:35:35.019 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:35:35.019 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:35:35.019 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:34.984+0000 7ff9d892c800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:35:35.019 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7ff9d892c800 thread_name:radosgw-admin 2023-12-03T11:35:35.020 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.020 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:35.020 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff9d8e54db0] 2023-12-03T11:35:35.020 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff9d8ea154c] 2023-12-03T11:35:35.020 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:35:35.020 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:35:35.020 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff9db56ef52] 2023-12-03T11:35:35.021 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7ff9db56f0b6] 2023-12-03T11:35:35.021 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560156c0ca71] 2023-12-03T11:35:35.021 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x560156c18f34] 2023-12-03T11:35:35.021 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:35:35.021 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7ff9d8e3feb0] 2023-12-03T11:35:35.021 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:35:35.021 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:35:35.021 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:35:35.022 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.022 INFO:tasks.workunit.client.0.smithi131.stderr:--- begin dump of recent events --- 2023-12-03T11:35:35.022 INFO:tasks.workunit.client.0.smithi131.stderr: -499> 2023-12-03T11:35:34.940+0000 7ff9d2ef4640 4 set_mon_vals no callback set 2023-12-03T11:35:35.022 INFO:tasks.workunit.client.0.smithi131.stderr: -498> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.022 INFO:tasks.workunit.client.0.smithi131.stderr: -497> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.022 INFO:tasks.workunit.client.0.smithi131.stderr: -496> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.022 INFO:tasks.workunit.client.0.smithi131.stderr: -495> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.022 INFO:tasks.workunit.client.0.smithi131.stderr: -494> 2023-12-03T11:35:34.940+0000 7ff9d892c800 1 librados: init done 2023-12-03T11:35:35.023 INFO:tasks.workunit.client.0.smithi131.stderr: -493> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: get_monmap_and_config 2023-12-03T11:35:35.023 INFO:tasks.workunit.client.0.smithi131.stderr: -492> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: build_initial_monmap 2023-12-03T11:35:35.023 INFO:tasks.workunit.client.0.smithi131.stderr: -491> 2023-12-03T11:35:34.940+0000 7ff9d892c800 1 build_initial for_mkfs: 0 2023-12-03T11:35:35.023 INFO:tasks.workunit.client.0.smithi131.stderr: -490> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: monmap: 2023-12-03T11:35:35.023 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:35.023 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:35.023 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:35.023 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:35.023 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:35.024 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.024 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:35.024 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:35.024 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:35.024 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.024 INFO:tasks.workunit.client.0.smithi131.stderr: -489> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding auth protocol: cephx 2023-12-03T11:35:35.024 INFO:tasks.workunit.client.0.smithi131.stderr: -488> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding auth protocol: cephx 2023-12-03T11:35:35.024 INFO:tasks.workunit.client.0.smithi131.stderr: -487> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding auth protocol: cephx 2023-12-03T11:35:35.025 INFO:tasks.workunit.client.0.smithi131.stderr: -486> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.025 INFO:tasks.workunit.client.0.smithi131.stderr: -485> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.025 INFO:tasks.workunit.client.0.smithi131.stderr: -484> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.025 INFO:tasks.workunit.client.0.smithi131.stderr: -483> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.025 INFO:tasks.workunit.client.0.smithi131.stderr: -482> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.025 INFO:tasks.workunit.client.0.smithi131.stderr: -481> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.025 INFO:tasks.workunit.client.0.smithi131.stderr: -480> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.026 INFO:tasks.workunit.client.0.smithi131.stderr: -479> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.026 INFO:tasks.workunit.client.0.smithi131.stderr: -478> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.026 INFO:tasks.workunit.client.0.smithi131.stderr: -477> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.026 INFO:tasks.workunit.client.0.smithi131.stderr: -476> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.026 INFO:tasks.workunit.client.0.smithi131.stderr: -475> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.026 INFO:tasks.workunit.client.0.smithi131.stderr: -474> 2023-12-03T11:35:34.941+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.026 INFO:tasks.workunit.client.0.smithi131.stderr: -473> 2023-12-03T11:35:34.941+0000 7ff9d892c800 10 monclient: init 2023-12-03T11:35:35.026 INFO:tasks.workunit.client.0.smithi131.stderr: -472> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding auth protocol: cephx 2023-12-03T11:35:35.026 INFO:tasks.workunit.client.0.smithi131.stderr: -471> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding auth protocol: cephx 2023-12-03T11:35:35.026 INFO:tasks.workunit.client.0.smithi131.stderr: -470> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding auth protocol: cephx 2023-12-03T11:35:35.026 INFO:tasks.workunit.client.0.smithi131.stderr: -469> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -468> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -467> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -466> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -465> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -464> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -463> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -462> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -461> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -460> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -459> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -458> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -457> 2023-12-03T11:35:34.941+0000 7ff9d1ef2640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -456> 2023-12-03T11:35:34.941+0000 7ff9d1ef2640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -455> 2023-12-03T11:35:34.941+0000 7ff9d1ef2640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.027 INFO:tasks.workunit.client.0.smithi131.stderr: -454> 2023-12-03T11:35:34.941+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -453> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient: get_auth_request con 0x7ff9c0069820 auth_method 0 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -452> 2023-12-03T11:35:34.942+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -451> 2023-12-03T11:35:34.942+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command rotate-key cmddesc rotate-key hook 0x7ffe05de88a8 EEXIST 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -450> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -449> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -448> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-b con 0x560158438420 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -447> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-a con 0x560158438800 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -446> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-c con 0x56015845a780 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -445> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -444> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -443> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -442> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -441> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): authenticate will time out at 1626.320587s 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -440> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request con 0x56015845a780 auth_method 0 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -439> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.028 INFO:tasks.workunit.client.0.smithi131.stderr: -438> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -437> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -436> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request con 0x560158438420 auth_method 0 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -435> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -434> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -433> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -432> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request con 0x560158438800 auth_method 0 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -431> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -430> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -429> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -428> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -427> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -426> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -425> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.029 INFO:tasks.workunit.client.0.smithi131.stderr: -424> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr: -423> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr: -422> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr: -421> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr: -420> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr: -419> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_done global_id 6890 payload 274 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr: -418> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient: _finish_hunting 0 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr: -417> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 1 monclient: found mon.noname-c 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr: -416> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr: -415> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr: -414> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr: -413> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: dump: 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.030 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr: -412> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: _finish_auth 0 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr: -411> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: _check_auth_tickets 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr: -410> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr: -409> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr: -408> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr: -407> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: dump: 2023-12-03T11:35:35.031 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr: -406> 2023-12-03T11:35:34.942+0000 7ff9d892c800 5 monclient: authenticate success, global_id 6890 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr: -405> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient: get_monmap_and_config success 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr: -404> 2023-12-03T11:35:34.942+0000 7ff9d892c800 4 set_mon_vals no callback set 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr: -403> 2023-12-03T11:35:34.943+0000 7ff9d892c800 10 monclient: shutdown 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr: -402> 2023-12-03T11:35:34.943+0000 7ff9d892c800 10 monclient: build_initial_monmap 2023-12-03T11:35:35.032 INFO:tasks.workunit.client.0.smithi131.stderr: -401> 2023-12-03T11:35:34.943+0000 7ff9d892c800 1 build_initial for_mkfs: 0 2023-12-03T11:35:35.033 INFO:tasks.workunit.client.0.smithi131.stderr: -400> 2023-12-03T11:35:34.943+0000 7ff9d892c800 10 monclient: monmap: 2023-12-03T11:35:35.033 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:35.033 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:35.033 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:35.033 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:35.033 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:35.033 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.033 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:35.033 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:35.033 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:35.033 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -399> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding auth protocol: cephx 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -398> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding auth protocol: cephx 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -397> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding auth protocol: cephx 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -396> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -395> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -394> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -393> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -392> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -391> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -390> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -389> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -388> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -387> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.034 INFO:tasks.workunit.client.0.smithi131.stderr: -386> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -385> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -384> 2023-12-03T11:35:34.943+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -383> 2023-12-03T11:35:34.943+0000 7ff9d892c800 1 librados: starting msgr at 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -382> 2023-12-03T11:35:34.943+0000 7ff9d892c800 1 librados: starting objecter 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -381> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command objecter_requests cmddesc objecter_requests hook 0x56015841e680 EEXIST 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -380> 2023-12-03T11:35:34.943+0000 7ff9d892c800 1 librados: setting wanted keys 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -379> 2023-12-03T11:35:34.943+0000 7ff9d892c800 1 librados: calling monclient init 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -378> 2023-12-03T11:35:34.943+0000 7ff9d892c800 10 monclient: init 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -377> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding auth protocol: cephx 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -376> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding auth protocol: cephx 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -375> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding auth protocol: cephx 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -374> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -373> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -372> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.035 INFO:tasks.workunit.client.0.smithi131.stderr: -371> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -370> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -369> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -368> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -367> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -366> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -365> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -364> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -363> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -362> 2023-12-03T11:35:34.943+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -361> 2023-12-03T11:35:34.944+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -360> 2023-12-03T11:35:34.944+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command rotate-key cmddesc rotate-key hook 0x560158430f70 EEXIST 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -359> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -358> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -357> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-a con 0x560158438420 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -356> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-c con 0x560158466d50 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:35.036 INFO:tasks.workunit.client.0.smithi131.stderr: -355> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-b con 0x560158475f80 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:35.037 INFO:tasks.workunit.client.0.smithi131.stderr: -354> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.037 INFO:tasks.workunit.client.0.smithi131.stderr: -353> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.037 INFO:tasks.workunit.client.0.smithi131.stderr: -352> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.037 INFO:tasks.workunit.client.0.smithi131.stderr: -351> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:35.037 INFO:tasks.workunit.client.0.smithi131.stderr: -350> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): authenticate will time out at 1626.322631s 2023-12-03T11:35:35.037 INFO:tasks.workunit.client.0.smithi131.stderr: -349> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request con 0x560158438420 auth_method 0 2023-12-03T11:35:35.037 INFO:tasks.workunit.client.0.smithi131.stderr: -348> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.038 INFO:tasks.workunit.client.0.smithi131.stderr: -347> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.038 INFO:tasks.workunit.client.0.smithi131.stderr: -346> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.038 INFO:tasks.workunit.client.0.smithi131.stderr: -345> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request con 0x560158466d50 auth_method 0 2023-12-03T11:35:35.038 INFO:tasks.workunit.client.0.smithi131.stderr: -344> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.038 INFO:tasks.workunit.client.0.smithi131.stderr: -343> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.038 INFO:tasks.workunit.client.0.smithi131.stderr: -342> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.038 INFO:tasks.workunit.client.0.smithi131.stderr: -341> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request con 0x560158475f80 auth_method 0 2023-12-03T11:35:35.038 INFO:tasks.workunit.client.0.smithi131.stderr: -340> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -339> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -338> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -337> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -336> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -335> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -334> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -333> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -332> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -331> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -330> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -329> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -328> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_done global_id 7251 payload 824 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -327> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient: _finish_hunting 0 2023-12-03T11:35:35.039 INFO:tasks.workunit.client.0.smithi131.stderr: -326> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 1 monclient: found mon.noname-a 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr: -325> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr: -324> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr: -323> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr: -322> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: dump: 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.040 INFO:tasks.workunit.client.0.smithi131.stderr: -321> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: _finish_auth 0 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr: -320> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: _check_auth_tickets 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr: -319> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr: -318> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr: -317> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr: -316> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: dump: 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.041 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -315> 2023-12-03T11:35:34.944+0000 7ff9d892c800 5 monclient: authenticate success, global_id 7251 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -314> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -313> 2023-12-03T11:35:34.944+0000 7ff9baffd640 4 set_mon_vals no callback set 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -312> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -311> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -310> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -309> 2023-12-03T11:35:34.944+0000 7ff9d892c800 1 librados: init done 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -308> 2023-12-03T11:35:34.945+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -307> 2023-12-03T11:35:34.946+0000 7ff9b97fa640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -306> 2023-12-03T11:35:34.946+0000 7ff9b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -305> 2023-12-03T11:35:34.946+0000 7ff9b97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -304> 2023-12-03T11:35:34.946+0000 7ff9d3ef6640 10 monclient: get_auth_request con 0x7ff9b0069850 auth_method 0 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -303> 2023-12-03T11:35:34.946+0000 7ff9d4ef8640 10 monclient: get_auth_request con 0x560158481580 auth_method 0 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -302> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.042 INFO:tasks.workunit.client.0.smithi131.stderr: -301> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 realm 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -300> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -299> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -298> 2023-12-03T11:35:34.947+0000 7ff9d892c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -297> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -296> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -295> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -294> 2023-12-03T11:35:34.947+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x560158485370 auth_method 0 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -293> 2023-12-03T11:35:34.948+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -292> 2023-12-03T11:35:34.948+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -291> 2023-12-03T11:35:34.948+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -290> 2023-12-03T11:35:34.948+0000 7ff9d892c800 20 searching for the correct realm 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -289> 2023-12-03T11:35:34.948+0000 7ff9d3ef6640 10 monclient: get_auth_request con 0x56015848a330 auth_method 0 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -288> 2023-12-03T11:35:34.949+0000 7ff9d4ef8640 10 monclient: get_auth_request con 0x7ff9c8036040 auth_method 0 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -287> 2023-12-03T11:35:34.950+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x7ff9cc05eb30 auth_method 0 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -286> 2023-12-03T11:35:34.950+0000 7ff9d3ef6640 10 monclient: get_auth_request con 0x7ff9c409ca50 auth_method 0 2023-12-03T11:35:35.043 INFO:tasks.workunit.client.0.smithi131.stderr: -285> 2023-12-03T11:35:34.952+0000 7ff9d4ef8640 10 monclient: get_auth_request con 0x7ff9c8037bb0 auth_method 0 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -284> 2023-12-03T11:35:34.954+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x7ff9c800d3e0 auth_method 0 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -283> 2023-12-03T11:35:34.956+0000 7ff9d46f7640 0 -- 172.21.15.131:0/2108145607 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7ff9c800d3e0 msgr2=0x7ff9c800d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -282> 2023-12-03T11:35:34.956+0000 7ff9b97fa640 1 client.7251.objecter ms_handle_reset 0x7ff9c800d3e0 session 0x7ff9c8035dc0 osd.0 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -281> 2023-12-03T11:35:34.956+0000 7ff9b97fa640 10 monclient: _renew_subs 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -280> 2023-12-03T11:35:34.956+0000 7ff9b97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -279> 2023-12-03T11:35:34.956+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x7ff9b0079670 auth_method 0 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -278> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -277> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -276> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -275> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -274> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -273> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -272> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.044 INFO:tasks.workunit.client.0.smithi131.stderr: -271> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -270> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -269> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -268> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 zone default found 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -267> 2023-12-03T11:35:34.959+0000 7ff9d892c800 4 Realm: () 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -266> 2023-12-03T11:35:34.959+0000 7ff9d892c800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -265> 2023-12-03T11:35:34.959+0000 7ff9d892c800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -264> 2023-12-03T11:35:34.959+0000 7ff9d892c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -263> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 zonegroup default 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -262> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -261> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -260> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -259> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -258> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -257> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.045 INFO:tasks.workunit.client.0.smithi131.stderr: -256> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 started sync module instance, tier type = 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -255> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -254> 2023-12-03T11:35:34.963+0000 7ff9d46f7640 0 -- 172.21.15.131:0/2108145607 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7ff9cc05eb30 msgr2=0x7ff9cc055cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -253> 2023-12-03T11:35:34.963+0000 7ff9b97fa640 1 client.7251.objecter ms_handle_reset 0x7ff9cc05eb30 session 0x7ff9cc086550 osd.2 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -252> 2023-12-03T11:35:34.963+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x7ff9c800d3e0 auth_method 0 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -251> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=0 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -250> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=1 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -249> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=2 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -248> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=3 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -247> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=4 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -246> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=5 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -245> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=6 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -244> 2023-12-03T11:35:34.968+0000 7ff9d892c800 20 add_watcher() i=7 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -243> 2023-12-03T11:35:34.968+0000 7ff9d892c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:35.046 INFO:tasks.workunit.client.0.smithi131.stderr: -242> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding auth protocol: cephx 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -241> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding auth protocol: cephx 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -240> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding auth protocol: cephx 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -239> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -238> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -237> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -236> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -235> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -234> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -233> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -232> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -231> 2023-12-03T11:35:34.970+0000 7ff99a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -230> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -229> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -228> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.047 INFO:tasks.workunit.client.0.smithi131.stderr: -227> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr: -226> 2023-12-03T11:35:34.970+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr: -225> 2023-12-03T11:35:34.970+0000 7ff9d892c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr: -224> 2023-12-03T11:35:34.970+0000 7ff9d892c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr: -223> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command cache list hook 0x560158370860 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr: -222> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command cache inspect hook 0x560158370860 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr: -221> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command cache erase hook 0x560158370860 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr: -220> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command cache zap hook 0x560158370860 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr: -219> 2023-12-03T11:35:34.970+0000 7ff9d892c800 10 monclient: get_monmap_and_config 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr: -218> 2023-12-03T11:35:34.970+0000 7ff9d892c800 10 monclient: build_initial_monmap 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr: -217> 2023-12-03T11:35:34.970+0000 7ff9d892c800 1 build_initial for_mkfs: 0 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr: -216> 2023-12-03T11:35:34.970+0000 7ff9d892c800 10 monclient: monmap: 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:35.048 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr: -215> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding auth protocol: cephx 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr: -214> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding auth protocol: cephx 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr: -213> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding auth protocol: cephx 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr: -212> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr: -211> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr: -210> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr: -209> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.049 INFO:tasks.workunit.client.0.smithi131.stderr: -208> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -207> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -206> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -205> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -204> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -203> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -202> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -201> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -200> 2023-12-03T11:35:34.970+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -199> 2023-12-03T11:35:34.970+0000 7ff9d892c800 10 monclient: init 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -198> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding auth protocol: cephx 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -197> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding auth protocol: cephx 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -196> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding auth protocol: cephx 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -195> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.050 INFO:tasks.workunit.client.0.smithi131.stderr: -194> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -193> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -192> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -191> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -190> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -189> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -188> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -187> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -186> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -185> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -184> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -183> 2023-12-03T11:35:34.971+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -182> 2023-12-03T11:35:34.971+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -181> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command rotate-key cmddesc rotate-key hook 0x7ffe05de8e28 EEXIST 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -180> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:35.051 INFO:tasks.workunit.client.0.smithi131.stderr: -179> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -178> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-b con 0x5601584c6960 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -177> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-a con 0x5601584c2330 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -176> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-c con 0x5601584cad80 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -175> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -174> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -173> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -172> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -171> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): authenticate will time out at 1626.349923s 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -170> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request con 0x5601584c2330 auth_method 0 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -169> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -168> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -167> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -166> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request con 0x5601584cad80 auth_method 0 2023-12-03T11:35:35.052 INFO:tasks.workunit.client.0.smithi131.stderr: -165> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -164> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -163> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -162> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -161> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -160> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -159> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -158> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -157> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -156> 2023-12-03T11:35:34.971+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request con 0x5601584c6960 auth_method 0 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -155> 2023-12-03T11:35:34.971+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -154> 2023-12-03T11:35:34.971+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -153> 2023-12-03T11:35:34.971+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -152> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_done global_id 7254 payload 274 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -151> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient: _finish_hunting 0 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -150> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 1 monclient: found mon.noname-a 2023-12-03T11:35:35.053 INFO:tasks.workunit.client.0.smithi131.stderr: -149> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr: -148> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr: -147> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr: -146> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: dump: 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.054 INFO:tasks.workunit.client.0.smithi131.stderr: -145> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: _finish_auth 0 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr: -144> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: _check_auth_tickets 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr: -143> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr: -142> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr: -141> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr: -140> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: dump: 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.055 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr: -139> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 monclient: authenticate success, global_id 7254 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr: -138> 2023-12-03T11:35:34.972+0000 7ff9d892c800 10 monclient: get_monmap_and_config success 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr: -137> 2023-12-03T11:35:34.972+0000 7ff9d892c800 4 set_mon_vals no callback set 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr: -136> 2023-12-03T11:35:34.972+0000 7ff9d892c800 10 monclient: shutdown 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr: -135> 2023-12-03T11:35:34.972+0000 7ff9d892c800 10 monclient: build_initial_monmap 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr: -134> 2023-12-03T11:35:34.972+0000 7ff9d892c800 1 build_initial for_mkfs: 0 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr: -133> 2023-12-03T11:35:34.972+0000 7ff9d892c800 10 monclient: monmap: 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:35.056 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -132> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding auth protocol: cephx 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -131> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding auth protocol: cephx 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -130> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding auth protocol: cephx 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -129> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -128> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -127> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -126> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -125> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -124> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -123> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -122> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.057 INFO:tasks.workunit.client.0.smithi131.stderr: -121> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -120> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -119> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -118> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -117> 2023-12-03T11:35:34.973+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -116> 2023-12-03T11:35:34.973+0000 7ff9d892c800 1 librados: starting msgr at 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -115> 2023-12-03T11:35:34.973+0000 7ff9d892c800 1 librados: starting objecter 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -114> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command objecter_requests cmddesc objecter_requests hook 0x560158495160 EEXIST 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -113> 2023-12-03T11:35:34.973+0000 7ff9d892c800 1 librados: setting wanted keys 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -112> 2023-12-03T11:35:34.973+0000 7ff9d892c800 1 librados: calling monclient init 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -111> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient: init 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -110> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding auth protocol: cephx 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -109> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding auth protocol: cephx 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -108> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding auth protocol: cephx 2023-12-03T11:35:35.058 INFO:tasks.workunit.client.0.smithi131.stderr: -107> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -106> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -105> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -104> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -103> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -102> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -101> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -100> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -99> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -98> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -97> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -96> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -95> 2023-12-03T11:35:34.973+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -94> 2023-12-03T11:35:34.973+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -93> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command rotate-key cmddesc rotate-key hook 0x5601584cb8a0 EEXIST 2023-12-03T11:35:35.059 INFO:tasks.workunit.client.0.smithi131.stderr: -92> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -91> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -90> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-c con 0x5601584c2330 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -89> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-b con 0x5601584c6960 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -88> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-a con 0x5601584cad80 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -87> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -86> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -85> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -84> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -83> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): authenticate will time out at 1626.352301s 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -82> 2023-12-03T11:35:34.973+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request con 0x5601584c2330 auth_method 0 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -81> 2023-12-03T11:35:34.973+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -80> 2023-12-03T11:35:34.973+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -79> 2023-12-03T11:35:34.973+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.060 INFO:tasks.workunit.client.0.smithi131.stderr: -78> 2023-12-03T11:35:34.973+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request con 0x5601584cad80 auth_method 0 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -77> 2023-12-03T11:35:34.973+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -76> 2023-12-03T11:35:34.973+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -75> 2023-12-03T11:35:34.973+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -74> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -73> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -72> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -71> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request con 0x5601584c6960 auth_method 0 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -70> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -69> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -68> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -67> 2023-12-03T11:35:34.974+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -66> 2023-12-03T11:35:34.974+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -65> 2023-12-03T11:35:34.974+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -64> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -63> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.061 INFO:tasks.workunit.client.0.smithi131.stderr: -62> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr: -61> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_done global_id 6899 payload 824 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr: -60> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient: _finish_hunting 0 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr: -59> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 1 monclient: found mon.noname-c 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr: -58> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr: -57> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr: -56> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr: -55> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: dump: 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.062 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr: -54> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: _finish_auth 0 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr: -53> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: _check_auth_tickets 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr: -52> 2023-12-03T11:35:34.974+0000 7ff9d892c800 5 monclient: authenticate success, global_id 6899 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr: -51> 2023-12-03T11:35:34.974+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr: -50> 2023-12-03T11:35:34.974+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr: -49> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr: -48> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr: -47> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr: -46> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: dump: 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.063 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr: -45> 2023-12-03T11:35:34.974+0000 7ff999fe3640 4 set_mon_vals no callback set 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr: -44> 2023-12-03T11:35:34.974+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr: -43> 2023-12-03T11:35:34.974+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr: -42> 2023-12-03T11:35:34.974+0000 7ff9d892c800 1 librados: init done 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr: -41> 2023-12-03T11:35:34.974+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command cr dump hook 0x5601584da788 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr: -40> 2023-12-03T11:35:34.975+0000 7ff90bfff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr: -39> 2023-12-03T11:35:34.975+0000 7ff90bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.064 INFO:tasks.workunit.client.0.smithi131.stderr: -38> 2023-12-03T11:35:34.975+0000 7ff90bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -37> 2023-12-03T11:35:34.976+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x7ff910069820 auth_method 0 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -36> 2023-12-03T11:35:34.976+0000 7ff9d892c800 5 note: GC not initialized 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -35> 2023-12-03T11:35:34.976+0000 7ff9097fa640 20 reqs_thread_entry: start 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -34> 2023-12-03T11:35:34.976+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command sync trace show hook 0x7ff9c40043a0 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -33> 2023-12-03T11:35:34.976+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command sync trace history hook 0x7ff9c40043a0 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -32> 2023-12-03T11:35:34.976+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command sync trace active hook 0x7ff9c40043a0 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -31> 2023-12-03T11:35:34.976+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command sync trace active_short hook 0x7ff9c40043a0 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -30> 2023-12-03T11:35:34.976+0000 7ff9d892c800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -29> 2023-12-03T11:35:34.976+0000 7ff9d892c800 20 Filter name: none 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -28> 2023-12-03T11:35:34.976+0000 7ff902ffd640 20 reqs_thread_entry: start 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -27> 2023-12-03T11:35:34.976+0000 7ff9d892c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -26> 2023-12-03T11:35:34.976+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -25> 2023-12-03T11:35:34.976+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -24> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:35:35.065 INFO:tasks.workunit.client.0.smithi131.stderr: -23> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -22> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 : miss 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -21> 2023-12-03T11:35:34.977+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -20> 2023-12-03T11:35:34.977+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -19> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -18> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -17> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -16> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -15> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -14> 2023-12-03T11:35:34.977+0000 7ff9d3ef6640 10 monclient: get_auth_request con 0x560158519270 auth_method 0 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -13> 2023-12-03T11:35:34.981+0000 7ff9d892c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -12> 2023-12-03T11:35:34.981+0000 7ff9d892c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -11> 2023-12-03T11:35:34.981+0000 7ff9d892c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -10> 2023-12-03T11:35:34.981+0000 7ff9d892c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27, ofs0, ns] 2023-12-03T11:35:35.066 INFO:tasks.workunit.client.0.smithi131.stderr: -9> 2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791320 cookie 94563776135280 notifier 7251 bl.length()=873 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: -8> 2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: -7> 2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: -6> 2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: -5> 2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): orig_sources= new_sources= 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: -4> 2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): potential sources added=[] removed=[] 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: -3> 2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): orig_dests= new_dests= 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: -2> 2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): potential dests added=[] removed=[] 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: -1> 2023-12-03T11:35:34.983+0000 7ff9d892c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff9d892c800 time 2023-12-03T11:35:34.984121+0000 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff9db56eef8] 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7ff9db56f0b6] 2023-12-03T11:35:35.067 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560156c0ca71] 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x560156c18f34] 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7ff9d8e3feb0] 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 0> 2023-12-03T11:35:34.984+0000 7ff9d892c800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7ff9d892c800 thread_name:radosgw-admin 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff9d8e54db0] 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff9d8ea154c] 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:35:35.068 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff9db56ef52] 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7ff9db56f0b6] 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560156c0ca71] 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x560156c18f34] 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7ff9d8e3feb0] 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr:--- logging levels --- 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 none 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 lockdep 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 context 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 crush 2023-12-03T11:35:35.069 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_balancer 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_locker 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log_expire 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_migrator 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 buffer 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 timer 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 filer 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 striper 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 objecter 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rados 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_mirror 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_replay 2023-12-03T11:35:35.070 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_pwl 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 journaler 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objectcacher 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 client 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 osd 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 optracker 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objclass 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 filestore 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 journal 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 ms 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mon 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 0/10 monc 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 paxos 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 tp 2023-12-03T11:35:35.071 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 auth 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 crypto 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 finisher 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 reserver 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 heartbeatmap 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 perfcounter 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 20/20 rgw 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_sync 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_datacache 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_access 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_flight 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 javaclient 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 asok 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 throttle 2023-12-03T11:35:35.072 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 refs 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 compressor 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluestore 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluefs 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 bdev 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 kstore 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 4/ 5 rocksdb 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 fuse 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 2/ 5 mgr 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mgrc 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 dpdk 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 eventtrace 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 prioritycache 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 test 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:35:35.073 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephsqlite 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_onode 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_odata 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_omap 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_tm 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_t 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_epm 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_lba 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cache 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_journal 2023-12-03T11:35:35.074 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_device 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_backref 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 alienstore 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mclock 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cyanstore 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 ceph_exporter 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 memstore 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 trace 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: -2/-2 (syslog threshold) 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 99/99 (stderr threshold) 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff902ffd640 / http_manager 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9097fa640 / http_manager 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff90bfff640 / ms_dispatch 2023-12-03T11:35:35.075 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff999fe3640 / io_context_pool 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff99a7e4640 / rgw_dt_lg_renew 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9b97fa640 / ms_dispatch 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9baffd640 / io_context_pool 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d1ef2640 / ms_dispatch 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d2ef4640 / io_context_pool 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d3ef6640 / msgr-worker-2 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d46f7640 / msgr-worker-1 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d4ef8640 / msgr-worker-0 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d892c800 / radosgw-admin 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: max_recent 500 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: max_new 1000 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: log_file /var/log/ceph/ceph-client.admin.104710.log 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr:--- end dump of recent events --- 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr:--- begin dump of recent events --- 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: -499> 2023-12-03T11:35:34.940+0000 7ff9d2ef4640 4 set_mon_vals no callback set 2023-12-03T11:35:35.076 INFO:tasks.workunit.client.0.smithi131.stderr: -498> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr: -497> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr: -496> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr: -495> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr: -494> 2023-12-03T11:35:34.940+0000 7ff9d892c800 1 librados: init done 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr: -493> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: get_monmap_and_config 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr: -492> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: build_initial_monmap 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr: -491> 2023-12-03T11:35:34.940+0000 7ff9d892c800 1 build_initial for_mkfs: 0 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr: -490> 2023-12-03T11:35:34.940+0000 7ff9d892c800 10 monclient: monmap: 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:35.077 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -489> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding auth protocol: cephx 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -488> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding auth protocol: cephx 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -487> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding auth protocol: cephx 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -486> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -485> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -484> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -483> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -482> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -481> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -480> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -479> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -478> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.078 INFO:tasks.workunit.client.0.smithi131.stderr: -477> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -476> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: crc 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -475> 2023-12-03T11:35:34.940+0000 7ff9d892c800 5 AuthRegistry(0x560158432bb0) adding con mode: secure 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -474> 2023-12-03T11:35:34.941+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -473> 2023-12-03T11:35:34.941+0000 7ff9d892c800 10 monclient: init 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -472> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding auth protocol: cephx 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -471> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding auth protocol: cephx 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -470> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding auth protocol: cephx 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -469> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -468> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -467> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -466> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -465> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -464> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.079 INFO:tasks.workunit.client.0.smithi131.stderr: -463> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -462> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -461> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -460> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -459> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: crc 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -458> 2023-12-03T11:35:34.941+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8760) adding con mode: secure 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -457> 2023-12-03T11:35:34.941+0000 7ff9d1ef2640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -456> 2023-12-03T11:35:34.941+0000 7ff9d1ef2640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -455> 2023-12-03T11:35:34.941+0000 7ff9d1ef2640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -454> 2023-12-03T11:35:34.941+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -453> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient: get_auth_request con 0x7ff9c0069820 auth_method 0 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -452> 2023-12-03T11:35:34.942+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -451> 2023-12-03T11:35:34.942+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command rotate-key cmddesc rotate-key hook 0x7ffe05de88a8 EEXIST 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -450> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:35.080 INFO:tasks.workunit.client.0.smithi131.stderr: -449> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -448> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-b con 0x560158438420 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -447> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-a con 0x560158438800 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -446> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-c con 0x56015845a780 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -445> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -444> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -443> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -442> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -441> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient(hunting): authenticate will time out at 1626.320587s 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -440> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request con 0x56015845a780 auth_method 0 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -439> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -438> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -437> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -436> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request con 0x560158438420 auth_method 0 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -435> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.081 INFO:tasks.workunit.client.0.smithi131.stderr: -434> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -433> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -432> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request con 0x560158438800 auth_method 0 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -431> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -430> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -429> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -428> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -427> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -426> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -425> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -424> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -423> 2023-12-03T11:35:34.942+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -422> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -421> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.082 INFO:tasks.workunit.client.0.smithi131.stderr: -420> 2023-12-03T11:35:34.942+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr: -419> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_done global_id 6890 payload 274 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr: -418> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient: _finish_hunting 0 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr: -417> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 1 monclient: found mon.noname-c 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr: -416> 2023-12-03T11:35:34.942+0000 7ff9d4ef8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr: -415> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr: -414> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr: -413> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: dump: 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.083 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr: -412> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: _finish_auth 0 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr: -411> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: _check_auth_tickets 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr: -410> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr: -409> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr: -408> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr: -407> 2023-12-03T11:35:34.942+0000 7ff9baffd640 10 monclient: dump: 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.084 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr: -406> 2023-12-03T11:35:34.942+0000 7ff9d892c800 5 monclient: authenticate success, global_id 6890 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr: -405> 2023-12-03T11:35:34.942+0000 7ff9d892c800 10 monclient: get_monmap_and_config success 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr: -404> 2023-12-03T11:35:34.942+0000 7ff9d892c800 4 set_mon_vals no callback set 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr: -403> 2023-12-03T11:35:34.943+0000 7ff9d892c800 10 monclient: shutdown 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr: -402> 2023-12-03T11:35:34.943+0000 7ff9d892c800 10 monclient: build_initial_monmap 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr: -401> 2023-12-03T11:35:34.943+0000 7ff9d892c800 1 build_initial for_mkfs: 0 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr: -400> 2023-12-03T11:35:34.943+0000 7ff9d892c800 10 monclient: monmap: 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:35.085 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr: -399> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding auth protocol: cephx 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr: -398> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding auth protocol: cephx 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr: -397> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding auth protocol: cephx 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr: -396> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr: -395> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr: -394> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr: -393> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr: -392> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr: -391> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.086 INFO:tasks.workunit.client.0.smithi131.stderr: -390> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -389> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -388> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -387> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -386> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: crc 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -385> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x5601582ebe10) adding con mode: secure 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -384> 2023-12-03T11:35:34.943+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -383> 2023-12-03T11:35:34.943+0000 7ff9d892c800 1 librados: starting msgr at 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -382> 2023-12-03T11:35:34.943+0000 7ff9d892c800 1 librados: starting objecter 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -381> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command objecter_requests cmddesc objecter_requests hook 0x56015841e680 EEXIST 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -380> 2023-12-03T11:35:34.943+0000 7ff9d892c800 1 librados: setting wanted keys 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -379> 2023-12-03T11:35:34.943+0000 7ff9d892c800 1 librados: calling monclient init 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -378> 2023-12-03T11:35:34.943+0000 7ff9d892c800 10 monclient: init 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -377> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding auth protocol: cephx 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -376> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding auth protocol: cephx 2023-12-03T11:35:35.087 INFO:tasks.workunit.client.0.smithi131.stderr: -375> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding auth protocol: cephx 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -374> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -373> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -372> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -371> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -370> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -369> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -368> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -367> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -366> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -365> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -364> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: crc 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -363> 2023-12-03T11:35:34.943+0000 7ff9d892c800 5 AuthRegistry(0x560158430e28) adding con mode: secure 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -362> 2023-12-03T11:35:34.943+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -361> 2023-12-03T11:35:34.944+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -360> 2023-12-03T11:35:34.944+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command rotate-key cmddesc rotate-key hook 0x560158430f70 EEXIST 2023-12-03T11:35:35.088 INFO:tasks.workunit.client.0.smithi131.stderr: -359> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -358> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _add_conns ranks=[0,2,1] 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -357> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-a con 0x560158438420 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -356> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-c con 0x560158466d50 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -355> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-b con 0x560158475f80 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -354> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -353> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -352> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -351> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -350> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient(hunting): authenticate will time out at 1626.322631s 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -349> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request con 0x560158438420 auth_method 0 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -348> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -347> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -346> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.089 INFO:tasks.workunit.client.0.smithi131.stderr: -345> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request con 0x560158466d50 auth_method 0 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -344> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -343> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -342> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -341> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request con 0x560158475f80 auth_method 0 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -340> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -339> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -338> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -337> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -336> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -335> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -334> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -333> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -332> 2023-12-03T11:35:34.944+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.090 INFO:tasks.workunit.client.0.smithi131.stderr: -331> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr: -330> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr: -329> 2023-12-03T11:35:34.944+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr: -328> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_done global_id 7251 payload 824 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr: -327> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient: _finish_hunting 0 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr: -326> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 1 monclient: found mon.noname-a 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr: -325> 2023-12-03T11:35:34.944+0000 7ff9d46f7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr: -324> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr: -323> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr: -322> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: dump: 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.091 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr: -321> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: _finish_auth 0 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr: -320> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: _check_auth_tickets 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr: -319> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr: -318> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr: -317> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr: -316> 2023-12-03T11:35:34.944+0000 7ff9b97fa640 10 monclient: dump: 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.092 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr: -315> 2023-12-03T11:35:34.944+0000 7ff9d892c800 5 monclient: authenticate success, global_id 7251 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr: -314> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr: -313> 2023-12-03T11:35:34.944+0000 7ff9baffd640 4 set_mon_vals no callback set 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr: -312> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr: -311> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr: -310> 2023-12-03T11:35:34.944+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr: -309> 2023-12-03T11:35:34.944+0000 7ff9d892c800 1 librados: init done 2023-12-03T11:35:35.093 INFO:tasks.workunit.client.0.smithi131.stderr: -308> 2023-12-03T11:35:34.945+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -307> 2023-12-03T11:35:34.946+0000 7ff9b97fa640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -306> 2023-12-03T11:35:34.946+0000 7ff9b97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -305> 2023-12-03T11:35:34.946+0000 7ff9b97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -304> 2023-12-03T11:35:34.946+0000 7ff9d3ef6640 10 monclient: get_auth_request con 0x7ff9b0069850 auth_method 0 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -303> 2023-12-03T11:35:34.946+0000 7ff9d4ef8640 10 monclient: get_auth_request con 0x560158481580 auth_method 0 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -302> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -301> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 realm 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -300> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -299> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -298> 2023-12-03T11:35:34.947+0000 7ff9d892c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -297> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -296> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -295> 2023-12-03T11:35:34.947+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.094 INFO:tasks.workunit.client.0.smithi131.stderr: -294> 2023-12-03T11:35:34.947+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x560158485370 auth_method 0 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -293> 2023-12-03T11:35:34.948+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -292> 2023-12-03T11:35:34.948+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -291> 2023-12-03T11:35:34.948+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -290> 2023-12-03T11:35:34.948+0000 7ff9d892c800 20 searching for the correct realm 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -289> 2023-12-03T11:35:34.948+0000 7ff9d3ef6640 10 monclient: get_auth_request con 0x56015848a330 auth_method 0 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -288> 2023-12-03T11:35:34.949+0000 7ff9d4ef8640 10 monclient: get_auth_request con 0x7ff9c8036040 auth_method 0 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -287> 2023-12-03T11:35:34.950+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x7ff9cc05eb30 auth_method 0 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -286> 2023-12-03T11:35:34.950+0000 7ff9d3ef6640 10 monclient: get_auth_request con 0x7ff9c409ca50 auth_method 0 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -285> 2023-12-03T11:35:34.952+0000 7ff9d4ef8640 10 monclient: get_auth_request con 0x7ff9c8037bb0 auth_method 0 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -284> 2023-12-03T11:35:34.954+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x7ff9c800d3e0 auth_method 0 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -283> 2023-12-03T11:35:34.956+0000 7ff9d46f7640 0 -- 172.21.15.131:0/2108145607 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7ff9c800d3e0 msgr2=0x7ff9c800d860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -282> 2023-12-03T11:35:34.956+0000 7ff9b97fa640 1 client.7251.objecter ms_handle_reset 0x7ff9c800d3e0 session 0x7ff9c8035dc0 osd.0 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -281> 2023-12-03T11:35:34.956+0000 7ff9b97fa640 10 monclient: _renew_subs 2023-12-03T11:35:35.095 INFO:tasks.workunit.client.0.smithi131.stderr: -280> 2023-12-03T11:35:34.956+0000 7ff9b97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.131:3300/0 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -279> 2023-12-03T11:35:34.956+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x7ff9b0079670 auth_method 0 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -278> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -277> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -276> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -275> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -274> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -273> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -272> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -271> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -270> 2023-12-03T11:35:34.958+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -269> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -268> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 zone default found 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -267> 2023-12-03T11:35:34.959+0000 7ff9d892c800 4 Realm: () 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -266> 2023-12-03T11:35:34.959+0000 7ff9d892c800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:35.096 INFO:tasks.workunit.client.0.smithi131.stderr: -265> 2023-12-03T11:35:34.959+0000 7ff9d892c800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -264> 2023-12-03T11:35:34.959+0000 7ff9d892c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -263> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 zonegroup default 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -262> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -261> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -260> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -259> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -258> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -257> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -256> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 started sync module instance, tier type = 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -255> 2023-12-03T11:35:34.959+0000 7ff9d892c800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -254> 2023-12-03T11:35:34.963+0000 7ff9d46f7640 0 -- 172.21.15.131:0/2108145607 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7ff9cc05eb30 msgr2=0x7ff9cc055cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -253> 2023-12-03T11:35:34.963+0000 7ff9b97fa640 1 client.7251.objecter ms_handle_reset 0x7ff9cc05eb30 session 0x7ff9cc086550 osd.2 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -252> 2023-12-03T11:35:34.963+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x7ff9c800d3e0 auth_method 0 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -251> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=0 2023-12-03T11:35:35.097 INFO:tasks.workunit.client.0.smithi131.stderr: -250> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=1 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -249> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=2 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -248> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=3 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -247> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=4 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -246> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=5 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -245> 2023-12-03T11:35:34.967+0000 7ff9d892c800 20 add_watcher() i=6 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -244> 2023-12-03T11:35:34.968+0000 7ff9d892c800 20 add_watcher() i=7 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -243> 2023-12-03T11:35:34.968+0000 7ff9d892c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -242> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding auth protocol: cephx 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -241> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding auth protocol: cephx 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -240> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding auth protocol: cephx 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -239> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -238> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -237> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -236> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.098 INFO:tasks.workunit.client.0.smithi131.stderr: -235> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -234> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -233> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -232> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -231> 2023-12-03T11:35:34.970+0000 7ff99a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -230> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -229> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -228> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: crc 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -227> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de9190) adding con mode: secure 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -226> 2023-12-03T11:35:34.970+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -225> 2023-12-03T11:35:34.970+0000 7ff9d892c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -224> 2023-12-03T11:35:34.970+0000 7ff9d892c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -223> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command cache list hook 0x560158370860 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -222> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command cache inspect hook 0x560158370860 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -221> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command cache erase hook 0x560158370860 2023-12-03T11:35:35.099 INFO:tasks.workunit.client.0.smithi131.stderr: -220> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command cache zap hook 0x560158370860 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr: -219> 2023-12-03T11:35:34.970+0000 7ff9d892c800 10 monclient: get_monmap_and_config 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr: -218> 2023-12-03T11:35:34.970+0000 7ff9d892c800 10 monclient: build_initial_monmap 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr: -217> 2023-12-03T11:35:34.970+0000 7ff9d892c800 1 build_initial for_mkfs: 0 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr: -216> 2023-12-03T11:35:34.970+0000 7ff9d892c800 10 monclient: monmap: 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.100 INFO:tasks.workunit.client.0.smithi131.stderr: -215> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding auth protocol: cephx 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -214> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding auth protocol: cephx 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -213> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding auth protocol: cephx 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -212> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -211> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -210> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -209> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -208> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -207> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -206> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -205> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -204> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -203> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -202> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: crc 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -201> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x5601584c8240) adding con mode: secure 2023-12-03T11:35:35.101 INFO:tasks.workunit.client.0.smithi131.stderr: -200> 2023-12-03T11:35:34.970+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -199> 2023-12-03T11:35:34.970+0000 7ff9d892c800 10 monclient: init 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -198> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding auth protocol: cephx 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -197> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding auth protocol: cephx 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -196> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding auth protocol: cephx 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -195> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -194> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -193> 2023-12-03T11:35:34.970+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -192> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -191> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -190> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -189> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -188> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -187> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.102 INFO:tasks.workunit.client.0.smithi131.stderr: -186> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -185> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: crc 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -184> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 AuthRegistry(0x7ffe05de8ce0) adding con mode: secure 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -183> 2023-12-03T11:35:34.971+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -182> 2023-12-03T11:35:34.971+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -181> 2023-12-03T11:35:34.971+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command rotate-key cmddesc rotate-key hook 0x7ffe05de8e28 EEXIST 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -180> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -179> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient: _add_conns ranks=[1,0,2] 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -178> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-b con 0x5601584c6960 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -177> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-a con 0x5601584c2330 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -176> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-c con 0x5601584cad80 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -175> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -174> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -173> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.103 INFO:tasks.workunit.client.0.smithi131.stderr: -172> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -171> 2023-12-03T11:35:34.971+0000 7ff9d892c800 10 monclient(hunting): authenticate will time out at 1626.349923s 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -170> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request con 0x5601584c2330 auth_method 0 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -169> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -168> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -167> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -166> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request con 0x5601584cad80 auth_method 0 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -165> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -164> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -163> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -162> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -161> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -160> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -159> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -158> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -157> 2023-12-03T11:35:34.971+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.104 INFO:tasks.workunit.client.0.smithi131.stderr: -156> 2023-12-03T11:35:34.971+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request con 0x5601584c6960 auth_method 0 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr: -155> 2023-12-03T11:35:34.971+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr: -154> 2023-12-03T11:35:34.971+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr: -153> 2023-12-03T11:35:34.971+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr: -152> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_done global_id 7254 payload 274 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr: -151> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient: _finish_hunting 0 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr: -150> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 1 monclient: found mon.noname-a 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr: -149> 2023-12-03T11:35:34.971+0000 7ff9d46f7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.131:3300/0 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr: -148> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr: -147> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr: -146> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: dump: 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.105 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr: -145> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: _finish_auth 0 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr: -144> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: _check_auth_tickets 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr: -143> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr: -142> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr: -141> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr: -140> 2023-12-03T11:35:34.972+0000 7ff999fe3640 10 monclient: dump: 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.106 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr: -139> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 monclient: authenticate success, global_id 7254 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr: -138> 2023-12-03T11:35:34.972+0000 7ff9d892c800 10 monclient: get_monmap_and_config success 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr: -137> 2023-12-03T11:35:34.972+0000 7ff9d892c800 4 set_mon_vals no callback set 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr: -136> 2023-12-03T11:35:34.972+0000 7ff9d892c800 10 monclient: shutdown 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr: -135> 2023-12-03T11:35:34.972+0000 7ff9d892c800 10 monclient: build_initial_monmap 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr: -134> 2023-12-03T11:35:34.972+0000 7ff9d892c800 1 build_initial for_mkfs: 0 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr: -133> 2023-12-03T11:35:34.972+0000 7ff9d892c800 10 monclient: monmap: 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 0 2023-12-03T11:35:35.107 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 00000000-0000-0000-0000-000000000000 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 0.000000 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr:created 0.000000 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 0 (unknown) 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.noname-a 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.noname-b 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.noname-c 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr: -132> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding auth protocol: cephx 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr: -131> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding auth protocol: cephx 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr: -130> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding auth protocol: cephx 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr: -129> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr: -128> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.108 INFO:tasks.workunit.client.0.smithi131.stderr: -127> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -126> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -125> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -124> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -123> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -122> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -121> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -120> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -119> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: crc 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -118> 2023-12-03T11:35:34.972+0000 7ff9d892c800 5 AuthRegistry(0x5601584bea50) adding con mode: secure 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -117> 2023-12-03T11:35:34.973+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -116> 2023-12-03T11:35:34.973+0000 7ff9d892c800 1 librados: starting msgr at 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -115> 2023-12-03T11:35:34.973+0000 7ff9d892c800 1 librados: starting objecter 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -114> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command objecter_requests cmddesc objecter_requests hook 0x560158495160 EEXIST 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -113> 2023-12-03T11:35:34.973+0000 7ff9d892c800 1 librados: setting wanted keys 2023-12-03T11:35:35.109 INFO:tasks.workunit.client.0.smithi131.stderr: -112> 2023-12-03T11:35:34.973+0000 7ff9d892c800 1 librados: calling monclient init 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -111> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient: init 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -110> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding auth protocol: cephx 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -109> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding auth protocol: cephx 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -108> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding auth protocol: cephx 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -107> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -106> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -105> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -104> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -103> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -102> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -101> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -100> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -99> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.110 INFO:tasks.workunit.client.0.smithi131.stderr: -98> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -97> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: crc 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -96> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 AuthRegistry(0x5601584cb758) adding con mode: secure 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -95> 2023-12-03T11:35:34.973+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -94> 2023-12-03T11:35:34.973+0000 7ff9d892c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -93> 2023-12-03T11:35:34.973+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command rotate-key cmddesc rotate-key hook 0x5601584cb8a0 EEXIST 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -92> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient: _reopen_session rank -1 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -91> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient: _add_conns ranks=[2,1,0] 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -90> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-c con 0x5601584c2330 addr [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -89> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-b con 0x5601584c6960 addr [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -88> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): picked mon.noname-a con 0x5601584cad80 addr [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -87> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -86> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -85> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): start opening mon connection 2023-12-03T11:35:35.111 INFO:tasks.workunit.client.0.smithi131.stderr: -84> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): _renew_subs 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -83> 2023-12-03T11:35:34.973+0000 7ff9d892c800 10 monclient(hunting): authenticate will time out at 1626.352301s 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -82> 2023-12-03T11:35:34.973+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request con 0x5601584c2330 auth_method 0 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -81> 2023-12-03T11:35:34.973+0000 7ff9d4ef8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -80> 2023-12-03T11:35:34.973+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -79> 2023-12-03T11:35:34.973+0000 7ff9d4ef8640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -78> 2023-12-03T11:35:34.973+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request con 0x5601584cad80 auth_method 0 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -77> 2023-12-03T11:35:34.973+0000 7ff9d3ef6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -76> 2023-12-03T11:35:34.973+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -75> 2023-12-03T11:35:34.973+0000 7ff9d3ef6640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -74> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -73> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -72> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -71> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request con 0x5601584c6960 auth_method 0 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -70> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2023-12-03T11:35:35.112 INFO:tasks.workunit.client.0.smithi131.stderr: -69> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): _init_auth method 2 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -68> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): _init_auth creating new auth 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -67> 2023-12-03T11:35:34.974+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -66> 2023-12-03T11:35:34.974+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -65> 2023-12-03T11:35:34.974+0000 7ff9d3ef6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -64> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload 9 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -63> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -62> 2023-12-03T11:35:34.974+0000 7ff9d46f7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -61> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient(hunting): handle_auth_done global_id 6899 payload 824 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -60> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient: _finish_hunting 0 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -59> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 1 monclient: found mon.noname-c 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -58> 2023-12-03T11:35:34.974+0000 7ff9d4ef8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -57> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -56> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2023-12-03T11:35:35.113 INFO:tasks.workunit.client.0.smithi131.stderr: -55> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: dump: 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr: -54> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: _finish_auth 0 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr: -53> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: _check_auth_tickets 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr: -52> 2023-12-03T11:35:34.974+0000 7ff9d892c800 5 monclient: authenticate success, global_id 6899 2023-12-03T11:35:35.114 INFO:tasks.workunit.client.0.smithi131.stderr: -51> 2023-12-03T11:35:34.974+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr: -50> 2023-12-03T11:35:34.974+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr: -49> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: handle_config config(0 keys) v1 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr: -48> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr: -47> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr: -46> 2023-12-03T11:35:34.974+0000 7ff90bfff640 10 monclient: dump: 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr:epoch 1 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr:fsid 666a215a-2cfd-4a1c-90d3-5202ec868043 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr:last_changed 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr:created 2023-12-03T11:21:20.052221+0000 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr:min_mon_release 18 (reef) 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr:election_strategy: 1 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr:1: [v2:172.21.15.148:3300/0,v1:172.21.15.148:6789/0] mon.b 2023-12-03T11:35:35.115 INFO:tasks.workunit.client.0.smithi131.stderr:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -45> 2023-12-03T11:35:34.974+0000 7ff999fe3640 4 set_mon_vals no callback set 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -44> 2023-12-03T11:35:34.974+0000 7ff9d892c800 10 monclient: _renew_subs 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -43> 2023-12-03T11:35:34.974+0000 7ff9d892c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.131:3301/0 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -42> 2023-12-03T11:35:34.974+0000 7ff9d892c800 1 librados: init done 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -41> 2023-12-03T11:35:34.974+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command cr dump hook 0x5601584da788 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -40> 2023-12-03T11:35:34.975+0000 7ff90bfff640 4 mgrc handle_mgr_map Got map version 5 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -39> 2023-12-03T11:35:34.975+0000 7ff90bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -38> 2023-12-03T11:35:34.975+0000 7ff90bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.148:6832/4108154146,v1:172.21.15.148:6833/4108154146] 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -37> 2023-12-03T11:35:34.976+0000 7ff9d46f7640 10 monclient: get_auth_request con 0x7ff910069820 auth_method 0 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -36> 2023-12-03T11:35:34.976+0000 7ff9d892c800 5 note: GC not initialized 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -35> 2023-12-03T11:35:34.976+0000 7ff9097fa640 20 reqs_thread_entry: start 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -34> 2023-12-03T11:35:34.976+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command sync trace show hook 0x7ff9c40043a0 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -33> 2023-12-03T11:35:34.976+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command sync trace history hook 0x7ff9c40043a0 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -32> 2023-12-03T11:35:34.976+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command sync trace active hook 0x7ff9c40043a0 2023-12-03T11:35:35.116 INFO:tasks.workunit.client.0.smithi131.stderr: -31> 2023-12-03T11:35:34.976+0000 7ff9d892c800 5 asok(0x56015822ba10) register_command sync trace active_short hook 0x7ff9c40043a0 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -30> 2023-12-03T11:35:34.976+0000 7ff9d892c800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -29> 2023-12-03T11:35:34.976+0000 7ff9d892c800 20 Filter name: none 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -28> 2023-12-03T11:35:34.976+0000 7ff902ffd640 20 reqs_thread_entry: start 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -27> 2023-12-03T11:35:34.976+0000 7ff9d892c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -26> 2023-12-03T11:35:34.976+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -25> 2023-12-03T11:35:34.976+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -24> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -23> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -22> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 : miss 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -21> 2023-12-03T11:35:34.977+0000 7ff9d892c800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -20> 2023-12-03T11:35:34.977+0000 7ff9d892c800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -19> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -18> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -17> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:35:35.117 INFO:tasks.workunit.client.0.smithi131.stderr: -16> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -15> 2023-12-03T11:35:34.977+0000 7ff9d892c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -14> 2023-12-03T11:35:34.977+0000 7ff9d3ef6640 10 monclient: get_auth_request con 0x560158519270 auth_method 0 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -13> 2023-12-03T11:35:34.981+0000 7ff9d892c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -12> 2023-12-03T11:35:34.981+0000 7ff9d892c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -11> 2023-12-03T11:35:34.981+0000 7ff9d892c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -10> 2023-12-03T11:35:34.981+0000 7ff9d892c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27, ofs0, ns] 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -9> 2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791320 cookie 94563776135280 notifier 7251 bl.length()=873 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -8> 2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -7> 2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -6> 2023-12-03T11:35:34.981+0000 7ff9baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -5> 2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): orig_sources= new_sources= 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -4> 2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): potential sources added=[] removed=[] 2023-12-03T11:35:35.118 INFO:tasks.workunit.client.0.smithi131.stderr: -3> 2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): orig_dests= new_dests= 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: -2> 2023-12-03T11:35:34.982+0000 7ff9d892c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): potential dests added=[] removed=[] 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: -1> 2023-12-03T11:35:34.983+0000 7ff9d892c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff9d892c800 time 2023-12-03T11:35:34.984121+0000 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7537-gbcbf278c/rpm/el9/BUILD/ceph-18.0.0-7537-gbcbf278c/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ff9db56eef8] 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7ff9db56f0b6] 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560156c0ca71] 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x560156c18f34] 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: 5: main() 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /lib64/libc.so.6(+0x3feb0) [0x7ff9d8e3feb0] 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: 7: __libc_start_main() 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: 8: _start() 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.119 INFO:tasks.workunit.client.0.smithi131.stderr: 0> 2023-12-03T11:35:34.984+0000 7ff9d892c800 -1 *** Caught signal (Aborted) ** 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: in thread 7ff9d892c800 thread_name:radosgw-admin 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff9d8e54db0] 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff9d8ea154c] 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 3: raise() 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 4: abort() 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ff9db56ef52] 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x16f0b6) [0x7ff9db56f0b6] 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560156c0ca71] 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x314) [0x560156c18f34] 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 9: main() 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 10: /lib64/libc.so.6(+0x3feb0) [0x7ff9d8e3feb0] 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 11: __libc_start_main() 2023-12-03T11:35:35.120 INFO:tasks.workunit.client.0.smithi131.stderr: 12: _start() 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr:--- logging levels --- 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 none 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 lockdep 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 context 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 crush 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_balancer 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_locker 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_log_expire 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mds_migrator 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 buffer 2023-12-03T11:35:35.121 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 timer 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 filer 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 striper 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 1 objecter 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rados 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_mirror 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_replay 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 rbd_pwl 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 journaler 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objectcacher 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 immutable_obj_cache 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 client 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 osd 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 optracker 2023-12-03T11:35:35.122 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 objclass 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 filestore 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 journal 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 ms 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mon 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 0/10 monc 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 paxos 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 tp 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 auth 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 crypto 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 finisher 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 reserver 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 heartbeatmap 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 perfcounter 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 20/20 rgw 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_sync 2023-12-03T11:35:35.123 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_datacache 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_access 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_dbstore 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 rgw_flight 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 javaclient 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 asok 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 1 throttle 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 0 refs 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 compressor 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluestore 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 bluefs 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 3 bdev 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 kstore 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 4/ 5 rocksdb 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 fuse 2023-12-03T11:35:35.124 INFO:tasks.workunit.client.0.smithi131.stderr: 2/ 5 mgr 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mgrc 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 dpdk 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 eventtrace 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 prioritycache 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 test 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephfs_mirror 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cephsqlite 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 crimson_interrupt 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_onode 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_odata 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_omap 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_tm 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_t 2023-12-03T11:35:35.125 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cleaner 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_epm 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_lba 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_fixedkv_tree 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_cache 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_journal 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_device 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 seastore_backref 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 alienstore 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 mclock 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 0/ 5 cyanstore 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 ceph_exporter 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 memstore 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 1/ 5 trace 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: -2/-2 (syslog threshold) 2023-12-03T11:35:35.126 INFO:tasks.workunit.client.0.smithi131.stderr: 99/99 (stderr threshold) 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr:--- pthread ID / name mapping for recent threads --- 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff902ffd640 / http_manager 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9097fa640 / http_manager 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff90bfff640 / ms_dispatch 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff999fe3640 / io_context_pool 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff99a7e4640 / rgw_dt_lg_renew 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9b97fa640 / ms_dispatch 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9baffd640 / io_context_pool 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d1ef2640 / ms_dispatch 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d2ef4640 / io_context_pool 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d3ef6640 / msgr-worker-2 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d46f7640 / msgr-worker-1 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d4ef8640 / msgr-worker-0 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: 7ff9d892c800 / radosgw-admin 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: max_recent 500 2023-12-03T11:35:35.127 INFO:tasks.workunit.client.0.smithi131.stderr: max_new 1000 2023-12-03T11:35:35.128 INFO:tasks.workunit.client.0.smithi131.stderr: log_file /var/lib/ceph/crash/2023-12-03T11:35:34.985433Z_3c7ca6c2-93bb-48cb-80fb-7bd14b266d13/log 2023-12-03T11:35:35.128 INFO:tasks.workunit.client.0.smithi131.stderr:--- end dump of recent events --- 2023-12-03T11:35:35.128 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-12-03T11:35:35.133 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:35:35.133 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:35:35.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.030+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.031+0000 7f9613725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.031+0000 7f9613725800 20 realm 2023-12-03T11:35:35.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.032+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.032+0000 7f9613725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.032+0000 7f9613725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.032+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.032+0000 7f9613725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.032+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.033+0000 7f9613725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.033+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.033+0000 7f9613725800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.033+0000 7f9613725800 20 searching for the correct realm 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.042+0000 7f960ece4640 0 -- 172.21.15.131:0/1547760719 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x555ce0a79900 msgr2=0x555ce0a7bd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.043+0000 7f9613725800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.043+0000 7f9613725800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.043+0000 7f9613725800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.043+0000 7f9613725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:35:35.134 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.043+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.043+0000 7f9613725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.043+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.043+0000 7f9613725800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.043+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 20 zone default found 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 4 Realm: () 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 20 zonegroup default 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.135 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 20 started sync module instance, tier type = 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.044+0000 7f9613725800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.051+0000 7f960ece4640 0 -- 172.21.15.131:0/1547760719 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x7f95e8079670 msgr2=0x7f95e807baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.053+0000 7f9613725800 20 add_watcher() i=0 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.053+0000 7f9613725800 20 add_watcher() i=1 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.053+0000 7f9613725800 20 add_watcher() i=2 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.053+0000 7f9613725800 20 add_watcher() i=3 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.053+0000 7f9613725800 20 add_watcher() i=4 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.053+0000 7f9613725800 20 add_watcher() i=5 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.053+0000 7f9613725800 20 add_watcher() i=6 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.054+0000 7f9613725800 20 add_watcher() i=7 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.054+0000 7f9613725800 2 all 8 watchers are set, enabling cache 2023-12-03T11:35:35.136 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.055+0000 7f95d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.056+0000 7f9613725800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.056+0000 7f9613725800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.061+0000 7f9613725800 5 note: GC not initialized 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.061+0000 7f9543fff640 20 reqs_thread_entry: start 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.061+0000 7f9613725800 20 init_complete bucket index max shards: 1 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.062+0000 7f9613725800 20 Filter name: none 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.062+0000 7f9541ffb640 20 reqs_thread_entry: start 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.062+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.062+0000 7f9613725800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.062+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.063+0000 7f9613725800 20 rados_obj.operate() r=0 bl.length=403 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.063+0000 7f9613725800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.063+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.063+0000 7f9613725800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:35:35.137 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.063+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.063+0000 7f9613725800 20 rados_obj.operate() r=0 bl.length=403 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.063+0000 7f9613725800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.064+0000 7f9613725800 20 rados->read ofs=0 len=0 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.064+0000 7f9613725800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.065+0000 7f95d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.066+0000 7f9613725800 20 remove_watcher() i=0 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.066+0000 7f9613725800 2 removed watcher, disabling cache 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.067+0000 7f9613725800 20 remove_watcher() i=1 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.068+0000 7f9613725800 20 remove_watcher() i=2 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.069+0000 7f9613725800 20 remove_watcher() i=3 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.070+0000 7f9613725800 20 remove_watcher() i=4 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.071+0000 7f9613725800 20 remove_watcher() i=5 2023-12-03T11:35:35.138 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.072+0000 7f9613725800 20 remove_watcher() i=6 2023-12-03T11:35:35.139 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:35:35.073+0000 7f9613725800 20 remove_watcher() i=7 2023-12-03T11:35:35.139 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:35:35.139 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:35:35.139 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-do-reshard id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 num_objects: 20 size_kb: 1 num_shards: 1 2023-12-03T11:35:35.139 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:05.161 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2023-12-03T11:36:05.195 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:05.196 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:05.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.210+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.212+0000 7f204e925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.212+0000 7f204e925800 20 realm 2023-12-03T11:36:05.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.212+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.212+0000 7f204e925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.212+0000 7f204e925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:05.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.212+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.212+0000 7f204e925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.212+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.213+0000 7f204e925800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:05.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.213+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.214+0000 7f204e925800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:05.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.214+0000 7f204e925800 20 searching for the correct realm 2023-12-03T11:36:05.427 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.426+0000 7f204ad55640 0 -- 172.21.15.131:0/1893879094 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55a7f5ec3010 msgr2=0x55a7f5ec5400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:05.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.429+0000 7f204e925800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:05.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.429+0000 7f204e925800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:05.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.429+0000 7f204e925800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:05.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.429+0000 7f204e925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:05.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.429+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.430 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.429+0000 7f204e925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.431 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.429+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.429+0000 7f204e925800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:05.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.429+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:05.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 20 zone default found 2023-12-03T11:36:05.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 4 Realm: () 2023-12-03T11:36:05.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:05.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:05.432 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:05.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 20 zonegroup default 2023-12-03T11:36:05.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.430+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.431+0000 7f204e925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.431+0000 7f204e925800 20 started sync module instance, tier type = 2023-12-03T11:36:05.433 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.431+0000 7f204e925800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:05.436 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.435+0000 7f204a554640 0 -- 172.21.15.131:0/1893879094 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55a7f5ec7090 msgr2=0x55a7f5ec9480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:05.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.441+0000 7f204e925800 20 add_watcher() i=0 2023-12-03T11:36:05.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.441+0000 7f204e925800 20 add_watcher() i=1 2023-12-03T11:36:05.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.441+0000 7f204e925800 20 add_watcher() i=2 2023-12-03T11:36:05.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.441+0000 7f204e925800 20 add_watcher() i=3 2023-12-03T11:36:05.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.441+0000 7f204e925800 20 add_watcher() i=4 2023-12-03T11:36:05.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.441+0000 7f204e925800 20 add_watcher() i=5 2023-12-03T11:36:05.443 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.441+0000 7f204e925800 20 add_watcher() i=6 2023-12-03T11:36:05.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.443+0000 7f204e925800 20 add_watcher() i=7 2023-12-03T11:36:05.444 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.443+0000 7f204e925800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:05.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.445+0000 7f200ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:05.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.445+0000 7f204e925800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:05.446 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.445+0000 7f204e925800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:05.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.452+0000 7f204e925800 5 note: GC not initialized 2023-12-03T11:36:05.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.452+0000 7f1f7effd640 20 reqs_thread_entry: start 2023-12-03T11:36:05.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.452+0000 7f204e925800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:05.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.452+0000 7f204e925800 20 Filter name: none 2023-12-03T11:36:05.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.452+0000 7f1f7cff9640 20 reqs_thread_entry: start 2023-12-03T11:36:05.454 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.452+0000 7f204e925800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2023-12-03T11:36:05.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.452+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.453+0000 7f204e925800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:36:05.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.453+0000 7f204e925800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2023-12-03T11:36:05.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.453+0000 7f204e925800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2023-12-03T11:36:05.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.453+0000 7f204e925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 : miss 2023-12-03T11:36:05.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.453+0000 7f204e925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.455 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.453+0000 7f204e925800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:36:05.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.453+0000 7f204e925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:36:05.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.453+0000 7f204e925800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:36:05.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.453+0000 7f204e925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:05.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.453+0000 7f204e925800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:36:05.456 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.453+0000 7f204e925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 2023-12-03T11:36:05.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.458+0000 7f204e925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:36:05.459 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.458+0000 7f204e925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:36:05.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.458+0000 7f204e925800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:36:05.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.458+0000 7f204e925800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27, ofs0, ns] 2023-12-03T11:36:05.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.459+0000 7f2038ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791322 cookie 94179873848224 notifier 7293 bl.length()=873 2023-12-03T11:36:05.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.459+0000 7f2038ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:36:05.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.459+0000 7f2038ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:36:05.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.459+0000 7f2038ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:36:05.460 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.459+0000 7f204e925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): orig_sources= new_sources= 2023-12-03T11:36:05.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.459+0000 7f204e925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): potential sources added=[] removed=[] 2023-12-03T11:36:05.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.459+0000 7f204e925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): orig_dests= new_dests= 2023-12-03T11:36:05.461 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.459+0000 7f204e925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): potential dests added=[] removed=[] 2023-12-03T11:36:05.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.460+0000 7f204e925800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27.1.0 2023-12-03T11:36:05.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.460+0000 7f204e925800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27.1.0 2023-12-03T11:36:05.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.460+0000 7f204e925800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27.1.1 2023-12-03T11:36:05.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.460+0000 7f204e925800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27.1.1 2023-12-03T11:36:05.462 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.460+0000 7f204e925800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27.0 2023-12-03T11:36:05.464 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.463+0000 7f204e925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 : hit (requested=0x17, cached=0x17) 2023-12-03T11:36:05.465 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.463+0000 7f204e925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 2023-12-03T11:36:05.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f204e925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:36:05.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f204e925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:36:05.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f204e925800 10 updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:36:05.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f204e925800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27, ofs0, ns] 2023-12-03T11:36:05.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f2038ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791323 cookie 94179873848224 notifier 7293 bl.length()=841 2023-12-03T11:36:05.466 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f2038ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 info.flags=0x17 2023-12-03T11:36:05.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f2038ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 to cache LRU end 2023-12-03T11:36:05.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f2038ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2023-12-03T11:36:05.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f204e925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): orig_sources= new_sources= 2023-12-03T11:36:05.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f204e925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): potential sources added=[] removed=[] 2023-12-03T11:36:05.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f204e925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): orig_dests= new_dests= 2023-12-03T11:36:05.467 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.465+0000 7f204e925800 20 handle_bi_update(): bucket=:abort-at-do-reshard[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27]): potential dests added=[] removed=[] 2023-12-03T11:36:05.468 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.467+0000 7f204e925800 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2023-12-03T11:36:05.470 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.469+0000 7f200ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:05.472 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.471+0000 7f204e925800 20 remove_watcher() i=0 2023-12-03T11:36:05.472 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.471+0000 7f204e925800 2 removed watcher, disabling cache 2023-12-03T11:36:05.473 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.472+0000 7f204e925800 20 remove_watcher() i=1 2023-12-03T11:36:05.474 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.473+0000 7f204e925800 20 remove_watcher() i=2 2023-12-03T11:36:05.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.474+0000 7f204e925800 20 remove_watcher() i=3 2023-12-03T11:36:05.477 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.475+0000 7f204e925800 20 remove_watcher() i=4 2023-12-03T11:36:05.478 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.476+0000 7f204e925800 20 remove_watcher() i=5 2023-12-03T11:36:05.479 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.478+0000 7f204e925800 20 remove_watcher() i=6 2023-12-03T11:36:05.480 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.479+0000 7f204e925800 20 remove_watcher() i=7 2023-12-03T11:36:05.487 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2023-12-03T11:36:05.516 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:05.516 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:05.530 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.529+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.532 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.531+0000 7f7f41811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.532 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.531+0000 7f7f41811800 20 realm 2023-12-03T11:36:05.532 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.531+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.531+0000 7f7f41811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.531+0000 7f7f41811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:05.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.531+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.531+0000 7f7f41811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.533 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.531+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.534 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.532+0000 7f7f41811800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:05.534 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.532+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.534 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.533+0000 7f7f41811800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:05.534 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.533+0000 7f7f41811800 20 searching for the correct realm 2023-12-03T11:36:05.544 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.542+0000 7f7f3cdb1640 0 -- 172.21.15.131:0/825098041 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x564cc1a551d0 msgr2=0x564cc1a575e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:05.545 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.544+0000 7f7f41811800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:05.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.544+0000 7f7f41811800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:05.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.544+0000 7f7f41811800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:05.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.544+0000 7f7f41811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:05.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.544+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.544+0000 7f7f41811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.544+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.544+0000 7f7f41811800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:05.546 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.544+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:05.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 20 zone default found 2023-12-03T11:36:05.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 4 Realm: () 2023-12-03T11:36:05.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:05.547 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:05.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:05.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 20 zonegroup default 2023-12-03T11:36:05.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.545+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.546+0000 7f7f41811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.546+0000 7f7f41811800 20 started sync module instance, tier type = 2023-12-03T11:36:05.548 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.546+0000 7f7f41811800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:05.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.551+0000 7f7f3d5b2640 0 -- 172.21.15.131:0/825098041 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f7f2408c940 msgr2=0x7f7f2407b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:36:05.555 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.554+0000 7f7f41811800 20 add_watcher() i=0 2023-12-03T11:36:05.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.554+0000 7f7f41811800 20 add_watcher() i=1 2023-12-03T11:36:05.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.554+0000 7f7f41811800 20 add_watcher() i=2 2023-12-03T11:36:05.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.554+0000 7f7f41811800 20 add_watcher() i=3 2023-12-03T11:36:05.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.554+0000 7f7f41811800 20 add_watcher() i=4 2023-12-03T11:36:05.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.554+0000 7f7f41811800 20 add_watcher() i=5 2023-12-03T11:36:05.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.554+0000 7f7f41811800 20 add_watcher() i=6 2023-12-03T11:36:05.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.555+0000 7f7f41811800 20 add_watcher() i=7 2023-12-03T11:36:05.556 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.555+0000 7f7f41811800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:05.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.557+0000 7f7f037de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:05.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.557+0000 7f7f41811800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:05.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.557+0000 7f7f41811800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:05.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.563+0000 7f7f41811800 5 note: GC not initialized 2023-12-03T11:36:05.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.563+0000 7f7e727fc640 20 reqs_thread_entry: start 2023-12-03T11:36:05.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.563+0000 7f7f41811800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:05.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.563+0000 7f7f41811800 20 Filter name: none 2023-12-03T11:36:05.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.564+0000 7f7e63fff640 20 reqs_thread_entry: start 2023-12-03T11:36:05.565 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.564+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.564+0000 7f7f41811800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:36:05.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.564+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.565+0000 7f7f41811800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:36:05.566 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.565+0000 7f7f41811800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:05.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.565+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.565+0000 7f7f41811800 20 rados_obj.operate() r=0 bl.length=187 2023-12-03T11:36:05.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.565+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.565+0000 7f7f41811800 20 rados_obj.operate() r=0 bl.length=371 2023-12-03T11:36:05.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.565+0000 7f7f41811800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:05.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.566+0000 7f7f41811800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.567 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.566+0000 7f7f41811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.568 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.567+0000 7f7f037de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:05.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.569+0000 7f7f41811800 20 remove_watcher() i=0 2023-12-03T11:36:05.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.569+0000 7f7f41811800 2 removed watcher, disabling cache 2023-12-03T11:36:05.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.570+0000 7f7f41811800 20 remove_watcher() i=1 2023-12-03T11:36:05.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.571+0000 7f7f41811800 20 remove_watcher() i=2 2023-12-03T11:36:05.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.572+0000 7f7f41811800 20 remove_watcher() i=3 2023-12-03T11:36:05.574 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.573+0000 7f7f41811800 20 remove_watcher() i=4 2023-12-03T11:36:05.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.574+0000 7f7f41811800 20 remove_watcher() i=5 2023-12-03T11:36:05.576 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.575+0000 7f7f41811800 20 remove_watcher() i=6 2023-12-03T11:36:05.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.576+0000 7f7f41811800 20 remove_watcher() i=7 2023-12-03T11:36:05.581 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:05.581 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:36:05.581 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: abort-at-do-reshard id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.27 num_objects: 19 size_kb: 1 num_shards: 2 2023-12-03T11:36:05.582 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:05.655 INFO:tasks.workunit.client.0.smithi131.stderr: test: reshard versioned bucket 2023-12-03T11:36:05.656 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:36:05.684 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:05.684 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:05.698 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.697+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.698+0000 7f10e4d11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.698+0000 7f10e4d11800 20 realm 2023-12-03T11:36:05.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.698+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.698+0000 7f10e4d11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.698+0000 7f10e4d11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:05.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.698+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.699+0000 7f10e4d11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.700 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.699+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.699+0000 7f10e4d11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:05.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.699+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.700+0000 7f10e4d11800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:05.701 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.700+0000 7f10e4d11800 20 searching for the correct realm 2023-12-03T11:36:05.709 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.708+0000 7f10e2811640 0 -- 172.21.15.131:0/2058932014 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f10dc067070 msgr2=0x7f10dc099930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:05.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:05.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:05.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:05.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:05.711 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:05.712 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 zone default found 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 4 Realm: () 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 zonegroup default 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.710+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.711+0000 7f10e4d11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.711+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.711+0000 7f10e4d11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.711+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.713 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.711+0000 7f10e4d11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.714 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.711+0000 7f10e4d11800 20 started sync module instance, tier type = 2023-12-03T11:36:05.714 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.711+0000 7f10e4d11800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:05.718 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.716+0000 7f10e3012640 0 -- 172.21.15.131:0/2058932014 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f10cc044040 msgr2=0x7f10cc033400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:05.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.720+0000 7f10e4d11800 20 add_watcher() i=0 2023-12-03T11:36:05.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.720+0000 7f10e4d11800 20 add_watcher() i=1 2023-12-03T11:36:05.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.720+0000 7f10e4d11800 20 add_watcher() i=2 2023-12-03T11:36:05.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.720+0000 7f10e4d11800 20 add_watcher() i=3 2023-12-03T11:36:05.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.720+0000 7f10e4d11800 20 add_watcher() i=4 2023-12-03T11:36:05.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.720+0000 7f10e4d11800 20 add_watcher() i=5 2023-12-03T11:36:05.721 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.720+0000 7f10e4d11800 20 add_watcher() i=6 2023-12-03T11:36:05.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.720+0000 7f10e4d11800 20 add_watcher() i=7 2023-12-03T11:36:05.722 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.720+0000 7f10e4d11800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:05.723 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.722+0000 7f1023fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:05.724 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.722+0000 7f10e4d11800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:05.724 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.722+0000 7f10e4d11800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:05.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.728+0000 7f10e4d11800 5 note: GC not initialized 2023-12-03T11:36:05.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.728+0000 7f1012ffd640 20 reqs_thread_entry: start 2023-12-03T11:36:05.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.728+0000 7f10e4d11800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:05.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.728+0000 7f10e4d11800 20 Filter name: none 2023-12-03T11:36:05.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.728+0000 7f1010ff9640 20 reqs_thread_entry: start 2023-12-03T11:36:05.730 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.729+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.729+0000 7f10e4d11800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:05.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.729+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.729+0000 7f10e4d11800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:05.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.729+0000 7f10e4d11800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:05.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.730+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.730+0000 7f10e4d11800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:05.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.730+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.730+0000 7f10e4d11800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:05.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.730+0000 7f10e4d11800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:05.732 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.730+0000 7f10e4d11800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.731+0000 7f10e4d11800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.731+0000 7f1023fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:05.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.733+0000 7f10e4d11800 20 remove_watcher() i=0 2023-12-03T11:36:05.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.733+0000 7f10e4d11800 2 removed watcher, disabling cache 2023-12-03T11:36:05.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.734+0000 7f10e4d11800 20 remove_watcher() i=1 2023-12-03T11:36:05.736 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.735+0000 7f10e4d11800 20 remove_watcher() i=2 2023-12-03T11:36:05.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.736+0000 7f10e4d11800 20 remove_watcher() i=3 2023-12-03T11:36:05.738 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.737+0000 7f10e4d11800 20 remove_watcher() i=4 2023-12-03T11:36:05.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.738+0000 7f10e4d11800 20 remove_watcher() i=5 2023-12-03T11:36:05.740 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.739+0000 7f10e4d11800 20 remove_watcher() i=6 2023-12-03T11:36:05.741 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.740+0000 7f10e4d11800 20 remove_watcher() i=7 2023-12-03T11:36:05.746 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:05.746 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:36:05.746 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: myver id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 num_objects: 0 size_kb: 0 num_shards: 1 2023-12-03T11:36:05.746 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:05.747 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2023-12-03T11:36:05.777 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:05.777 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:05.790 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.789+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.790+0000 7f4a4f128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.790+0000 7f4a4f128800 20 realm 2023-12-03T11:36:05.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.790+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.790+0000 7f4a4f128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.790+0000 7f4a4f128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:05.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.790+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.791+0000 7f4a4f128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.792 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.791+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.791+0000 7f4a4f128800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:05.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.791+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.792+0000 7f4a4f128800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:05.793 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.792+0000 7f4a4f128800 20 searching for the correct realm 2023-12-03T11:36:05.803 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:05.803 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:05.803 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:05.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:05.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4b578640 0 -- 172.21.15.131:0/1136695320 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x55f05e0f5300 msgr2=0x55f05e0f7720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:05.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:05.804 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.805 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:05.805 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 zone default found 2023-12-03T11:36:05.805 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 4 Realm: () 2023-12-03T11:36:05.805 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:05.805 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:05.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:05.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 zonegroup default 2023-12-03T11:36:05.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.802+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.803+0000 7f4a4f128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.803+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.803+0000 7f4a4f128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.803+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.803+0000 7f4a4f128800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.803+0000 7f4a4f128800 20 started sync module instance, tier type = 2023-12-03T11:36:05.806 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.803+0000 7f4a4f128800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:05.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.812+0000 7f4a4f128800 20 add_watcher() i=0 2023-12-03T11:36:05.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.812+0000 7f4a4f128800 20 add_watcher() i=1 2023-12-03T11:36:05.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.812+0000 7f4a4f128800 20 add_watcher() i=2 2023-12-03T11:36:05.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.812+0000 7f4a4f128800 20 add_watcher() i=3 2023-12-03T11:36:05.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.812+0000 7f4a4f128800 20 add_watcher() i=4 2023-12-03T11:36:05.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.812+0000 7f4a4f128800 20 add_watcher() i=5 2023-12-03T11:36:05.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.812+0000 7f4a4a576640 0 -- 172.21.15.131:0/1136695320 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55f05e0fe2a0 msgr2=0x55f05e100690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:05.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.812+0000 7f4a4f128800 20 add_watcher() i=6 2023-12-03T11:36:05.814 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.813+0000 7f4a4f128800 20 add_watcher() i=7 2023-12-03T11:36:05.815 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.813+0000 7f4a4f128800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:05.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.815+0000 7f498bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:05.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.815+0000 7f4a4f128800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:05.816 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.815+0000 7f4a4f128800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:05.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.821+0000 7f4a4f128800 5 note: GC not initialized 2023-12-03T11:36:05.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.821+0000 7f497affd640 20 reqs_thread_entry: start 2023-12-03T11:36:05.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.821+0000 7f4a4f128800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:05.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.821+0000 7f4a4f128800 20 Filter name: none 2023-12-03T11:36:05.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4978ff9640 20 reqs_thread_entry: start 2023-12-03T11:36:05.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:36:05.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:05.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:36:05.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:36:05.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 : miss 2023-12-03T11:36:05.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:05.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:05.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 10 adding default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:05.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:05.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:05.825 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.822+0000 7f4a4f128800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 2023-12-03T11:36:05.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.826+0000 7f4a4f128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:05.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.826+0000 7f4a4f128800 10 moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:05.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.826+0000 7f4a4f128800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:05.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.826+0000 7f4a4f128800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17, ofs0, ns] 2023-12-03T11:36:05.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.827+0000 7f4a317fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791325 cookie 94490858644480 notifier 7353 bl.length()=783 2023-12-03T11:36:05.828 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.827+0000 7f4a317fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:05.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.827+0000 7f4a317fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:05.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.827+0000 7f4a317fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:05.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.827+0000 7f4a4f128800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_sources= new_sources= 2023-12-03T11:36:05.829 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.827+0000 7f4a4f128800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential sources added=[] removed=[] 2023-12-03T11:36:05.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.827+0000 7f4a4f128800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_dests= new_dests= 2023-12-03T11:36:05.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.827+0000 7f4a4f128800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential dests added=[] removed=[] 2023-12-03T11:36:05.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.828+0000 7f4a4f128800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.1.0 2023-12-03T11:36:05.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.828+0000 7f4a4f128800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.1.0 2023-12-03T11:36:05.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.828+0000 7f4a4f128800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.1.1 2023-12-03T11:36:05.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.828+0000 7f4a4f128800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.1.1 2023-12-03T11:36:05.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.828+0000 7f4a4f128800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.0 2023-12-03T11:36:05.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.829+0000 7f4a4f128800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 : hit (requested=0x17, cached=0x17) 2023-12-03T11:36:05.830 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.829+0000 7f4a4f128800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 2023-12-03T11:36:05.831 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a4f128800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:05.831 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a4f128800 10 moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:05.831 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a4f128800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:05.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a4f128800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17, ofs0, ns] 2023-12-03T11:36:05.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a30ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791326 cookie 94490858644480 notifier 7353 bl.length()=751 2023-12-03T11:36:05.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a30ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:05.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a30ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:05.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a30ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:05.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a4f128800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_sources= new_sources= 2023-12-03T11:36:05.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a4f128800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential sources added=[] removed=[] 2023-12-03T11:36:05.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a4f128800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_dests= new_dests= 2023-12-03T11:36:05.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.830+0000 7f4a4f128800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential dests added=[] removed=[] 2023-12-03T11:36:05.832 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.831+0000 7f4a4f128800 1 execute INFO: reshard of bucket "myver" completed successfully 2023-12-03T11:36:05.834 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.833+0000 7f498bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:05.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.835+0000 7f4a4f128800 20 remove_watcher() i=0 2023-12-03T11:36:05.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.835+0000 7f4a4f128800 2 removed watcher, disabling cache 2023-12-03T11:36:05.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.836+0000 7f4a4f128800 20 remove_watcher() i=1 2023-12-03T11:36:05.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.837+0000 7f4a4f128800 20 remove_watcher() i=2 2023-12-03T11:36:05.839 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.838+0000 7f4a4f128800 20 remove_watcher() i=3 2023-12-03T11:36:05.840 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.839+0000 7f4a4f128800 20 remove_watcher() i=4 2023-12-03T11:36:05.841 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.840+0000 7f4a4f128800 20 remove_watcher() i=5 2023-12-03T11:36:05.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.841+0000 7f4a4f128800 20 remove_watcher() i=6 2023-12-03T11:36:05.843 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.842+0000 7f4a4f128800 20 remove_watcher() i=7 2023-12-03T11:36:05.849 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:36:05.876 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:05.876 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:05.890 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.889+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.890+0000 7f67b060f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.890+0000 7f67b060f800 20 realm 2023-12-03T11:36:05.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.890+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.890+0000 7f67b060f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.890+0000 7f67b060f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:05.892 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.890+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.891+0000 7f67b060f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.891+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.891+0000 7f67b060f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:05.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.891+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.893 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.892+0000 7f67b060f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:05.894 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.892+0000 7f67b060f800 20 searching for the correct realm 2023-12-03T11:36:05.901 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.900+0000 7f67abc8c640 0 -- 172.21.15.131:0/3886900607 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7f67a005d730 msgr2=0x7f67a0057c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:05.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.902+0000 7f67b060f800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:05.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.902+0000 7f67b060f800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:05.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.902+0000 7f67b060f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:05.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.902+0000 7f67b060f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:05.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.902+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.903 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.902+0000 7f67b060f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.904 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.902+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.902+0000 7f67b060f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:05.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.902+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:05.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 20 zone default found 2023-12-03T11:36:05.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 4 Realm: () 2023-12-03T11:36:05.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:05.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:05.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:05.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 20 zonegroup default 2023-12-03T11:36:05.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.905 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.903+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.904+0000 7f67b060f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.904+0000 7f67b060f800 20 started sync module instance, tier type = 2023-12-03T11:36:05.906 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.904+0000 7f67b060f800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:05.909 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.908+0000 7f67ac48d640 0 -- 172.21.15.131:0/3886900607 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7f67a005f140 msgr2=0x7f67a0056230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:05.913 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.912+0000 7f67b060f800 20 add_watcher() i=0 2023-12-03T11:36:05.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.912+0000 7f67b060f800 20 add_watcher() i=1 2023-12-03T11:36:05.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.912+0000 7f67b060f800 20 add_watcher() i=2 2023-12-03T11:36:05.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.912+0000 7f67b060f800 20 add_watcher() i=3 2023-12-03T11:36:05.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.912+0000 7f67b060f800 20 add_watcher() i=4 2023-12-03T11:36:05.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.912+0000 7f67b060f800 20 add_watcher() i=5 2023-12-03T11:36:05.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.912+0000 7f67b060f800 20 add_watcher() i=6 2023-12-03T11:36:05.914 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.913+0000 7f67b060f800 20 add_watcher() i=7 2023-12-03T11:36:05.915 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.913+0000 7f67b060f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:05.916 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.915+0000 7f6771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:05.916 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.915+0000 7f67b060f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:05.916 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.915+0000 7f67b060f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:05.922 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.921+0000 7f67b060f800 5 note: GC not initialized 2023-12-03T11:36:05.922 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.921+0000 7f66e8ff9640 20 reqs_thread_entry: start 2023-12-03T11:36:05.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.921+0000 7f67b060f800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:05.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.921+0000 7f67b060f800 20 Filter name: none 2023-12-03T11:36:05.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.921+0000 7f66de7fc640 20 reqs_thread_entry: start 2023-12-03T11:36:05.923 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.921+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.922+0000 7f67b060f800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:05.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.922+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.922+0000 7f67b060f800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:05.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.922+0000 7f67b060f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:05.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.922+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.922+0000 7f67b060f800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:05.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.922+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.923+0000 7f67b060f800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:05.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.923+0000 7f67b060f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:05.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.923+0000 7f67b060f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:05.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.923+0000 7f67b060f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:05.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.924+0000 7f6771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:05.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.926+0000 7f67b060f800 20 remove_watcher() i=0 2023-12-03T11:36:05.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.926+0000 7f67b060f800 2 removed watcher, disabling cache 2023-12-03T11:36:05.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.927+0000 7f67b060f800 20 remove_watcher() i=1 2023-12-03T11:36:05.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.928+0000 7f67b060f800 20 remove_watcher() i=2 2023-12-03T11:36:05.930 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.929+0000 7f67b060f800 20 remove_watcher() i=3 2023-12-03T11:36:05.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.930+0000 7f67b060f800 20 remove_watcher() i=4 2023-12-03T11:36:05.932 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.931+0000 7f67b060f800 20 remove_watcher() i=5 2023-12-03T11:36:05.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.932+0000 7f67b060f800 20 remove_watcher() i=6 2023-12-03T11:36:05.935 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:05.933+0000 7f67b060f800 20 remove_watcher() i=7 2023-12-03T11:36:05.939 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:05.939 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:36:05.939 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: myver id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 num_objects: 0 size_kb: 0 num_shards: 2 2023-12-03T11:36:05.939 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:05.985 INFO:tasks.workunit.client.0.smithi131.stderr: test: reshard removes olh entries with empty name 2023-12-03T11:36:06.076 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket a-bucket 2023-12-03T11:36:06.102 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:06.103 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:06.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.115+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.118 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.117+0000 7f43c651f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.117+0000 7f43c651f800 20 realm 2023-12-03T11:36:06.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.117+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.117+0000 7f43c651f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.117+0000 7f43c651f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:06.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.117+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.117+0000 7f43c651f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.117+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.118+0000 7f43c651f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.118+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.118+0000 7f43c651f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:06.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.118+0000 7f43c651f800 20 searching for the correct realm 2023-12-03T11:36:06.127 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.126+0000 7f43c2955640 0 -- 172.21.15.131:0/1627006311 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x56191edaa570 msgr2=0x56191edac960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.129+0000 7f43c651f800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:06.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.129+0000 7f43c651f800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:06.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.129+0000 7f43c651f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:06.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.129+0000 7f43c651f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:06.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.129+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.129+0000 7f43c651f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.129+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.131 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:06.132 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 20 zone default found 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 4 Realm: () 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 20 zonegroup default 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.130+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.131+0000 7f43c651f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.131+0000 7f43c651f800 20 started sync module instance, tier type = 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.131+0000 7f43c651f800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:06.133 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.131+0000 7f43c2955640 0 -- 172.21.15.131:0/1627006311 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f43ac09c120 msgr2=0x7f43ac0c6110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:36:06.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.139+0000 7f43c651f800 20 add_watcher() i=0 2023-12-03T11:36:06.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.139+0000 7f43c651f800 20 add_watcher() i=1 2023-12-03T11:36:06.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.139+0000 7f43c651f800 20 add_watcher() i=2 2023-12-03T11:36:06.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.139+0000 7f43c651f800 20 add_watcher() i=3 2023-12-03T11:36:06.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.139+0000 7f43c651f800 20 add_watcher() i=4 2023-12-03T11:36:06.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.139+0000 7f43c651f800 20 add_watcher() i=5 2023-12-03T11:36:06.141 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.139+0000 7f43c651f800 20 add_watcher() i=6 2023-12-03T11:36:06.142 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.140+0000 7f43c651f800 20 add_watcher() i=7 2023-12-03T11:36:06.142 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.140+0000 7f43c651f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:06.143 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.142+0000 7f4387fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.143 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.142+0000 7f43c651f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:06.143 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.142+0000 7f43c651f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:06.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.148+0000 7f43c651f800 5 note: GC not initialized 2023-12-03T11:36:06.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.148+0000 7f42f6ffd640 20 reqs_thread_entry: start 2023-12-03T11:36:06.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.148+0000 7f43c651f800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:06.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.148+0000 7f43c651f800 20 Filter name: none 2023-12-03T11:36:06.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.148+0000 7f42f4ff9640 20 reqs_thread_entry: start 2023-12-03T11:36:06.150 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.148+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.149+0000 7f43c651f800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:36:06.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.149+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.149+0000 7f43c651f800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:36:06.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.149+0000 7f43c651f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:06.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.149+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.151 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.150+0000 7f43c651f800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:36:06.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.150+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.150+0000 7f43c651f800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:36:06.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.150+0000 7f43c651f800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:06.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.150+0000 7f43c651f800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.152 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.151+0000 7f43c651f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.153 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.151+0000 7f4387fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.155 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.154+0000 7f43c651f800 20 remove_watcher() i=0 2023-12-03T11:36:06.156 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.154+0000 7f43c651f800 2 removed watcher, disabling cache 2023-12-03T11:36:06.157 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.155+0000 7f43c651f800 20 remove_watcher() i=1 2023-12-03T11:36:06.157 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.156+0000 7f43c651f800 20 remove_watcher() i=2 2023-12-03T11:36:06.158 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.157+0000 7f43c651f800 20 remove_watcher() i=3 2023-12-03T11:36:06.159 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.158+0000 7f43c651f800 20 remove_watcher() i=4 2023-12-03T11:36:06.160 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.159+0000 7f43c651f800 20 remove_watcher() i=5 2023-12-03T11:36:06.161 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.160+0000 7f43c651f800 20 remove_watcher() i=6 2023-12-03T11:36:06.162 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.161+0000 7f43c651f800 20 remove_watcher() i=7 2023-12-03T11:36:06.167 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:06.167 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:36:06.167 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: a-bucket id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 num_objects: 0 size_kb: 0 num_shards: 3 2023-12-03T11:36:06.167 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:06.169 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket layout --bucket a-bucket 2023-12-03T11:36:06.195 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:06.195 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:06.209 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.208+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.210+0000 7f263d28c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.210+0000 7f263d28c800 20 realm 2023-12-03T11:36:06.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.210+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.211 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.210+0000 7f263d28c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.210+0000 7f263d28c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:06.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.210+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.210+0000 7f263d28c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.210+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.211+0000 7f263d28c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.211+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.211+0000 7f263d28c800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:06.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.211+0000 7f263d28c800 20 searching for the correct realm 2023-12-03T11:36:06.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.220+0000 7f263ad8c640 0 -- 172.21.15.131:0/3960758876 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f26340c9000 msgr2=0x7f263409eaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.221+0000 7f263d28c800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:06.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.221+0000 7f263d28c800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:06.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.221+0000 7f263d28c800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:06.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.221+0000 7f263d28c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:06.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.221+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.221+0000 7f263d28c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.221+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:06.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 20 zone default found 2023-12-03T11:36:06.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 4 Realm: () 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 20 zonegroup default 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.222+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.223+0000 7f263d28c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.223+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.223+0000 7f263d28c800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.223+0000 7f263d28c800 20 started sync module instance, tier type = 2023-12-03T11:36:06.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.223+0000 7f263d28c800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:06.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.228+0000 7f263b58d640 0 -- 172.21.15.131:0/3960758876 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f2630041940 msgr2=0x7f2630008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.231+0000 7f263d28c800 20 add_watcher() i=0 2023-12-03T11:36:06.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.231+0000 7f263d28c800 20 add_watcher() i=1 2023-12-03T11:36:06.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.231+0000 7f263d28c800 20 add_watcher() i=2 2023-12-03T11:36:06.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.231+0000 7f263d28c800 20 add_watcher() i=3 2023-12-03T11:36:06.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.231+0000 7f263d28c800 20 add_watcher() i=4 2023-12-03T11:36:06.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.231+0000 7f263d28c800 20 add_watcher() i=5 2023-12-03T11:36:06.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.231+0000 7f263d28c800 20 add_watcher() i=6 2023-12-03T11:36:06.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.232+0000 7f263d28c800 20 add_watcher() i=7 2023-12-03T11:36:06.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.232+0000 7f263d28c800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:06.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.233+0000 7f257bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.234+0000 7f263d28c800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:06.235 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.234+0000 7f263d28c800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:06.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.240+0000 7f263d28c800 5 note: GC not initialized 2023-12-03T11:36:06.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.240+0000 7f256affd640 20 reqs_thread_entry: start 2023-12-03T11:36:06.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.240+0000 7f263d28c800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:06.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.240+0000 7f263d28c800 20 Filter name: none 2023-12-03T11:36:06.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.240+0000 7f2568ff9640 20 reqs_thread_entry: start 2023-12-03T11:36:06.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.240+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.240+0000 7f263d28c800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:36:06.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.240+0000 7f263d28c800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.241+0000 7f263d28c800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:36:06.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.241+0000 7f263d28c800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:06.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.242+0000 7f257bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.243+0000 7f263d28c800 20 remove_watcher() i=0 2023-12-03T11:36:06.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.243+0000 7f263d28c800 2 removed watcher, disabling cache 2023-12-03T11:36:06.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.244+0000 7f263d28c800 20 remove_watcher() i=1 2023-12-03T11:36:06.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.245+0000 7f263d28c800 20 remove_watcher() i=2 2023-12-03T11:36:06.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.246+0000 7f263d28c800 20 remove_watcher() i=3 2023-12-03T11:36:06.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.247+0000 7f263d28c800 20 remove_watcher() i=4 2023-12-03T11:36:06.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.248+0000 7f263d28c800 20 remove_watcher() i=5 2023-12-03T11:36:06.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.249+0000 7f263d28c800 20 remove_watcher() i=6 2023-12-03T11:36:06.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.250+0000 7f263d28c800 20 remove_watcher() i=7 2023-12-03T11:36:06.258 INFO:tasks.workunit.client.0.smithi131.stderr:rados -p default.rgw.buckets.index setomapval .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2023-12-03T11:36:06.282 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:06.282 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:06.498 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket a-bucket 2023-12-03T11:36:06.524 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:06.525 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:06.538 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.537+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.539+0000 7fee8292e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.539+0000 7fee8292e800 20 realm 2023-12-03T11:36:06.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.539+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.539+0000 7fee8292e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.539+0000 7fee8292e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:06.540 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.539+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.539+0000 7fee8292e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.539+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.540+0000 7fee8292e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.540+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.540+0000 7fee8292e800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:06.541 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.540+0000 7fee8292e800 20 searching for the correct realm 2023-12-03T11:36:06.550 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.549+0000 7fee7e55b640 0 -- 172.21.15.131:0/1721127786 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x556c5abe3480 msgr2=0x556c5abe5890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.550+0000 7fee8292e800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:06.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.550+0000 7fee8292e800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:06.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.550+0000 7fee8292e800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:06.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.550+0000 7fee8292e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:06.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.550+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.550+0000 7fee8292e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.550+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.552 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:06.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 20 zone default found 2023-12-03T11:36:06.553 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 4 Realm: () 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 20 zonegroup default 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.551+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.552+0000 7fee8292e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.552+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.552+0000 7fee8292e800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.552+0000 7fee8292e800 20 started sync module instance, tier type = 2023-12-03T11:36:06.554 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.552+0000 7fee8292e800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:06.558 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.557+0000 7fee7ed5c640 0 -- 172.21.15.131:0/1721127786 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7fee68057530 msgr2=0x7fee68080040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.561 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.560+0000 7fee8292e800 20 add_watcher() i=0 2023-12-03T11:36:06.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.560+0000 7fee8292e800 20 add_watcher() i=1 2023-12-03T11:36:06.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.560+0000 7fee8292e800 20 add_watcher() i=2 2023-12-03T11:36:06.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.560+0000 7fee8292e800 20 add_watcher() i=3 2023-12-03T11:36:06.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.560+0000 7fee8292e800 20 add_watcher() i=4 2023-12-03T11:36:06.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.560+0000 7fee8292e800 20 add_watcher() i=5 2023-12-03T11:36:06.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.560+0000 7fee8292e800 20 add_watcher() i=6 2023-12-03T11:36:06.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.561+0000 7fee8292e800 20 add_watcher() i=7 2023-12-03T11:36:06.562 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.561+0000 7fee8292e800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:06.563 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.562+0000 7fee43fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.563+0000 7fee8292e800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:06.564 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.563+0000 7fee8292e800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:06.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.568+0000 7fee8292e800 5 note: GC not initialized 2023-12-03T11:36:06.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.568+0000 7fedb2ffd640 20 reqs_thread_entry: start 2023-12-03T11:36:06.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.568+0000 7fee8292e800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:06.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.568+0000 7fee8292e800 20 Filter name: none 2023-12-03T11:36:06.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.569+0000 7fedb0ff9640 20 reqs_thread_entry: start 2023-12-03T11:36:06.570 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.569+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.569+0000 7fee8292e800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:36:06.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.569+0000 7fee8292e800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.569+0000 7fee8292e800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:36:06.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.569+0000 7fee8292e800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:06.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.569+0000 7fee8292e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2023-12-03T11:36:06.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.569+0000 7fee8292e800 20 INFO: main: starting shard=0 2023-12-03T11:36:06.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.569+0000 7fee8292e800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.0 2023-12-03T11:36:06.571 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.569+0000 7fee8292e800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.0 2023-12-03T11:36:06.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.570+0000 7fee8292e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:36:06.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.570+0000 7fee8292e800 20 INFO: main: starting shard=1 2023-12-03T11:36:06.572 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.570+0000 7fee8292e800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.1 2023-12-03T11:36:06.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.570+0000 7fee8292e800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.1 2023-12-03T11:36:06.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.571+0000 7fee8292e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:36:06.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.571+0000 7fee8292e800 20 INFO: main: starting shard=2 2023-12-03T11:36:06.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.571+0000 7fee8292e800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.2 2023-12-03T11:36:06.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.571+0000 7fee8292e800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.2 2023-12-03T11:36:06.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.571+0000 7fee8292e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:36:06.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.571+0000 7fee8292e800 20 INFO: main: done 2023-12-03T11:36:06.573 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.572+0000 7fee43fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.574+0000 7fee8292e800 20 remove_watcher() i=0 2023-12-03T11:36:06.575 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.574+0000 7fee8292e800 2 removed watcher, disabling cache 2023-12-03T11:36:06.576 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.574+0000 7fee8292e800 20 remove_watcher() i=1 2023-12-03T11:36:06.576 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.575+0000 7fee8292e800 20 remove_watcher() i=2 2023-12-03T11:36:06.577 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.576+0000 7fee8292e800 20 remove_watcher() i=3 2023-12-03T11:36:06.578 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.577+0000 7fee8292e800 20 remove_watcher() i=4 2023-12-03T11:36:06.579 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.578+0000 7fee8292e800 20 remove_watcher() i=5 2023-12-03T11:36:06.580 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.579+0000 7fee8292e800 20 remove_watcher() i=6 2023-12-03T11:36:06.581 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.580+0000 7fee8292e800 20 remove_watcher() i=7 2023-12-03T11:36:06.587 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2023-12-03T11:36:06.618 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:06.618 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:06.631 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.630+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.632+0000 7f608e322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.632+0000 7f608e322800 20 realm 2023-12-03T11:36:06.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.632+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.632+0000 7f608e322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.633 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.632+0000 7f608e322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:06.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.632+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.632+0000 7f608e322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.632+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.633+0000 7f608e322800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.634 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.633+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.633+0000 7f608e322800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:06.635 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.633+0000 7f608e322800 20 searching for the correct realm 2023-12-03T11:36:06.643 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.642+0000 7f6089f95640 0 -- 172.21.15.131:0/2954475341 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x562577ae1590 msgr2=0x562577ae39e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.643+0000 7f608e322800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:06.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.643+0000 7f608e322800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:06.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.643+0000 7f608e322800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:06.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.643+0000 7f608e322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:06.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.643+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.643+0000 7f608e322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.643+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.645 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 20 zone default found 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 4 Realm: () 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 20 zonegroup default 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.644+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.645+0000 7f608e322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.645+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.645+0000 7f608e322800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.647 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.645+0000 7f608e322800 20 started sync module instance, tier type = 2023-12-03T11:36:06.648 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.645+0000 7f608e322800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:06.652 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.651+0000 7f6089794640 0 -- 172.21.15.131:0/2954475341 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x562577ae65d0 msgr2=0x562577ae89c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.653+0000 7f608e322800 20 add_watcher() i=0 2023-12-03T11:36:06.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.653+0000 7f608e322800 20 add_watcher() i=1 2023-12-03T11:36:06.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.653+0000 7f608e322800 20 add_watcher() i=2 2023-12-03T11:36:06.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.653+0000 7f608e322800 20 add_watcher() i=3 2023-12-03T11:36:06.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.653+0000 7f608e322800 20 add_watcher() i=4 2023-12-03T11:36:06.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.653+0000 7f608e322800 20 add_watcher() i=5 2023-12-03T11:36:06.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.653+0000 7f608e322800 20 add_watcher() i=6 2023-12-03T11:36:06.655 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.654+0000 7f608e322800 20 add_watcher() i=7 2023-12-03T11:36:06.656 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.654+0000 7f608e322800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:06.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.656+0000 7f604f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.656+0000 7f608e322800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:06.657 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.656+0000 7f608e322800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:06.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.662+0000 7f608e322800 5 note: GC not initialized 2023-12-03T11:36:06.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.662+0000 7f5fbe7fc640 20 reqs_thread_entry: start 2023-12-03T11:36:06.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.662+0000 7f608e322800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:06.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.662+0000 7f608e322800 20 Filter name: none 2023-12-03T11:36:06.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.662+0000 7f5faffff640 20 reqs_thread_entry: start 2023-12-03T11:36:06.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.662+0000 7f608e322800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2023-12-03T11:36:06.664 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.662+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.663+0000 7f608e322800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:36:06.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.663+0000 7f608e322800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2023-12-03T11:36:06.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.663+0000 7f608e322800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2023-12-03T11:36:06.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.663+0000 7f608e322800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 : miss 2023-12-03T11:36:06.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.663+0000 7f608e322800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.663+0000 7f608e322800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:36:06.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.663+0000 7f608e322800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:36:06.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.663+0000 7f608e322800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:36:06.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.663+0000 7f608e322800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:06.665 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.663+0000 7f608e322800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:06.666 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.663+0000 7f608e322800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 2023-12-03T11:36:06.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.667+0000 7f608e322800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:36:06.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.667+0000 7f608e322800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:36:06.668 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.667+0000 7f608e322800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:06.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.667+0000 7f608e322800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16, ofs0, ns] 2023-12-03T11:36:06.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.667+0000 7f606b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791400 cookie 94718921713040 notifier 7470 bl.length()=789 2023-12-03T11:36:06.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.667+0000 7f606b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:36:06.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.667+0000 7f606b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:36:06.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.667+0000 7f606b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:06.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.668+0000 7f608e322800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_sources= new_sources= 2023-12-03T11:36:06.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.668+0000 7f608e322800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential sources added=[] removed=[] 2023-12-03T11:36:06.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.668+0000 7f608e322800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_dests= new_dests= 2023-12-03T11:36:06.669 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.668+0000 7f608e322800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential dests added=[] removed=[] 2023-12-03T11:36:06.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.669+0000 7f608e322800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.3.0 2023-12-03T11:36:06.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.669+0000 7f608e322800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.3.0 2023-12-03T11:36:06.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.669+0000 7f608e322800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.0 2023-12-03T11:36:06.670 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.669+0000 7f608e322800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.0 2023-12-03T11:36:06.671 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.669+0000 7f608e322800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2023-12-03T11:36:06.671 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.669+0000 7f608e322800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.1 2023-12-03T11:36:06.671 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.669+0000 7f608e322800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.1 2023-12-03T11:36:06.671 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.670+0000 7f608e322800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.2 2023-12-03T11:36:06.671 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.670+0000 7f608e322800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.2.2 2023-12-03T11:36:06.672 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.670+0000 7f608e322800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 : hit (requested=0x17, cached=0x17) 2023-12-03T11:36:06.672 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.670+0000 7f608e322800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 2023-12-03T11:36:06.672 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.671+0000 7f608e322800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:36:06.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.671+0000 7f608e322800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:36:06.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.671+0000 7f608e322800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:06.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.671+0000 7f608e322800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16, ofs0, ns] 2023-12-03T11:36:06.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.672+0000 7f606bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791401 cookie 94718921713040 notifier 7470 bl.length()=757 2023-12-03T11:36:06.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.672+0000 7f606bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 info.flags=0x17 2023-12-03T11:36:06.673 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.672+0000 7f606bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16 to cache LRU end 2023-12-03T11:36:06.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.672+0000 7f606bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:06.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.672+0000 7f608e322800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_sources= new_sources= 2023-12-03T11:36:06.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.672+0000 7f608e322800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential sources added=[] removed=[] 2023-12-03T11:36:06.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.672+0000 7f608e322800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): orig_dests= new_dests= 2023-12-03T11:36:06.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.672+0000 7f608e322800 20 handle_bi_update(): bucket=:a-bucket[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16]): potential dests added=[] removed=[] 2023-12-03T11:36:06.674 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.673+0000 7f608e322800 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2023-12-03T11:36:06.676 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.675+0000 7f604f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.678 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.677+0000 7f608e322800 20 remove_watcher() i=0 2023-12-03T11:36:06.678 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.677+0000 7f608e322800 2 removed watcher, disabling cache 2023-12-03T11:36:06.679 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.678+0000 7f608e322800 20 remove_watcher() i=1 2023-12-03T11:36:06.680 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.679+0000 7f608e322800 20 remove_watcher() i=2 2023-12-03T11:36:06.681 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.680+0000 7f608e322800 20 remove_watcher() i=3 2023-12-03T11:36:06.682 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.681+0000 7f608e322800 20 remove_watcher() i=4 2023-12-03T11:36:06.683 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.682+0000 7f608e322800 20 remove_watcher() i=5 2023-12-03T11:36:06.684 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.683+0000 7f608e322800 20 remove_watcher() i=6 2023-12-03T11:36:06.685 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.684+0000 7f608e322800 20 remove_watcher() i=7 2023-12-03T11:36:06.691 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket a-bucket 2023-12-03T11:36:06.717 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:06.718 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:06.731 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.730+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.732+0000 7f8d0f935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.732+0000 7f8d0f935800 20 realm 2023-12-03T11:36:06.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.732+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.732+0000 7f8d0f935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.732+0000 7f8d0f935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:06.733 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.732+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.732+0000 7f8d0f935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.732+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.733+0000 7f8d0f935800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.733+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.734 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.733+0000 7f8d0f935800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:06.735 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.733+0000 7f8d0f935800 20 searching for the correct realm 2023-12-03T11:36:06.743 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.742+0000 7f8d0b5de640 0 -- 172.21.15.131:0/2395603010 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5593992ef1b0 msgr2=0x5593992f15a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.743+0000 7f8d0f935800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:06.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.743+0000 7f8d0f935800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:06.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.743+0000 7f8d0f935800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:06.744 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.743+0000 7f8d0f935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:06.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.743+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.743+0000 7f8d0f935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.745 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.743+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.743+0000 7f8d0f935800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.743+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 20 zone default found 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 4 Realm: () 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 20 zonegroup default 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.746 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 20 started sync module instance, tier type = 2023-12-03T11:36:06.747 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.744+0000 7f8d0f935800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:06.752 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.750+0000 7f8d02ddd640 0 -- 172.21.15.131:0/2395603010 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x5593992f41e0 msgr2=0x5593992f65d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.753+0000 7f8d0f935800 20 add_watcher() i=0 2023-12-03T11:36:06.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.753+0000 7f8d0f935800 20 add_watcher() i=1 2023-12-03T11:36:06.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.753+0000 7f8d0f935800 20 add_watcher() i=2 2023-12-03T11:36:06.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.753+0000 7f8d0f935800 20 add_watcher() i=3 2023-12-03T11:36:06.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.753+0000 7f8d0f935800 20 add_watcher() i=4 2023-12-03T11:36:06.754 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.753+0000 7f8d0f935800 20 add_watcher() i=5 2023-12-03T11:36:06.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.753+0000 7f8d0f935800 20 add_watcher() i=6 2023-12-03T11:36:06.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.754+0000 7f8d0f935800 20 add_watcher() i=7 2023-12-03T11:36:06.755 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.754+0000 7f8d0f935800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:06.756 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.755+0000 7f8cd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.757 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.756+0000 7f8d0f935800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:06.757 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.756+0000 7f8d0f935800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:06.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.761+0000 7f8d0f935800 5 note: GC not initialized 2023-12-03T11:36:06.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.761+0000 7f8c3ffff640 20 reqs_thread_entry: start 2023-12-03T11:36:06.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.761+0000 7f8d0f935800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:06.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.761+0000 7f8d0f935800 20 Filter name: none 2023-12-03T11:36:06.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.762+0000 7f8c3dffb640 20 reqs_thread_entry: start 2023-12-03T11:36:06.763 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.762+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.762+0000 7f8d0f935800 20 rados_obj.operate() r=0 bl.length=176 2023-12-03T11:36:06.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.762+0000 7f8d0f935800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.763+0000 7f8d0f935800 20 rados_obj.operate() r=0 bl.length=360 2023-12-03T11:36:06.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.763+0000 7f8d0f935800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:06.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.763+0000 7f8d0f935800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2023-12-03T11:36:06.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.763+0000 7f8d0f935800 20 INFO: main: starting shard=0 2023-12-03T11:36:06.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.763+0000 7f8d0f935800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.3.0 2023-12-03T11:36:06.764 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.763+0000 7f8d0f935800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.16.3.0 2023-12-03T11:36:06.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.763+0000 7f8d0f935800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:36:06.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.763+0000 7f8d0f935800 20 INFO: main: done 2023-12-03T11:36:06.765 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.764+0000 7f8cd17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.766+0000 7f8d0f935800 20 remove_watcher() i=0 2023-12-03T11:36:06.767 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.766+0000 7f8d0f935800 2 removed watcher, disabling cache 2023-12-03T11:36:06.768 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.767+0000 7f8d0f935800 20 remove_watcher() i=1 2023-12-03T11:36:06.769 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.768+0000 7f8d0f935800 20 remove_watcher() i=2 2023-12-03T11:36:06.770 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.769+0000 7f8d0f935800 20 remove_watcher() i=3 2023-12-03T11:36:06.771 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.770+0000 7f8d0f935800 20 remove_watcher() i=4 2023-12-03T11:36:06.772 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.771+0000 7f8d0f935800 20 remove_watcher() i=5 2023-12-03T11:36:06.773 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.771+0000 7f8d0f935800 20 remove_watcher() i=6 2023-12-03T11:36:06.774 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.772+0000 7f8d0f935800 20 remove_watcher() i=7 2023-12-03T11:36:06.778 INFO:tasks.workunit.client.0.smithi131.stderr: test: PUT succeeds during reshard 2023-12-03T11:36:06.780 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:36:06.807 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:06.807 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:06.821 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.820+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.821+0000 7f1619925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.821+0000 7f1619925800 20 realm 2023-12-03T11:36:06.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.821+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.822+0000 7f1619925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.822+0000 7f1619925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:06.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.822+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.823 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.822+0000 7f1619925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.822+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.823+0000 7f1619925800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.823+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.823+0000 7f1619925800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:06.824 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.823+0000 7f1619925800 20 searching for the correct realm 2023-12-03T11:36:06.833 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.832+0000 7f16156e5640 0 -- 172.21.15.131:0/1846297713 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f161005e050 msgr2=0x7f1610098930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.834+0000 7f1619925800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:06.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.834+0000 7f1619925800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:06.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.834+0000 7f1619925800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:06.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.834+0000 7f1619925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:06.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.834+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.834+0000 7f1619925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.835 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.834+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.834+0000 7f1619925800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.834+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:06.836 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 20 zone default found 2023-12-03T11:36:06.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 4 Realm: () 2023-12-03T11:36:06.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:06.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:06.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:06.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 20 zonegroup default 2023-12-03T11:36:06.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.837 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.835+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.836+0000 7f1619925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.836+0000 7f1619925800 20 started sync module instance, tier type = 2023-12-03T11:36:06.838 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.836+0000 7f1619925800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:06.842 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.841+0000 7f16156e5640 0 -- 172.21.15.131:0/1846297713 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f15f0079670 msgr2=0x7f15f007baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.845 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.844+0000 7f1619925800 20 add_watcher() i=0 2023-12-03T11:36:06.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.844+0000 7f1619925800 20 add_watcher() i=1 2023-12-03T11:36:06.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.844+0000 7f1619925800 20 add_watcher() i=2 2023-12-03T11:36:06.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.844+0000 7f1619925800 20 add_watcher() i=3 2023-12-03T11:36:06.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.844+0000 7f1619925800 20 add_watcher() i=4 2023-12-03T11:36:06.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.844+0000 7f1619925800 20 add_watcher() i=5 2023-12-03T11:36:06.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.844+0000 7f1619925800 20 add_watcher() i=6 2023-12-03T11:36:06.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.845+0000 7f1619925800 20 add_watcher() i=7 2023-12-03T11:36:06.846 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.845+0000 7f1619925800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:06.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.846+0000 7f15dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.847+0000 7f1619925800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:06.848 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.847+0000 7f1619925800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:06.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.852+0000 7f1619925800 5 note: GC not initialized 2023-12-03T11:36:06.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.853+0000 7f1549ffb640 20 reqs_thread_entry: start 2023-12-03T11:36:06.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.853+0000 7f1619925800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:06.854 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.853+0000 7f1619925800 20 Filter name: none 2023-12-03T11:36:06.855 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.853+0000 7f153b7fe640 20 reqs_thread_entry: start 2023-12-03T11:36:06.855 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.853+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.853+0000 7f1619925800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:06.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.853+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.854+0000 7f1619925800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:06.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.854+0000 7f1619925800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:06.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.854+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.854+0000 7f1619925800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:06.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.854+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.854+0000 7f1619925800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:06.856 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.854+0000 7f1619925800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:06.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.855+0000 7f1619925800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.855+0000 7f1619925800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.857 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.856+0000 7f15dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.857+0000 7f1619925800 20 remove_watcher() i=0 2023-12-03T11:36:06.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.857+0000 7f1619925800 2 removed watcher, disabling cache 2023-12-03T11:36:06.859 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.858+0000 7f1619925800 20 remove_watcher() i=1 2023-12-03T11:36:06.860 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.859+0000 7f1619925800 20 remove_watcher() i=2 2023-12-03T11:36:06.861 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.860+0000 7f1619925800 20 remove_watcher() i=3 2023-12-03T11:36:06.862 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.861+0000 7f1619925800 20 remove_watcher() i=4 2023-12-03T11:36:06.863 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.862+0000 7f1619925800 20 remove_watcher() i=5 2023-12-03T11:36:06.864 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.863+0000 7f1619925800 20 remove_watcher() i=6 2023-12-03T11:36:06.865 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.864+0000 7f1619925800 20 remove_watcher() i=7 2023-12-03T11:36:06.870 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:06.870 INFO:tasks.workunit.client.0.smithi131.stderr:BUCKET_STATS: 2023-12-03T11:36:06.870 INFO:tasks.workunit.client.0.smithi131.stderr:bucket: myver id: e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 num_objects: 0 size_kb: 0 num_shards: 2 2023-12-03T11:36:06.870 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:06.871 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2023-12-03T11:36:06.903 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:06.903 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:06.917 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.916+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.918+0000 7fe108212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.918+0000 7fe108212800 20 realm 2023-12-03T11:36:06.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.918+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.918+0000 7fe108212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.919 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.918+0000 7fe108212800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:06.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.918+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.918+0000 7fe108212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.918+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.919+0000 7fe108212800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.919+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.920 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.919+0000 7fe108212800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:06.921 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.919+0000 7fe108212800 20 searching for the correct realm 2023-12-03T11:36:06.929 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.928+0000 7fe103850640 0 -- 172.21.15.131:0/1277743041 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x556f8ab01ed0 msgr2=0x556f8ab04300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.930 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.929+0000 7fe108212800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:06.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.929+0000 7fe108212800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:06.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.929+0000 7fe108212800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:06.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.929+0000 7fe108212800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:06.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.929+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.929+0000 7fe108212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.931 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.929+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.932 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:06.932 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.932 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:06.932 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 20 zone default found 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 4 Realm: () 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 20 zonegroup default 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.930+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.931+0000 7fe108212800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.931+0000 7fe108212800 20 started sync module instance, tier type = 2023-12-03T11:36:06.933 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.931+0000 7fe108212800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:06.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.936+0000 7fe104051640 0 -- 172.21.15.131:0/1277743041 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7fe0ec085910 msgr2=0x7fe0ec05f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:06.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.939+0000 7fe108212800 20 add_watcher() i=0 2023-12-03T11:36:06.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.939+0000 7fe108212800 20 add_watcher() i=1 2023-12-03T11:36:06.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.939+0000 7fe108212800 20 add_watcher() i=2 2023-12-03T11:36:06.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.939+0000 7fe108212800 20 add_watcher() i=3 2023-12-03T11:36:06.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.939+0000 7fe108212800 20 add_watcher() i=4 2023-12-03T11:36:06.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.939+0000 7fe108212800 20 add_watcher() i=5 2023-12-03T11:36:06.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.939+0000 7fe108212800 20 add_watcher() i=6 2023-12-03T11:36:06.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.940+0000 7fe108212800 20 add_watcher() i=7 2023-12-03T11:36:06.941 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.940+0000 7fe108212800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:06.942 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.941+0000 7fe0c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:06.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.941+0000 7fe108212800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:06.943 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.941+0000 7fe108212800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:06.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.947+0000 7fe108212800 5 note: GC not initialized 2023-12-03T11:36:06.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.947+0000 7fe040ff9640 20 reqs_thread_entry: start 2023-12-03T11:36:06.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.947+0000 7fe108212800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:06.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.947+0000 7fe108212800 20 Filter name: none 2023-12-03T11:36:06.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.947+0000 7fe0367fc640 20 reqs_thread_entry: start 2023-12-03T11:36:06.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:36:06.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:06.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:36:06.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:36:06.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 : miss 2023-12-03T11:36:06.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 20 rados->read ofs=0 len=0 2023-12-03T11:36:06.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:06.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:06.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 10 adding default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:06.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:06.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:06.951 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.948+0000 7fe108212800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 2023-12-03T11:36:06.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe108212800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:06.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe108212800 10 moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:06.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe108212800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:06.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe108212800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17, ofs0, ns] 2023-12-03T11:36:06.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe0f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791327 cookie 93937556583456 notifier 7157 bl.length()=783 2023-12-03T11:36:06.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe0f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:06.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe0f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:06.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe0f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:06.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe108212800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_sources= new_sources= 2023-12-03T11:36:06.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe108212800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential sources added=[] removed=[] 2023-12-03T11:36:06.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe108212800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_dests= new_dests= 2023-12-03T11:36:06.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.953+0000 7fe108212800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential dests added=[] removed=[] 2023-12-03T11:36:06.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:06.955+0000 7fe108212800 -1 Injecting delay=5.000000000s at location=do_reshard 2023-12-03T11:36:11.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.955+0000 7fe108212800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.0 2023-12-03T11:36:11.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.955+0000 7fe108212800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.0 2023-12-03T11:36:11.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.955+0000 7fe108212800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.1 2023-12-03T11:36:11.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.955+0000 7fe108212800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.1 2023-12-03T11:36:11.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.955+0000 7fe108212800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.2 2023-12-03T11:36:11.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.955+0000 7fe108212800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.2 2023-12-03T11:36:11.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.955+0000 7fe108212800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.1.0 2023-12-03T11:36:11.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.955+0000 7fe108212800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.1.0 2023-12-03T11:36:11.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.956+0000 7fe108212800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.1.1 2023-12-03T11:36:11.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.956+0000 7fe108212800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.1.1 2023-12-03T11:36:11.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.956+0000 7fe108212800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 : hit (requested=0x17, cached=0x17) 2023-12-03T11:36:11.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.956+0000 7fe108212800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 2023-12-03T11:36:11.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.958+0000 7fe108212800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:11.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.958+0000 7fe108212800 10 moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:11.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.958+0000 7fe108212800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:11.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.958+0000 7fe108212800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17, ofs0, ns] 2023-12-03T11:36:11.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.959+0000 7fe0f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791328 cookie 93937556583456 notifier 7157 bl.length()=751 2023-12-03T11:36:11.960 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.959+0000 7fe0f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:11.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.959+0000 7fe0f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:11.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.959+0000 7fe0f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:11.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.959+0000 7fe108212800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_sources= new_sources= 2023-12-03T11:36:11.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.959+0000 7fe108212800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential sources added=[] removed=[] 2023-12-03T11:36:11.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.959+0000 7fe108212800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_dests= new_dests= 2023-12-03T11:36:11.961 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.959+0000 7fe108212800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential dests added=[] removed=[] 2023-12-03T11:36:11.962 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.961+0000 7fe108212800 1 execute INFO: reshard of bucket "myver" completed successfully 2023-12-03T11:36:11.964 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.963+0000 7fe0c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:11.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.966+0000 7fe108212800 20 remove_watcher() i=0 2023-12-03T11:36:11.967 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.966+0000 7fe108212800 2 removed watcher, disabling cache 2023-12-03T11:36:11.968 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.967+0000 7fe108212800 20 remove_watcher() i=1 2023-12-03T11:36:11.970 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.969+0000 7fe108212800 20 remove_watcher() i=2 2023-12-03T11:36:11.971 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.970+0000 7fe108212800 20 remove_watcher() i=3 2023-12-03T11:36:11.972 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.971+0000 7fe108212800 20 remove_watcher() i=4 2023-12-03T11:36:11.974 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.973+0000 7fe108212800 20 remove_watcher() i=5 2023-12-03T11:36:11.975 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.974+0000 7fe108212800 20 remove_watcher() i=6 2023-12-03T11:36:11.976 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:11.975+0000 7fe108212800 20 remove_watcher() i=7 2023-12-03T11:36:12.899 INFO:tasks.workunit.client.0.smithi131.stderr:put object successful 2023-12-03T11:36:12.899 INFO:tasks.workunit.client.0.smithi131.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2023-12-03T11:36:12.899 INFO:tasks.workunit.client.0.smithi131.stderr: 2023-12-03T11:36:13.043 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2023-12-03T11:36:13.429 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2023-12-03T11:36:14.861 INFO:tasks.workunit.client.0.smithi131.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:36:14.863 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket myver --object x 2023-12-03T11:36:14.894 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:14.895 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:14.910 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.908+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.911 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.910+0000 7f6ef832d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:14.911 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.910+0000 7f6ef832d800 20 realm 2023-12-03T11:36:14.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.910+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.910+0000 7f6ef832d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:14.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.910+0000 7f6ef832d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:14.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.910+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.910+0000 7f6ef832d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:14.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.910+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.911+0000 7f6ef832d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:14.912 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.911+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.913 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.911+0000 7f6ef832d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:14.913 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.912+0000 7f6ef832d800 20 searching for the correct realm 2023-12-03T11:36:14.924 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.923+0000 7f6ef3f7e640 0 -- 172.21.15.131:0/2540608621 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55db42dd3fc0 msgr2=0x55db42dd63b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:14.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.924+0000 7f6ef832d800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:14.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.924+0000 7f6ef832d800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:14.925 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.924+0000 7f6ef832d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:14.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.924+0000 7f6ef832d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:14.926 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.924+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.924+0000 7f6ef832d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.924+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 20 zone default found 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 4 Realm: () 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 20 zonegroup default 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:14.927 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.925+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.926+0000 7f6ef832d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:14.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.926+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.926+0000 7f6ef832d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:14.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.926+0000 7f6ef832d800 20 started sync module instance, tier type = 2023-12-03T11:36:14.928 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.926+0000 7f6ef832d800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:14.935 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.933+0000 7f6eeb77d640 0 -- 172.21.15.131:0/2540608621 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55db42dd89c0 msgr2=0x55db42ddadf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:14.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.936+0000 7f6ef832d800 20 add_watcher() i=0 2023-12-03T11:36:14.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.936+0000 7f6ef832d800 20 add_watcher() i=1 2023-12-03T11:36:14.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.936+0000 7f6ef832d800 20 add_watcher() i=2 2023-12-03T11:36:14.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.936+0000 7f6ef832d800 20 add_watcher() i=3 2023-12-03T11:36:14.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.936+0000 7f6ef832d800 20 add_watcher() i=4 2023-12-03T11:36:14.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.936+0000 7f6ef832d800 20 add_watcher() i=5 2023-12-03T11:36:14.937 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.936+0000 7f6ef832d800 20 add_watcher() i=6 2023-12-03T11:36:14.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.937+0000 7f6ef832d800 20 add_watcher() i=7 2023-12-03T11:36:14.938 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.937+0000 7f6ef832d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:14.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.938+0000 7f6eb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:14.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.939+0000 7f6ef832d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:14.940 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.939+0000 7f6ef832d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.945+0000 7f6ef832d800 5 note: GC not initialized 2023-12-03T11:36:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.945+0000 7f6e30ff9640 20 reqs_thread_entry: start 2023-12-03T11:36:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.945+0000 7f6ef832d800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.945+0000 7f6ef832d800 20 Filter name: none 2023-12-03T11:36:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.945+0000 7f6e267fc640 20 reqs_thread_entry: start 2023-12-03T11:36:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.945+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.946+0000 7f6ef832d800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:14.947 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.946+0000 7f6ef832d800 20 rados->read ofs=0 len=0 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.946+0000 7f6ef832d800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.946+0000 7f6ef832d800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.946+0000 7f6ef832d800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.946+0000 7f6ef832d800 20 INFO: main: starting shard=0 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.947+0000 7f6ef832d800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.0 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.947+0000 7f6ef832d800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.0 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.947+0000 7f6ef832d800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.947+0000 7f6ef832d800 20 INFO: main: starting shard=1 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.947+0000 7f6ef832d800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.1 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.947+0000 7f6ef832d800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.1 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.947+0000 7f6ef832d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.947+0000 7f6ef832d800 20 INFO: main: starting shard=2 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.947+0000 7f6ef832d800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.2 2023-12-03T11:36:14.949 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.947+0000 7f6ef832d800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.2 2023-12-03T11:36:14.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.948+0000 7f6ef832d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:36:14.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.948+0000 7f6ef832d800 20 INFO: main: done 2023-12-03T11:36:14.950 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.949+0000 7f6eb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:14.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.951+0000 7f6ef832d800 20 remove_watcher() i=0 2023-12-03T11:36:14.952 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.951+0000 7f6ef832d800 2 removed watcher, disabling cache 2023-12-03T11:36:14.953 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.952+0000 7f6ef832d800 20 remove_watcher() i=1 2023-12-03T11:36:14.954 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.953+0000 7f6ef832d800 20 remove_watcher() i=2 2023-12-03T11:36:14.955 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.954+0000 7f6ef832d800 20 remove_watcher() i=3 2023-12-03T11:36:14.956 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.955+0000 7f6ef832d800 20 remove_watcher() i=4 2023-12-03T11:36:14.957 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.956+0000 7f6ef832d800 20 remove_watcher() i=5 2023-12-03T11:36:14.958 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.957+0000 7f6ef832d800 20 remove_watcher() i=6 2023-12-03T11:36:14.959 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:14.958+0000 7f6ef832d800 20 remove_watcher() i=7 2023-12-03T11:36:15.017 INFO:tasks.workunit.client.0.smithi131.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:36:15.018 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket myver --object y 2023-12-03T11:36:15.047 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:15.047 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:15.061 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.060+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.061+0000 7f51d7b26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.061+0000 7f51d7b26800 20 realm 2023-12-03T11:36:15.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.061+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.061+0000 7f51d7b26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.061+0000 7f51d7b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:15.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.061+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.062+0000 7f51d7b26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.063 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.062+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.063+0000 7f51d7b26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:15.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.063+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.063+0000 7f51d7b26800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:15.064 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.063+0000 7f51d7b26800 20 searching for the correct realm 2023-12-03T11:36:15.073 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.072+0000 7f51d3723640 0 -- 172.21.15.131:0/1998209957 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x5576a56b2510 msgr2=0x7f51cc0079d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:15.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.074+0000 7f51d7b26800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:15.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.074+0000 7f51d7b26800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:15.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.074+0000 7f51d7b26800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:15.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.074+0000 7f51d7b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:15.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.074+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.074+0000 7f51d7b26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.074+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.074+0000 7f51d7b26800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:15.076 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.074+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:15.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 20 zone default found 2023-12-03T11:36:15.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 4 Realm: () 2023-12-03T11:36:15.077 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:15.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:15.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:15.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 20 zonegroup default 2023-12-03T11:36:15.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.075+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.076+0000 7f51d7b26800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.076+0000 7f51d7b26800 20 started sync module instance, tier type = 2023-12-03T11:36:15.078 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.076+0000 7f51d7b26800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:15.079 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.078+0000 7f51d3723640 0 -- 172.21.15.131:0/1998209957 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5576a5855a10 msgr2=0x5576a5857e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:15.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.085+0000 7f51d7b26800 20 add_watcher() i=0 2023-12-03T11:36:15.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.085+0000 7f51d7b26800 20 add_watcher() i=1 2023-12-03T11:36:15.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.085+0000 7f51d7b26800 20 add_watcher() i=2 2023-12-03T11:36:15.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.085+0000 7f51d7b26800 20 add_watcher() i=3 2023-12-03T11:36:15.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.085+0000 7f51d7b26800 20 add_watcher() i=4 2023-12-03T11:36:15.086 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.085+0000 7f51d7b26800 20 add_watcher() i=5 2023-12-03T11:36:15.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.085+0000 7f51d7b26800 20 add_watcher() i=6 2023-12-03T11:36:15.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.086+0000 7f51d7b26800 20 add_watcher() i=7 2023-12-03T11:36:15.087 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.086+0000 7f51d7b26800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:15.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.087+0000 7f51997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:15.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.088+0000 7f51d7b26800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:15.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.088+0000 7f51d7b26800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:15.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.093+0000 7f51d7b26800 5 note: GC not initialized 2023-12-03T11:36:15.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.094+0000 7f5107fff640 20 reqs_thread_entry: start 2023-12-03T11:36:15.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.094+0000 7f51d7b26800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:15.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.094+0000 7f51d7b26800 20 Filter name: none 2023-12-03T11:36:15.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.094+0000 7f5105ffb640 20 reqs_thread_entry: start 2023-12-03T11:36:15.096 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.094+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.094+0000 7f51d7b26800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:15.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.094+0000 7f51d7b26800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.095+0000 7f51d7b26800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:15.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.095+0000 7f51d7b26800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:15.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.095+0000 7f51d7b26800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2023-12-03T11:36:15.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.095+0000 7f51d7b26800 20 INFO: main: starting shard=0 2023-12-03T11:36:15.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.095+0000 7f51d7b26800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.0 2023-12-03T11:36:15.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.095+0000 7f51d7b26800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.0 2023-12-03T11:36:15.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.095+0000 7f51d7b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:36:15.097 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.095+0000 7f51d7b26800 20 INFO: main: starting shard=1 2023-12-03T11:36:15.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.095+0000 7f51d7b26800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.1 2023-12-03T11:36:15.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.095+0000 7f51d7b26800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.1 2023-12-03T11:36:15.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.096+0000 7f51d7b26800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:36:15.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.096+0000 7f51d7b26800 20 INFO: main: starting shard=2 2023-12-03T11:36:15.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.096+0000 7f51d7b26800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.2 2023-12-03T11:36:15.098 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.096+0000 7f51d7b26800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.2 2023-12-03T11:36:15.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.096+0000 7f51d7b26800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:36:15.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.096+0000 7f51d7b26800 20 INFO: main: done 2023-12-03T11:36:15.099 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.097+0000 7f51997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:15.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.099+0000 7f51d7b26800 20 remove_watcher() i=0 2023-12-03T11:36:15.100 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.099+0000 7f51d7b26800 2 removed watcher, disabling cache 2023-12-03T11:36:15.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.100+0000 7f51d7b26800 20 remove_watcher() i=1 2023-12-03T11:36:15.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.101+0000 7f51d7b26800 20 remove_watcher() i=2 2023-12-03T11:36:15.103 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.102+0000 7f51d7b26800 20 remove_watcher() i=3 2023-12-03T11:36:15.104 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.103+0000 7f51d7b26800 20 remove_watcher() i=4 2023-12-03T11:36:15.105 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.104+0000 7f51d7b26800 20 remove_watcher() i=5 2023-12-03T11:36:15.106 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.105+0000 7f51d7b26800 20 remove_watcher() i=6 2023-12-03T11:36:15.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.106+0000 7f51d7b26800 20 remove_watcher() i=7 2023-12-03T11:36:15.164 INFO:tasks.workunit.client.0.smithi131.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2023-12-03T11:36:15.166 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bi list --bucket myver --object z 2023-12-03T11:36:15.196 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:15.196 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:15.210 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.209+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.210+0000 7f2951d75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.210+0000 7f2951d75800 20 realm 2023-12-03T11:36:15.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.210+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.210+0000 7f2951d75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.210+0000 7f2951d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:15.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.210+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.211+0000 7f2951d75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.211+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.212+0000 7f2951d75800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:15.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.212+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.213 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.212+0000 7f2951d75800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:15.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.212+0000 7f2951d75800 20 searching for the correct realm 2023-12-03T11:36:15.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.222+0000 7f294f87c640 0 -- 172.21.15.131:0/1978805596 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x564b9e0a6f80 msgr2=0x564b9e0a9370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:15.225 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.224+0000 7f2951d75800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:15.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.224+0000 7f2951d75800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:15.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.224+0000 7f2951d75800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:15.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.224+0000 7f2951d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:15.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.224+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.224+0000 7f2951d75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.226 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.224+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:15.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:15.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 20 zone default found 2023-12-03T11:36:15.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 4 Realm: () 2023-12-03T11:36:15.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:15.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:15.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:15.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 20 zonegroup default 2023-12-03T11:36:15.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.228 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.225+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.226+0000 7f2951d75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.226+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.226+0000 7f2951d75800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:15.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.226+0000 7f2951d75800 20 started sync module instance, tier type = 2023-12-03T11:36:15.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.226+0000 7f2951d75800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:15.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.232+0000 7f295007d640 0 -- 172.21.15.131:0/1978805596 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f294403e940 msgr2=0x7f2944015420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:15.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.235+0000 7f2951d75800 20 add_watcher() i=0 2023-12-03T11:36:15.236 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.235+0000 7f2951d75800 20 add_watcher() i=1 2023-12-03T11:36:15.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.235+0000 7f2951d75800 20 add_watcher() i=2 2023-12-03T11:36:15.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.235+0000 7f2951d75800 20 add_watcher() i=3 2023-12-03T11:36:15.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.235+0000 7f2951d75800 20 add_watcher() i=4 2023-12-03T11:36:15.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.235+0000 7f2951d75800 20 add_watcher() i=5 2023-12-03T11:36:15.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.235+0000 7f2951d75800 20 add_watcher() i=6 2023-12-03T11:36:15.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.236+0000 7f2951d75800 20 add_watcher() i=7 2023-12-03T11:36:15.238 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.236+0000 7f2951d75800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:15.239 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.237+0000 7f2915fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:15.239 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.238+0000 7f2951d75800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:15.239 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.238+0000 7f2951d75800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:15.245 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.243+0000 7f2951d75800 5 note: GC not initialized 2023-12-03T11:36:15.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.244+0000 7f288cff9640 20 reqs_thread_entry: start 2023-12-03T11:36:15.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.244+0000 7f2951d75800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:15.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.244+0000 7f2951d75800 20 Filter name: none 2023-12-03T11:36:15.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.244+0000 7f28827fc640 20 reqs_thread_entry: start 2023-12-03T11:36:15.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.244+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.244+0000 7f2951d75800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:15.246 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.244+0000 7f2951d75800 20 rados->read ofs=0 len=0 2023-12-03T11:36:15.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.245+0000 7f2951d75800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:15.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.245+0000 7f2951d75800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:15.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.245+0000 7f2951d75800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2023-12-03T11:36:15.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.245+0000 7f2951d75800 20 INFO: main: starting shard=0 2023-12-03T11:36:15.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.245+0000 7f2951d75800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.0 2023-12-03T11:36:15.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.245+0000 7f2951d75800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.0 2023-12-03T11:36:15.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.245+0000 7f2951d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:36:15.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.245+0000 7f2951d75800 20 INFO: main: starting shard=1 2023-12-03T11:36:15.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.245+0000 7f2951d75800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.1 2023-12-03T11:36:15.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.245+0000 7f2951d75800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.1 2023-12-03T11:36:15.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.245+0000 7f2951d75800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2023-12-03T11:36:15.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.246+0000 7f2951d75800 20 INFO: main: starting shard=2 2023-12-03T11:36:15.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.246+0000 7f2951d75800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.2 2023-12-03T11:36:15.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.246+0000 7f2951d75800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.2 2023-12-03T11:36:15.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.246+0000 7f2951d75800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2023-12-03T11:36:15.248 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.246+0000 7f2951d75800 20 INFO: main: done 2023-12-03T11:36:15.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.247+0000 7f2915fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:15.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.249+0000 7f2951d75800 20 remove_watcher() i=0 2023-12-03T11:36:15.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.249+0000 7f2951d75800 2 removed watcher, disabling cache 2023-12-03T11:36:15.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.250+0000 7f2951d75800 20 remove_watcher() i=1 2023-12-03T11:36:15.252 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.251+0000 7f2951d75800 20 remove_watcher() i=2 2023-12-03T11:36:15.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.252+0000 7f2951d75800 20 remove_watcher() i=3 2023-12-03T11:36:15.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.253+0000 7f2951d75800 20 remove_watcher() i=4 2023-12-03T11:36:15.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.254+0000 7f2951d75800 20 remove_watcher() i=5 2023-12-03T11:36:15.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.255+0000 7f2951d75800 20 remove_watcher() i=6 2023-12-03T11:36:15.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:15.256+0000 7f2951d75800 20 remove_watcher() i=7 2023-12-03T11:36:15.268 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2023-12-03T11:36:15.650 INFO:tasks.workunit.client.0.smithi131.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2023-12-03T11:36:16.023 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2023-12-03T11:36:16.052 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:16.053 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:16.066 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.065+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.068 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.067+0000 7fcb3e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.068 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.067+0000 7fcb3e721800 20 realm 2023-12-03T11:36:16.068 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.067+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.068 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.067+0000 7fcb3e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.067+0000 7fcb3e721800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:16.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.067+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.067+0000 7fcb3e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.067+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.068+0000 7fcb3e721800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:16.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.068+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.069 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.068+0000 7fcb3e721800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:16.070 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.068+0000 7fcb3e721800 20 searching for the correct realm 2023-12-03T11:36:16.080 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.079+0000 7fcb3a4b8640 0 -- 172.21.15.131:0/2138264434 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55c1c07c5fc0 msgr2=0x55c1c07c83b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:16.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.080+0000 7fcb3e721800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:16.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.080+0000 7fcb3e721800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:16.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.080+0000 7fcb3e721800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:16.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.080+0000 7fcb3e721800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:16.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.080+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.080+0000 7fcb3e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.080+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.080+0000 7fcb3e721800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:16.082 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.080+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:16.083 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 20 zone default found 2023-12-03T11:36:16.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 4 Realm: () 2023-12-03T11:36:16.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:16.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:16.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:16.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 20 zonegroup default 2023-12-03T11:36:16.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.081+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.084 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.082+0000 7fcb3e721800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.082+0000 7fcb3e721800 20 started sync module instance, tier type = 2023-12-03T11:36:16.085 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.082+0000 7fcb3e721800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:16.089 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.088+0000 7fcb3acb9640 0 -- 172.21.15.131:0/2138264434 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7fcb2409aed0 msgr2=0x7fcb240992d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:16.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.091+0000 7fcb3e721800 20 add_watcher() i=0 2023-12-03T11:36:16.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.091+0000 7fcb3e721800 20 add_watcher() i=1 2023-12-03T11:36:16.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.091+0000 7fcb3e721800 20 add_watcher() i=2 2023-12-03T11:36:16.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.091+0000 7fcb3e721800 20 add_watcher() i=3 2023-12-03T11:36:16.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.091+0000 7fcb3e721800 20 add_watcher() i=4 2023-12-03T11:36:16.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.091+0000 7fcb3e721800 20 add_watcher() i=5 2023-12-03T11:36:16.092 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.091+0000 7fcb3e721800 20 add_watcher() i=6 2023-12-03T11:36:16.093 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.091+0000 7fcb3e721800 20 add_watcher() i=7 2023-12-03T11:36:16.093 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.091+0000 7fcb3e721800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:16.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.093+0000 7fcafffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:16.094 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.093+0000 7fcb3e721800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:16.095 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.093+0000 7fcb3e721800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:16.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.099+0000 7fcb3e721800 5 note: GC not initialized 2023-12-03T11:36:16.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.099+0000 7fca6effd640 20 reqs_thread_entry: start 2023-12-03T11:36:16.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.099+0000 7fcb3e721800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:16.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.099+0000 7fcb3e721800 20 Filter name: none 2023-12-03T11:36:16.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.099+0000 7fca6cff9640 20 reqs_thread_entry: start 2023-12-03T11:36:16.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.099+0000 7fcb3e721800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:36:16.101 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.099+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.100+0000 7fcb3e721800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:16.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.100+0000 7fcb3e721800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:36:16.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.100+0000 7fcb3e721800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:36:16.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.100+0000 7fcb3e721800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 : miss 2023-12-03T11:36:16.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.100+0000 7fcb3e721800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.100+0000 7fcb3e721800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:16.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.100+0000 7fcb3e721800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:16.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.100+0000 7fcb3e721800 10 adding default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:16.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.100+0000 7fcb3e721800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:16.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.100+0000 7fcb3e721800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:16.102 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.100+0000 7fcb3e721800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 2023-12-03T11:36:16.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.106+0000 7fcb3e721800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:16.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.106+0000 7fcb3e721800 10 moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:16.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.106+0000 7fcb3e721800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:16.107 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.106+0000 7fcb3e721800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17, ofs0, ns] 2023-12-03T11:36:16.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.106+0000 7fcb30cb5640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791329 cookie 94290646477248 notifier 7259 bl.length()=783 2023-12-03T11:36:16.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.106+0000 7fcb30cb5640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:16.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.106+0000 7fcb30cb5640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:16.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.106+0000 7fcb30cb5640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:16.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.107+0000 7fcb3e721800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_sources= new_sources= 2023-12-03T11:36:16.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.107+0000 7fcb3e721800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential sources added=[] removed=[] 2023-12-03T11:36:16.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.107+0000 7fcb3e721800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_dests= new_dests= 2023-12-03T11:36:16.108 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.107+0000 7fcb3e721800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential dests added=[] removed=[] 2023-12-03T11:36:16.109 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.0 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.0 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.1 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.1 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.2 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.2 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.3 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.3 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.4 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.4 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.5 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.5 2023-12-03T11:36:16.110 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.6 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.6 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.7 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.7 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.8 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.8 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.10 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.10 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.11 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.11 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.12 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.12 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.13 2023-12-03T11:36:16.111 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.13 2023-12-03T11:36:16.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.14 2023-12-03T11:36:16.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.14 2023-12-03T11:36:16.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.15 2023-12-03T11:36:16.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.15 2023-12-03T11:36:16.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.16 2023-12-03T11:36:16.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.16 2023-12-03T11:36:16.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.0 2023-12-03T11:36:16.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.108+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.0 2023-12-03T11:36:16.112 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.109+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.1 2023-12-03T11:36:16.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.109+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.1 2023-12-03T11:36:16.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.109+0000 7fcb3e721800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.2 2023-12-03T11:36:16.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.109+0000 7fcb3e721800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.2.2 2023-12-03T11:36:16.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.111+0000 7fcb3e721800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 : hit (requested=0x17, cached=0x17) 2023-12-03T11:36:16.113 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.111+0000 7fcb3e721800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 2023-12-03T11:36:16.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.112+0000 7fcb3e721800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:16.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.112+0000 7fcb3e721800 10 moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:16.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.112+0000 7fcb3e721800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:16.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.112+0000 7fcb3e721800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17, ofs0, ns] 2023-12-03T11:36:16.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.112+0000 7fcb30cb5640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791330 cookie 94290646477248 notifier 7259 bl.length()=751 2023-12-03T11:36:16.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.112+0000 7fcb30cb5640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:16.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.112+0000 7fcb30cb5640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:16.114 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.112+0000 7fcb30cb5640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:16.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.113+0000 7fcb3e721800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_sources= new_sources= 2023-12-03T11:36:16.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.113+0000 7fcb3e721800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential sources added=[] removed=[] 2023-12-03T11:36:16.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.113+0000 7fcb3e721800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): orig_dests= new_dests= 2023-12-03T11:36:16.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.113+0000 7fcb3e721800 20 handle_bi_update(): bucket=:myver[e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17]): potential dests added=[] removed=[] 2023-12-03T11:36:16.115 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.114+0000 7fcb3e721800 1 execute INFO: reshard of bucket "myver" completed successfully 2023-12-03T11:36:16.117 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.116+0000 7fcafffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:16.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.118+0000 7fcb3e721800 20 remove_watcher() i=0 2023-12-03T11:36:16.119 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.118+0000 7fcb3e721800 2 removed watcher, disabling cache 2023-12-03T11:36:16.120 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.119+0000 7fcb3e721800 20 remove_watcher() i=1 2023-12-03T11:36:16.121 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.120+0000 7fcb3e721800 20 remove_watcher() i=2 2023-12-03T11:36:16.122 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.121+0000 7fcb3e721800 20 remove_watcher() i=3 2023-12-03T11:36:16.123 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.122+0000 7fcb3e721800 20 remove_watcher() i=4 2023-12-03T11:36:16.124 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.123+0000 7fcb3e721800 20 remove_watcher() i=5 2023-12-03T11:36:16.125 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.124+0000 7fcb3e721800 20 remove_watcher() i=6 2023-12-03T11:36:16.126 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.125+0000 7fcb3e721800 20 remove_watcher() i=7 2023-12-03T11:36:16.132 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2023-12-03T11:36:16.165 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:16.165 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:16.178 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.177+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.179+0000 7f4bf6732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.180 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.179+0000 7f4bf6732800 20 realm 2023-12-03T11:36:16.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.179+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.179+0000 7f4bf6732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.179+0000 7f4bf6732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:16.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.179+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.179+0000 7f4bf6732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.181 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.179+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.180+0000 7f4bf6732800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:16.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.180+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.180+0000 7f4bf6732800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:16.182 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.180+0000 7f4bf6732800 20 searching for the correct realm 2023-12-03T11:36:16.191 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.190+0000 7f4bf1b5a640 0 -- 172.21.15.131:0/2854053716 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x5628a1d64d30 msgr2=0x5628a1d67120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:16.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.191+0000 7f4bf6732800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:16.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.191+0000 7f4bf6732800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:16.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.191+0000 7f4bf6732800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:16.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.191+0000 7f4bf6732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:16.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.191+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.191+0000 7f4bf6732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.191+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.191+0000 7f4bf6732800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:16.193 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.191+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:16.194 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 20 zone default found 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 4 Realm: () 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 20 zonegroup default 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.192+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.193+0000 7f4bf6732800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.193+0000 7f4bf6732800 20 started sync module instance, tier type = 2023-12-03T11:36:16.195 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.193+0000 7f4bf6732800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:16.201 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.200+0000 7f4bf1b5a640 0 -- 172.21.15.131:0/2854053716 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x7f4bcc079670 msgr2=0x7f4bcc07baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:16.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.202+0000 7f4bf6732800 20 add_watcher() i=0 2023-12-03T11:36:16.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.202+0000 7f4bf6732800 20 add_watcher() i=1 2023-12-03T11:36:16.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.202+0000 7f4bf6732800 20 add_watcher() i=2 2023-12-03T11:36:16.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.202+0000 7f4bf6732800 20 add_watcher() i=3 2023-12-03T11:36:16.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.202+0000 7f4bf6732800 20 add_watcher() i=4 2023-12-03T11:36:16.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.202+0000 7f4bf6732800 20 add_watcher() i=5 2023-12-03T11:36:16.203 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.202+0000 7f4bf6732800 20 add_watcher() i=6 2023-12-03T11:36:16.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.202+0000 7f4bf6732800 20 add_watcher() i=7 2023-12-03T11:36:16.204 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.202+0000 7f4bf6732800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:16.205 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.204+0000 7f4bb7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:16.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.205+0000 7f4bf6732800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:16.206 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.205+0000 7f4bf6732800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:16.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.210+0000 7f4bf6732800 5 note: GC not initialized 2023-12-03T11:36:16.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.210+0000 7f4b26ffd640 20 reqs_thread_entry: start 2023-12-03T11:36:16.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.211+0000 7f4bf6732800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:16.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.211+0000 7f4bf6732800 20 Filter name: none 2023-12-03T11:36:16.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.211+0000 7f4b24ff9640 20 reqs_thread_entry: start 2023-12-03T11:36:16.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.211+0000 7f4bf6732800 10 cache get: name=default.rgw.meta+root+myver : miss 2023-12-03T11:36:16.212 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.211+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.211+0000 7f4bf6732800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:16.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.211+0000 7f4bf6732800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2023-12-03T11:36:16.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.211+0000 7f4bf6732800 10 adding default.rgw.meta+root+myver to cache LRU end 2023-12-03T11:36:16.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.211+0000 7f4bf6732800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 : miss 2023-12-03T11:36:16.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.211+0000 7f4bf6732800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.212+0000 7f4bf6732800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:16.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.212+0000 7f4bf6732800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 info.flags=0x17 2023-12-03T11:36:16.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.212+0000 7f4bf6732800 10 adding default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 to cache LRU end 2023-12-03T11:36:16.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.212+0000 7f4bf6732800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:36:16.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.212+0000 7f4bf6732800 10 updating xattr: name=user.rgw.acl bl.length()=143 2023-12-03T11:36:16.214 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.212+0000 7f4bf6732800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17 2023-12-03T11:36:16.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.212+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.0 2023-12-03T11:36:16.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.212+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.0 2023-12-03T11:36:16.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.212+0000 7f4bf6732800 1 NOTICE: finished shard 0 (0 entries removed) 2023-12-03T11:36:16.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.212+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.1 2023-12-03T11:36:16.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.212+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.1 2023-12-03T11:36:16.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.213+0000 7f4bf6732800 1 NOTICE: finished shard 1 (0 entries removed) 2023-12-03T11:36:16.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.213+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.2 2023-12-03T11:36:16.215 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.213+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.2 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.213+0000 7f4bf6732800 1 NOTICE: finished shard 2 (0 entries removed) 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.213+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.3 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.213+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.3 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.213+0000 7f4bf6732800 1 NOTICE: finished shard 3 (0 entries removed) 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.213+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.4 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.213+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.4 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.214+0000 7f4bf6732800 1 NOTICE: finished shard 4 (0 entries removed) 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.214+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.5 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.214+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.5 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.214+0000 7f4bf6732800 1 NOTICE: finished shard 5 (0 entries removed) 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.214+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.6 2023-12-03T11:36:16.217 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.214+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.6 2023-12-03T11:36:16.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.215+0000 7f4bf6732800 1 NOTICE: finished shard 6 (0 entries removed) 2023-12-03T11:36:16.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.215+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.7 2023-12-03T11:36:16.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.215+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.7 2023-12-03T11:36:16.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.215+0000 7f4bf6732800 1 NOTICE: finished shard 7 (0 entries removed) 2023-12-03T11:36:16.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.215+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.8 2023-12-03T11:36:16.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.215+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.8 2023-12-03T11:36:16.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.215+0000 7f4bf6732800 1 NOTICE: finished shard 8 (0 entries removed) 2023-12-03T11:36:16.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.215+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.218 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.215+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.216+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.10 2023-12-03T11:36:16.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.216+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.10 2023-12-03T11:36:16.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.217+0000 7f4bf6732800 1 NOTICE: finished shard 10 (0 entries removed) 2023-12-03T11:36:16.219 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.217+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.11 2023-12-03T11:36:16.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.217+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.11 2023-12-03T11:36:16.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.217+0000 7f4bf6732800 1 NOTICE: finished shard 11 (0 entries removed) 2023-12-03T11:36:16.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.217+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.12 2023-12-03T11:36:16.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.217+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.12 2023-12-03T11:36:16.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.218+0000 7f4bf6732800 1 NOTICE: finished shard 12 (0 entries removed) 2023-12-03T11:36:16.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.218+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.13 2023-12-03T11:36:16.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.218+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.13 2023-12-03T11:36:16.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.218+0000 7f4bf6732800 1 NOTICE: finished shard 13 (0 entries removed) 2023-12-03T11:36:16.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.218+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.14 2023-12-03T11:36:16.220 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.218+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.14 2023-12-03T11:36:16.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.218+0000 7f4bf6732800 1 NOTICE: finished shard 14 (0 entries removed) 2023-12-03T11:36:16.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.218+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.15 2023-12-03T11:36:16.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.218+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.15 2023-12-03T11:36:16.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.219+0000 7f4bf6732800 1 NOTICE: finished shard 15 (0 entries removed) 2023-12-03T11:36:16.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.219+0000 7f4bf6732800 10 bucket_obj is .dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.16 2023-12-03T11:36:16.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.219+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.16 2023-12-03T11:36:16.221 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.219+0000 7f4bf6732800 1 NOTICE: finished shard 16 (0 entries removed) 2023-12-03T11:36:16.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.219+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.219+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4be408ccd0 obj=myver:x state=0x5628a1e159d8 s->prefetch_data=0 2023-12-03T11:36:16.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.220+0000 7f4bf6732800 20 get_obj_state: setting s->obj_tag to 6ct27ig18h07fj042rb9ivax6fj3y8cw 2023-12-03T11:36:16.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.220+0000 7f4bf6732800 20 get_obj_state_impl: setting s->olh_tag to cw1tsyqf1qq7f24dy0d7b6zz35f512ss 2023-12-03T11:36:16.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.220+0000 7f4bf6732800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cw1tsyqf1qq7f24dy0d7b6zz35f512ss 2023-12-03T11:36:16.222 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.221+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.223 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.222+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.222+0000 7f4bf6732800 20 olh_log_entry: epoch=2 op=2 key=x[] 2023-12-03T11:36:16.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.222+0000 7f4bf6732800 20 olh_log_entry: epoch=2 op=3 key=x[tGEWGX-qU2ps7-LE79Jv3EwUOwJVLjE] 2023-12-03T11:36:16.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.222+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4be408ccd0 obj=myver:_:tGEWGX-qU2ps7-LE79Jv3EwUOwJVLjE_x state=0x5628a1e1e0a8 s->prefetch_data=0 2023-12-03T11:36:16.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.223+0000 7f4bf6732800 10 manifest: total_size = 9 2023-12-03T11:36:16.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.223+0000 7f4bf6732800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.11029904007490676220 2023-12-03T11:36:16.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.223+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4be408ccd0 obj=myver:_:tGEWGX-qU2ps7-LE79Jv3EwUOwJVLjE_x state=0x5628a1e1e0a8 s->prefetch_data=0 2023-12-03T11:36:16.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.223+0000 7f4bf6732800 20 prepare_atomic_modification: state is not atomic. state=0x5628a1e1e0a8 2023-12-03T11:36:16.224 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.223+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.226+0000 7f4be0ff9640 20 handle_completion(): completion ok for obj=x[tGEWGX-qU2ps7-LE79Jv3EwUOwJVLjE] 2023-12-03T11:36:16.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.226+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4be408ccd0 obj=myver:x state=0x5628a1e159d8 s->prefetch_data=0 2023-12-03T11:36:16.227 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.226+0000 7f4bf6732800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=cw1tsyqf1qq7f24dy0d7b6zz35f512ss 2023-12-03T11:36:16.229 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.228+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.229+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.229+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.230 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.229+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4be408ccd0 obj=myver:y state=0x5628a1e159d8 s->prefetch_data=0 2023-12-03T11:36:16.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.230+0000 7f4bf6732800 20 get_obj_state: setting s->obj_tag to 2vp6ue17q09m5ywh37c507o3v4svypn6 2023-12-03T11:36:16.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.230+0000 7f4bf6732800 20 get_obj_state_impl: setting s->olh_tag to fhiz92p7rytvlc6c49cqxb34uibmpdfd 2023-12-03T11:36:16.231 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.230+0000 7f4bf6732800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fhiz92p7rytvlc6c49cqxb34uibmpdfd 2023-12-03T11:36:16.232 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.231+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.233 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.232+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.232+0000 7f4bf6732800 20 olh_log_entry: epoch=2 op=2 key=y[] 2023-12-03T11:36:16.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.232+0000 7f4bf6732800 20 olh_log_entry: epoch=2 op=3 key=y[4xJkLznYX-QhvxdNSxxQ.cfH.D9UwAd] 2023-12-03T11:36:16.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.232+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4be408ccd0 obj=myver:_:4xJkLznYX-QhvxdNSxxQ.cfH.D9UwAd_y state=0x5628a1e1a068 s->prefetch_data=0 2023-12-03T11:36:16.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.232+0000 7f4bf6732800 10 manifest: total_size = 22 2023-12-03T11:36:16.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.232+0000 7f4bf6732800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16939540160938522187 2023-12-03T11:36:16.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.232+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4be408ccd0 obj=myver:_:4xJkLznYX-QhvxdNSxxQ.cfH.D9UwAd_y state=0x5628a1e1a068 s->prefetch_data=0 2023-12-03T11:36:16.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.232+0000 7f4bf6732800 20 prepare_atomic_modification: state is not atomic. state=0x5628a1e1a068 2023-12-03T11:36:16.234 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.232+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.235+0000 7f4bd3fff640 20 handle_completion(): completion ok for obj=y[4xJkLznYX-QhvxdNSxxQ.cfH.D9UwAd] 2023-12-03T11:36:16.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.236+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4be408ccd0 obj=myver:y state=0x5628a1e159d8 s->prefetch_data=0 2023-12-03T11:36:16.237 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.236+0000 7f4bf6732800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fhiz92p7rytvlc6c49cqxb34uibmpdfd 2023-12-03T11:36:16.238 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.237+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.238+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.239+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.240 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.239+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4bec00fec0 obj=myver:z state=0x5628a1e159d8 s->prefetch_data=0 2023-12-03T11:36:16.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.240+0000 7f4bf6732800 20 get_obj_state: setting s->obj_tag to e4fj6acz6w9y7s9cpwa5hbqektu8xtes 2023-12-03T11:36:16.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.240+0000 7f4bf6732800 20 get_obj_state_impl: setting s->olh_tag to 7izhp87bvae2y57s2l7uvps0zi5nryny 2023-12-03T11:36:16.241 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.240+0000 7f4bf6732800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7izhp87bvae2y57s2l7uvps0zi5nryny 2023-12-03T11:36:16.242 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.241+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.242+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.242+0000 7f4bf6732800 20 olh_log_entry: epoch=2 op=2 key=z[] 2023-12-03T11:36:16.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.242+0000 7f4bf6732800 20 olh_log_entry: epoch=2 op=3 key=z[CI.DI91hZgljSQ2F25coiwFdh5lrB9W] 2023-12-03T11:36:16.243 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.242+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4bec00fec0 obj=myver:_:CI.DI91hZgljSQ2F25coiwFdh5lrB9W_z state=0x5628a1e37688 s->prefetch_data=0 2023-12-03T11:36:16.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.243+0000 7f4bf6732800 10 manifest: total_size = 22 2023-12-03T11:36:16.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.243+0000 7f4bf6732800 20 get_obj_state: setting s->obj_tag to e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.6696640647564065649 2023-12-03T11:36:16.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.243+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4bec00fec0 obj=myver:_:CI.DI91hZgljSQ2F25coiwFdh5lrB9W_z state=0x5628a1e37688 s->prefetch_data=0 2023-12-03T11:36:16.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.243+0000 7f4bf6732800 20 prepare_atomic_modification: state is not atomic. state=0x5628a1e37688 2023-12-03T11:36:16.244 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.243+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.246+0000 7f4be0ff9640 20 handle_completion(): completion ok for obj=z[CI.DI91hZgljSQ2F25coiwFdh5lrB9W] 2023-12-03T11:36:16.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.246+0000 7f4bf6732800 20 get_obj_state: octx=0x7f4bec00fec0 obj=myver:z state=0x5628a1e159d8 s->prefetch_data=0 2023-12-03T11:36:16.247 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.246+0000 7f4bf6732800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7izhp87bvae2y57s2l7uvps0zi5nryny 2023-12-03T11:36:16.249 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.248+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.249+0000 7f4bf6732800 20 bucket index object: default.rgw.buckets.index:.dir.e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.17.3.9 2023-12-03T11:36:16.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.249+0000 7f4bf6732800 1 NOTICE: finished shard 9 (3 entries removed) 2023-12-03T11:36:16.250 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.249+0000 7f4bf6732800 1 NOTICE: finished all shards (3 entries removed) 2023-12-03T11:36:16.251 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.250+0000 7f4bb7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:16.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.252+0000 7f4bf6732800 20 remove_watcher() i=0 2023-12-03T11:36:16.253 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.252+0000 7f4bf6732800 2 removed watcher, disabling cache 2023-12-03T11:36:16.254 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.253+0000 7f4bf6732800 20 remove_watcher() i=1 2023-12-03T11:36:16.255 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.254+0000 7f4bf6732800 20 remove_watcher() i=2 2023-12-03T11:36:16.256 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.255+0000 7f4bf6732800 20 remove_watcher() i=3 2023-12-03T11:36:16.257 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.256+0000 7f4bf6732800 20 remove_watcher() i=4 2023-12-03T11:36:16.258 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.257+0000 7f4bf6732800 20 remove_watcher() i=5 2023-12-03T11:36:16.259 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.258+0000 7f4bf6732800 20 remove_watcher() i=6 2023-12-03T11:36:16.260 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.259+0000 7f4bf6732800 20 remove_watcher() i=7 2023-12-03T11:36:16.315 INFO:tasks.workunit.client.0.smithi131.stderr:radosgw-admin bucket stats --bucket myver 2023-12-03T11:36:16.342 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:36:16.343 INFO:tasks.workunit.client.0.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:36:16.356 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.355+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.356+0000 7fd66b531800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.356+0000 7fd66b531800 20 realm 2023-12-03T11:36:16.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.356+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.356+0000 7fd66b531800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.356+0000 7fd66b531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:36:16.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.356+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.357+0000 7fd66b531800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.358 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.357+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.357+0000 7fd66b531800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:16.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.357+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.358+0000 7fd66b531800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:36:16.359 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.358+0000 7fd66b531800 20 searching for the correct realm 2023-12-03T11:36:16.368 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.367+0000 7fd65e97d640 0 -- 172.21.15.131:0/1205400798 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x558b1d33fd90 msgr2=0x558b1d342180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:36:16.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.368+0000 7fd66b531800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:36:16.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.368+0000 7fd66b531800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:36:16.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.368+0000 7fd66b531800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:36:16.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.368+0000 7fd66b531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:36:16.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.368+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.368+0000 7fd66b531800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.370 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.368+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:36:16.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:36:16.371 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 20 zone default found 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 4 Realm: () 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 20 zonegroup default 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.369+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.370+0000 7fd66b531800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.370+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.370+0000 7fd66b531800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.370+0000 7fd66b531800 20 started sync module instance, tier type = 2023-12-03T11:36:16.372 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.370+0000 7fd66b531800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:36:16.377 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.376+0000 7fd65e97d640 0 -- 172.21.15.131:0/1205400798 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x7fd640079640 msgr2=0x7fd64007ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:36:16.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.379+0000 7fd66b531800 20 add_watcher() i=0 2023-12-03T11:36:16.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.379+0000 7fd66b531800 20 add_watcher() i=1 2023-12-03T11:36:16.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.379+0000 7fd66b531800 20 add_watcher() i=2 2023-12-03T11:36:16.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.379+0000 7fd66b531800 20 add_watcher() i=3 2023-12-03T11:36:16.380 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.379+0000 7fd66b531800 20 add_watcher() i=4 2023-12-03T11:36:16.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.379+0000 7fd66b531800 20 add_watcher() i=5 2023-12-03T11:36:16.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.379+0000 7fd66b531800 20 add_watcher() i=6 2023-12-03T11:36:16.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.380+0000 7fd66b531800 20 add_watcher() i=7 2023-12-03T11:36:16.381 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.380+0000 7fd66b531800 2 all 8 watchers are set, enabling cache 2023-12-03T11:36:16.382 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.381+0000 7fd62d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:16.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.381+0000 7fd66b531800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:36:16.383 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.381+0000 7fd66b531800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:36:16.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.387+0000 7fd66b531800 5 note: GC not initialized 2023-12-03T11:36:16.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.387+0000 7fd59bfff640 20 reqs_thread_entry: start 2023-12-03T11:36:16.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.387+0000 7fd66b531800 20 init_complete bucket index max shards: 1 2023-12-03T11:36:16.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.388+0000 7fd66b531800 20 Filter name: none 2023-12-03T11:36:16.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.388+0000 7fd599ffb640 20 reqs_thread_entry: start 2023-12-03T11:36:16.389 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.388+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.388+0000 7fd66b531800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:16.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.388+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.390 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.388+0000 7fd66b531800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:16.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.388+0000 7fd66b531800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:16.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.388+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.389+0000 7fd66b531800 20 rados_obj.operate() r=0 bl.length=173 2023-12-03T11:36:16.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.389+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.389+0000 7fd66b531800 20 rados_obj.operate() r=0 bl.length=357 2023-12-03T11:36:16.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.389+0000 7fd66b531800 20 couldn't put binfo cache entry, might have raced with data changes 2023-12-03T11:36:16.391 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.390+0000 7fd66b531800 20 rados->read ofs=0 len=0 2023-12-03T11:36:16.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.390+0000 7fd66b531800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:36:16.392 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.391+0000 7fd62d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:36:16.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.393+0000 7fd66b531800 20 remove_watcher() i=0 2023-12-03T11:36:16.394 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.393+0000 7fd66b531800 2 removed watcher, disabling cache 2023-12-03T11:36:16.395 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.394+0000 7fd66b531800 20 remove_watcher() i=1 2023-12-03T11:36:16.396 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.395+0000 7fd66b531800 20 remove_watcher() i=2 2023-12-03T11:36:16.397 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.396+0000 7fd66b531800 20 remove_watcher() i=3 2023-12-03T11:36:16.398 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.397+0000 7fd66b531800 20 remove_watcher() i=4 2023-12-03T11:36:16.399 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.398+0000 7fd66b531800 20 remove_watcher() i=5 2023-12-03T11:36:16.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.399+0000 7fd66b531800 20 remove_watcher() i=6 2023-12-03T11:36:16.401 INFO:tasks.workunit.client.0.smithi131.stderr:2023-12-03T11:36:16.400+0000 7fd66b531800 20 remove_watcher() i=7 2023-12-03T11:36:16.406 INFO:tasks.workunit.client.0.smithi131.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2023-12-03T11:36:16.406 INFO:tasks.workunit.client.0.smithi131.stderr:Deleting bucket a-bucket 2023-12-03T11:36:16.422 INFO:tasks.workunit.client.0.smithi131.stderr:Deleting bucket myver 2023-12-03T11:36:16.503 INFO:tasks.workunit.client.0.smithi131.stderr:Completed resharding tests 2023-12-03T11:36:16.503 INFO:tasks.workunit.client.0.smithi131.stdout:connected to http://localhost:80 2023-12-03T11:36:16.568 INFO:tasks.workunit.client.0.smithi131.stderr:+ deactivate 2023-12-03T11:36:16.568 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2023-12-03T11:36:16.568 INFO:tasks.workunit.client.0.smithi131.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-12-03T11:36:16.569 INFO:tasks.workunit.client.0.smithi131.stderr:+ export PATH 2023-12-03T11:36:16.569 INFO:tasks.workunit.client.0.smithi131.stderr:+ unset _OLD_VIRTUAL_PATH 2023-12-03T11:36:16.569 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' -n '' ']' 2023-12-03T11:36:16.569 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2023-12-03T11:36:16.569 INFO:tasks.workunit.client.0.smithi131.stderr:+ hash -r 2023-12-03T11:36:16.569 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' -n '' ']' 2023-12-03T11:36:16.569 INFO:tasks.workunit.client.0.smithi131.stderr:+ unset VIRTUAL_ENV 2023-12-03T11:36:16.569 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' '!' '' = nondestructive ']' 2023-12-03T11:36:16.569 INFO:tasks.workunit.client.0.smithi131.stderr:+ unset -f deactivate 2023-12-03T11:36:16.569 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo OK. 2023-12-03T11:36:16.570 INFO:tasks.workunit.client.0.smithi131.stdout:OK. 2023-12-03T11:36:16.570 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-03T11:36:16.570 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-03T11:36:16.637 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2023-12-03T11:36:16.637 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-03T11:36:16.999 DEBUG:teuthology.parallel:result is None 2023-12-03T11:36:17.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:36:17.027 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:36:17.027 DEBUG:teuthology.orchestra.run.smithi131:> rmdir -- /home/ubuntu/cephtest/mnt.0 2023-12-03T11:36:17.081 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2023-12-03T11:36:17.081 INFO:teuthology.run_tasks:Running task s3tests-java... 2023-12-03T11:36:17.095 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2023-12-03T11:36:17.096 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2023-12-03T11:36:17.096 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2023-12-03T11:36:17.096 DEBUG:teuthology.orchestra.run.smithi131:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2023-12-03T11:36:17.135 INFO:teuthology.orchestra.run.smithi131.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2023-12-03T11:36:22.384 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2023-12-03T11:36:22.385 DEBUG:teuthology.orchestra.run.smithi131:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2023-12-03T11:36:25.270 INFO:teuthology.orchestra.run.smithi131.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2023-12-03T11:36:25.851 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:16:15 ago on Sun 03 Dec 2023 11:20:10 AM UTC. 2023-12-03T11:36:26.020 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-12-03T11:36:26.027 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================== 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================== 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 424 k 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 9.3 M 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout: ModemManager-glib x86_64 1.20.2-1.el9 CentOS-BaseOS 334 k 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 CentOS-AppStream 625 k 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 CentOS-AppStream 11 M 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout: alsa-lib x86_64 1.2.9-1.el9 CentOS-AppStream 499 k 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout: at-spi2-atk x86_64 2.38.0-4.el9 CentOS-AppStream 86 k 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout: at-spi2-core x86_64 2.40.3-1.el9 CentOS-AppStream 176 k 2023-12-03T11:36:26.028 INFO:teuthology.orchestra.run.smithi131.stdout: atk x86_64 2.36.0-5.el9 CentOS-AppStream 270 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: avahi-glib x86_64 0.8-12.el9 appstream 15 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: bluez-libs x86_64 5.64-1.el9 CentOS-BaseOS 83 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: bubblewrap x86_64 0.4.1-6.el9 CentOS-BaseOS 49 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: colord-libs x86_64 1.4.5-4.el9 CentOS-AppStream 228 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: copy-jdk-configs noarch 4.0-3.el9 CentOS-AppStream 27 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: cups-libs x86_64 1:2.3.3op2-22.el9 CentOS-BaseOS 262 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 CentOS-AppStream 524 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: exiv2-libs x86_64 0.27.5-2.el9 CentOS-AppStream 780 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: fdk-aac-free x86_64 2.0.0-8.el9 CentOS-AppStream 324 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak-selinux noarch 1.12.8-1.el9 CentOS-AppStream 20 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak-session-helper x86_64 1.12.8-1.el9 CentOS-AppStream 73 k 2023-12-03T11:36:26.029 INFO:teuthology.orchestra.run.smithi131.stdout: gdk-pixbuf2-modules x86_64 2.42.6-3.el9 CentOS-AppStream 84 k 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: geoclue2 x86_64 2.6.0-7.el9 CentOS-AppStream 122 k 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: giflib x86_64 5.2.1-9.el9 CentOS-AppStream 47 k 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: graphene x86_64 1.10.6-2.el9 CentOS-AppStream 63 k 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: gsm x86_64 1.0.19-6.el9 CentOS-AppStream 33 k 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: gstreamer1 x86_64 1.22.1-2.el9 CentOS-AppStream 1.4 M 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: gstreamer1-plugins-base x86_64 1.22.1-1.el9 CentOS-AppStream 2.2 M 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: gtk-update-icon-cache x86_64 3.24.31-2.el9 CentOS-AppStream 34 k 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: gtk3 x86_64 3.24.31-2.el9 CentOS-AppStream 4.8 M 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: hicolor-icon-theme noarch 0.17-13.el9 CentOS-AppStream 65 k 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: iso-codes noarch 4.6.0-3.el9 CentOS-AppStream 3.3 M 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 CentOS-AppStream 32 M 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: javapackages-filesystem noarch 6.0.0-4.el9 CentOS-AppStream 10 k 2023-12-03T11:36:26.030 INFO:teuthology.orchestra.run.smithi131.stdout: jbigkit-libs x86_64 2.1-23.el9 CentOS-AppStream 52 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: lcms2 x86_64 2.12-3.el9 CentOS-AppStream 166 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libX11-xcb x86_64 1.7.0-8.el9 appstream 11 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libXcomposite x86_64 0.4.5-7.el9 CentOS-AppStream 23 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libXcursor x86_64 1.2.0-7.el9 CentOS-AppStream 30 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libXdamage x86_64 1.1.5-7.el9 CentOS-AppStream 22 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libXfixes x86_64 5.0.3-16.el9 CentOS-AppStream 19 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libXi x86_64 1.7.10-8.el9 CentOS-AppStream 38 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libXinerama x86_64 1.1.4-10.el9 CentOS-AppStream 14 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libXrandr x86_64 1.5.2-8.el9 CentOS-AppStream 27 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libXtst x86_64 1.2.3-16.el9 CentOS-AppStream 20 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libXv x86_64 1.0.11-16.el9 CentOS-AppStream 18 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libXxf86vm x86_64 1.1.4-18.el9 CentOS-AppStream 18 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libasyncns x86_64 0.8-22.el9 CentOS-AppStream 29 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libcanberra x86_64 0.30-27.el9 CentOS-AppStream 85 k 2023-12-03T11:36:26.031 INFO:teuthology.orchestra.run.smithi131.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 CentOS-AppStream 31 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libdrm x86_64 2.4.117-1.el9 CentOS-AppStream 158 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libepoxy x86_64 1.5.5-4.el9 CentOS-AppStream 240 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libexif x86_64 0.6.22-6.el9 CentOS-AppStream 431 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libfontenc x86_64 1.1.3-17.el9 CentOS-AppStream 30 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libgexiv2 x86_64 0.12.3-1.el9 CentOS-AppStream 82 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd x86_64 1:1.3.4-1.el9 CentOS-AppStream 134 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 CentOS-AppStream 36 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 CentOS-AppStream 141 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libgsf x86_64 1.14.47-5.el9 CentOS-AppStream 245 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libgxps x86_64 0.3.2-3.el9 CentOS-AppStream 78 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libiptcdata x86_64 1.0.5-9.el9 CentOS-AppStream 61 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libldac x86_64 2.0.2.3-10.el9 CentOS-AppStream 40 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libnotify x86_64 0.7.9-8.el9 CentOS-AppStream 43 k 2023-12-03T11:36:26.032 INFO:teuthology.orchestra.run.smithi131.stdout: libogg x86_64 2:1.3.4-6.el9 CentOS-AppStream 32 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libosinfo x86_64 1.10.0-1.el9 CentOS-AppStream 312 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libpciaccess x86_64 0.16-6.el9 CentOS-BaseOS 27 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libsbc x86_64 1.4-9.el9 CentOS-AppStream 44 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libsndfile x86_64 1.0.31-8.el9 CentOS-AppStream 205 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libtheora x86_64 1:1.1.1-31.el9 CentOS-AppStream 163 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libtiff x86_64 4.4.0-10.el9 CentOS-AppStream 196 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-ltdl x86_64 2.4.6-45.el9 CentOS-AppStream 36 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libtracker-sparql x86_64 3.1.2-3.el9 CentOS-AppStream 316 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libvisual x86_64 1:0.4.0-34.el9 CentOS-AppStream 143 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libvorbis x86_64 1:1.3.7-5.el9 CentOS-AppStream 192 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-client x86_64 1.21.0-1.el9 CentOS-AppStream 32 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-cursor x86_64 1.21.0-1.el9 CentOS-AppStream 18 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-egl x86_64 1.21.0-1.el9 CentOS-AppStream 12 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-server x86_64 1.21.0-1.el9 CentOS-AppStream 41 k 2023-12-03T11:36:26.033 INFO:teuthology.orchestra.run.smithi131.stdout: libwebp x86_64 1.2.0-8.el9 CentOS-AppStream 276 k 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: libxkbcommon x86_64 1.0.3-4.el9 CentOS-AppStream 132 k 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: libxshmfence x86_64 1.3-10.el9 CentOS-AppStream 12 k 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: lksctp-tools x86_64 1.0.19-2.el9 CentOS-BaseOS 90 k 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: low-memory-monitor x86_64 2.1-4.el9 CentOS-AppStream 35 k 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: lua-posix x86_64 35.0-8.el9 CentOS-AppStream 131 k 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libEGL x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 126 k 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libGL x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 167 k 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libgbm x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 36 k 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libglapi x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 44 k 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-vulkan-drivers x86_64 23.3.0~rc2-1.el9 CentOS-AppStream 9.7 M 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: mkfontscale x86_64 1.2.1-3.el9 CentOS-AppStream 31 k 2023-12-03T11:36:26.034 INFO:teuthology.orchestra.run.smithi131.stdout: openjpeg2 x86_64 2.4.0-7.el9 CentOS-AppStream 162 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: opus x86_64 1.3.1-10.el9 CentOS-AppStream 199 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: orc x86_64 0.4.31-6.el9 CentOS-AppStream 183 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: osinfo-db noarch 20230518-1.el9 CentOS-AppStream 273 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 CentOS-AppStream 68 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: ostree-libs x86_64 2023.7-2.el9 CentOS-AppStream 477 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-libs x86_64 0.3.67-2.el9 CentOS-AppStream 1.7 M 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: poppler x86_64 21.01.0-19.el9 CentOS-AppStream 1.1 M 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: poppler-data noarch 0.4.9-9.el9 CentOS-AppStream 1.8 M 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: poppler-glib x86_64 21.01.0-19.el9 CentOS-AppStream 151 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: pulseaudio-libs x86_64 15.0-2.el9 CentOS-AppStream 666 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: pulseaudio-utils x86_64 15.0-2.el9 CentOS-AppStream 72 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: rtkit x86_64 0.11-28.el9 CentOS-AppStream 55 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: sound-theme-freedesktop noarch 0.8-17.el9 CentOS-AppStream 377 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: totem-pl-parser x86_64 3.26.6-2.el9 CentOS-AppStream 130 k 2023-12-03T11:36:26.035 INFO:teuthology.orchestra.run.smithi131.stdout: ttmkfdir x86_64 3.0.9-65.el9 CentOS-AppStream 52 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: tzdata-java noarch 2023c-1.el9 CentOS-AppStream 149 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: upower x86_64 0.99.11-11.el9 CentOS-AppStream 168 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: vulkan-loader x86_64 1.3.250.1-1.el9 CentOS-AppStream 140 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 CentOS-AppStream 305 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: wireplumber x86_64 0.4.14-1.el9 CentOS-AppStream 83 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: wireplumber-libs x86_64 0.4.14-1.el9 CentOS-AppStream 337 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 CentOS-AppStream 41 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-desktop-portal x86_64 1.12.4-1.el9 CentOS-AppStream 365 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: xkeyboard-config noarch 2.33-2.el9 CentOS-AppStream 780 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 CentOS-AppStream 499 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: dconf x86_64 0.40.0-6.el9 CentOS-AppStream 108 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: exiv2 x86_64 0.27.5-2.el9 CentOS-AppStream 978 k 2023-12-03T11:36:26.036 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak x86_64 1.12.8-1.el9 CentOS-AppStream 1.7 M 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout: gtk2 x86_64 2.24.33-8.el9 CentOS-AppStream 3.5 M 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 CentOS-AppStream 25 k 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout: p11-kit-server x86_64 0.24.1-2.el9 CentOS-AppStream 198 k 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire x86_64 0.3.67-2.el9 CentOS-AppStream 86 k 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-alsa x86_64 0.3.67-2.el9 CentOS-AppStream 55 k 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-jack-audio-connection-kit x86_64 0.3.67-2.el9 CentOS-AppStream 126 k 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-pulseaudio x86_64 0.3.67-2.el9 CentOS-AppStream 18 k 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout: tracker x86_64 3.1.2-3.el9 CentOS-AppStream 537 k 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout: tracker-miners x86_64 3.1.2-3.el9 CentOS-AppStream 887 k 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 CentOS-AppStream 130 k 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout:====================================================================================================== 2023-12-03T11:36:26.037 INFO:teuthology.orchestra.run.smithi131.stdout:Install 129 Packages 2023-12-03T11:36:26.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:36:26.038 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 102 M 2023-12-03T11:36:26.038 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 381 M 2023-12-03T11:36:26.038 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-12-03T11:36:26.727 INFO:teuthology.orchestra.run.smithi131.stdout:(1/129): alsa-lib-1.2.9-1.el9.x86_64.rpm 1.2 MB/s | 499 kB 00:00 2023-12-03T11:36:26.761 INFO:teuthology.orchestra.run.smithi131.stdout:(2/129): adwaita-cursor-theme-40.1.1-3.el9.noar 1.4 MB/s | 625 kB 00:00 2023-12-03T11:36:26.786 INFO:teuthology.orchestra.run.smithi131.stdout:(3/129): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.5 MB/s | 86 kB 00:00 2023-12-03T11:36:26.812 INFO:teuthology.orchestra.run.smithi131.stdout:(4/129): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.6 MB/s | 176 kB 00:00 2023-12-03T11:36:26.854 INFO:teuthology.orchestra.run.smithi131.stdout:(5/129): atk-2.36.0-5.el9.x86_64.rpm 4.1 MB/s | 270 kB 00:00 2023-12-03T11:36:26.879 INFO:teuthology.orchestra.run.smithi131.stdout:(6/129): colord-libs-1.4.5-4.el9.x86_64.rpm 3.5 MB/s | 228 kB 00:00 2023-12-03T11:36:26.904 INFO:teuthology.orchestra.run.smithi131.stdout:(7/129): copy-jdk-configs-4.0-3.el9.noarch.rpm 569 kB/s | 27 kB 00:00 2023-12-03T11:36:27.021 INFO:teuthology.orchestra.run.smithi131.stdout:(8/129): adwaita-icon-theme-40.1.1-3.el9.noarch 15 MB/s | 11 MB 00:00 2023-12-03T11:36:27.046 INFO:teuthology.orchestra.run.smithi131.stdout:(9/129): dconf-0.40.0-6.el9.x86_64.rpm 658 kB/s | 108 kB 00:00 2023-12-03T11:36:27.080 INFO:teuthology.orchestra.run.smithi131.stdout:(10/129): exempi-2.6.0-0.2.20211007gite23c213.e 2.9 MB/s | 524 kB 00:00 2023-12-03T11:36:27.122 INFO:teuthology.orchestra.run.smithi131.stdout:(11/129): exiv2-libs-0.27.5-2.el9.x86_64.rpm 10 MB/s | 780 kB 00:00 2023-12-03T11:36:27.147 INFO:teuthology.orchestra.run.smithi131.stdout:(12/129): exiv2-0.27.5-2.el9.x86_64.rpm 9.6 MB/s | 978 kB 00:00 2023-12-03T11:36:27.181 INFO:teuthology.orchestra.run.smithi131.stdout:(13/129): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.2 MB/s | 324 kB 00:00 2023-12-03T11:36:27.223 INFO:teuthology.orchestra.run.smithi131.stdout:(14/129): flatpak-1.12.8-1.el9.x86_64.rpm 17 MB/s | 1.7 MB 00:00 2023-12-03T11:36:27.240 INFO:teuthology.orchestra.run.smithi131.stdout:(15/129): flatpak-selinux-1.12.8-1.el9.noarch.r 362 kB/s | 20 kB 00:00 2023-12-03T11:36:27.265 INFO:teuthology.orchestra.run.smithi131.stdout:(16/129): flatpak-session-helper-1.12.8-1.el9.x 898 kB/s | 73 kB 00:00 2023-12-03T11:36:27.299 INFO:teuthology.orchestra.run.smithi131.stdout:(17/129): gdk-pixbuf2-modules-2.42.6-3.el9.x86_ 1.1 MB/s | 84 kB 00:00 2023-12-03T11:36:27.332 INFO:teuthology.orchestra.run.smithi131.stdout:(18/129): geoclue2-2.6.0-7.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2023-12-03T11:36:27.358 INFO:teuthology.orchestra.run.smithi131.stdout:(19/129): giflib-5.2.1-9.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2023-12-03T11:36:27.383 INFO:teuthology.orchestra.run.smithi131.stdout:(20/129): graphene-1.10.6-2.el9.x86_64.rpm 758 kB/s | 63 kB 00:00 2023-12-03T11:36:27.408 INFO:teuthology.orchestra.run.smithi131.stdout:(21/129): gsm-1.0.19-6.el9.x86_64.rpm 659 kB/s | 33 kB 00:00 2023-12-03T11:36:27.450 INFO:teuthology.orchestra.run.smithi131.stdout:(22/129): gstreamer1-1.22.1-2.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2023-12-03T11:36:27.505 INFO:teuthology.orchestra.run.smithi131.stdout:(23/129): gstreamer1-plugins-base-1.22.1-1.el9. 18 MB/s | 2.2 MB 00:00 2023-12-03T11:36:27.534 INFO:teuthology.orchestra.run.smithi131.stdout:(24/129): gtk-update-icon-cache-3.24.31-2.el9.x 275 kB/s | 34 kB 00:00 2023-12-03T11:36:27.601 INFO:teuthology.orchestra.run.smithi131.stdout:(25/129): gtk2-2.24.33-8.el9.x86_64.rpm 23 MB/s | 3.5 MB 00:00 2023-12-03T11:36:27.626 INFO:teuthology.orchestra.run.smithi131.stdout:(26/129): hicolor-icon-theme-0.17-13.el9.noarch 729 kB/s | 65 kB 00:00 2023-12-03T11:36:27.719 INFO:teuthology.orchestra.run.smithi131.stdout:(27/129): gtk3-3.24.31-2.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2023-12-03T11:36:27.794 INFO:teuthology.orchestra.run.smithi131.stdout:(28/129): iso-codes-4.6.0-3.el9.noarch.rpm 17 MB/s | 3.3 MB 00:00 2023-12-03T11:36:27.853 INFO:teuthology.orchestra.run.smithi131.stdout:(29/129): java-1.8.0-openjdk-1.8.0.362.b09-4.el 1.8 MB/s | 424 kB 00:00 2023-12-03T11:36:28.062 INFO:teuthology.orchestra.run.smithi131.stdout:(30/129): java-1.8.0-openjdk-devel-1.8.0.362.b0 27 MB/s | 9.3 MB 00:00 2023-12-03T11:36:28.212 INFO:teuthology.orchestra.run.smithi131.stdout:(31/129): javapackages-filesystem-6.0.0-4.el9.n 29 kB/s | 10 kB 00:00 2023-12-03T11:36:28.379 INFO:teuthology.orchestra.run.smithi131.stdout:(32/129): jbigkit-libs-2.1-23.el9.x86_64.rpm 165 kB/s | 52 kB 00:00 2023-12-03T11:36:28.504 INFO:teuthology.orchestra.run.smithi131.stdout:(33/129): lcms2-2.12-3.el9.x86_64.rpm 572 kB/s | 166 kB 00:00 2023-12-03T11:36:28.696 INFO:teuthology.orchestra.run.smithi131.stdout:(34/129): libXcomposite-0.4.5-7.el9.x86_64.rpm 73 kB/s | 23 kB 00:00 2023-12-03T11:36:28.980 INFO:teuthology.orchestra.run.smithi131.stdout:(35/129): java-1.8.0-openjdk-headless-1.8.0.362 27 MB/s | 32 MB 00:01 2023-12-03T11:36:28.997 INFO:teuthology.orchestra.run.smithi131.stdout:(36/129): libXcursor-1.2.0-7.el9.x86_64.rpm 60 kB/s | 30 kB 00:00 2023-12-03T11:36:29.013 INFO:teuthology.orchestra.run.smithi131.stdout:(37/129): libXdamage-1.1.5-7.el9.x86_64.rpm 69 kB/s | 22 kB 00:00 2023-12-03T11:36:29.030 INFO:teuthology.orchestra.run.smithi131.stdout:(38/129): libXfixes-5.0.3-16.el9.x86_64.rpm 564 kB/s | 19 kB 00:00 2023-12-03T11:36:29.047 INFO:teuthology.orchestra.run.smithi131.stdout:(39/129): libXi-1.7.10-8.el9.x86_64.rpm 773 kB/s | 38 kB 00:00 2023-12-03T11:36:29.064 INFO:teuthology.orchestra.run.smithi131.stdout:(40/129): libXinerama-1.1.4-10.el9.x86_64.rpm 278 kB/s | 14 kB 00:00 2023-12-03T11:36:29.081 INFO:teuthology.orchestra.run.smithi131.stdout:(41/129): libXtst-1.2.3-16.el9.x86_64.rpm 611 kB/s | 20 kB 00:00 2023-12-03T11:36:29.098 INFO:teuthology.orchestra.run.smithi131.stdout:(42/129): libXrandr-1.5.2-8.el9.x86_64.rpm 542 kB/s | 27 kB 00:00 2023-12-03T11:36:29.115 INFO:teuthology.orchestra.run.smithi131.stdout:(43/129): libXv-1.0.11-16.el9.x86_64.rpm 358 kB/s | 18 kB 00:00 2023-12-03T11:36:29.132 INFO:teuthology.orchestra.run.smithi131.stdout:(44/129): libXxf86vm-1.1.4-18.el9.x86_64.rpm 352 kB/s | 18 kB 00:00 2023-12-03T11:36:29.149 INFO:teuthology.orchestra.run.smithi131.stdout:(45/129): libasyncns-0.8-22.el9.x86_64.rpm 880 kB/s | 29 kB 00:00 2023-12-03T11:36:29.174 INFO:teuthology.orchestra.run.smithi131.stdout:(46/129): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 85 kB 00:00 2023-12-03T11:36:29.191 INFO:teuthology.orchestra.run.smithi131.stdout:(47/129): libcanberra-gtk2-0.30-27.el9.x86_64.r 425 kB/s | 25 kB 00:00 2023-12-03T11:36:29.208 INFO:teuthology.orchestra.run.smithi131.stdout:(48/129): libcanberra-gtk3-0.30-27.el9.x86_64.r 925 kB/s | 31 kB 00:00 2023-12-03T11:36:29.233 INFO:teuthology.orchestra.run.smithi131.stdout:(49/129): libdrm-2.4.117-1.el9.x86_64.rpm 2.6 MB/s | 158 kB 00:00 2023-12-03T11:36:29.259 INFO:teuthology.orchestra.run.smithi131.stdout:(50/129): libepoxy-1.5.5-4.el9.x86_64.rpm 3.5 MB/s | 240 kB 00:00 2023-12-03T11:36:29.275 INFO:teuthology.orchestra.run.smithi131.stdout:(51/129): libfontenc-1.1.3-17.el9.x86_64.rpm 726 kB/s | 30 kB 00:00 2023-12-03T11:36:29.309 INFO:teuthology.orchestra.run.smithi131.stdout:(52/129): libexif-0.6.22-6.el9.x86_64.rpm 5.6 MB/s | 431 kB 00:00 2023-12-03T11:36:29.334 INFO:teuthology.orchestra.run.smithi131.stdout:(53/129): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.1 MB/s | 82 kB 00:00 2023-12-03T11:36:29.360 INFO:teuthology.orchestra.run.smithi131.stdout:(54/129): libglvnd-1.3.4-1.el9.x86_64.rpm 1.6 MB/s | 134 kB 00:00 2023-12-03T11:36:29.385 INFO:teuthology.orchestra.run.smithi131.stdout:(55/129): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 713 kB/s | 36 kB 00:00 2023-12-03T11:36:29.410 INFO:teuthology.orchestra.run.smithi131.stdout:(56/129): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 141 kB 00:00 2023-12-03T11:36:29.436 INFO:teuthology.orchestra.run.smithi131.stdout:(57/129): libgsf-1.14.47-5.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2023-12-03T11:36:29.461 INFO:teuthology.orchestra.run.smithi131.stdout:(58/129): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 78 kB 00:00 2023-12-03T11:36:29.486 INFO:teuthology.orchestra.run.smithi131.stdout:(59/129): libiptcdata-1.0.5-9.el9.x86_64.rpm 806 kB/s | 61 kB 00:00 2023-12-03T11:36:29.512 INFO:teuthology.orchestra.run.smithi131.stdout:(60/129): libldac-2.0.2.3-10.el9.x86_64.rpm 536 kB/s | 40 kB 00:00 2023-12-03T11:36:29.537 INFO:teuthology.orchestra.run.smithi131.stdout:(61/129): libnotify-0.7.9-8.el9.x86_64.rpm 851 kB/s | 43 kB 00:00 2023-12-03T11:36:29.562 INFO:teuthology.orchestra.run.smithi131.stdout:(62/129): libogg-1.3.4-6.el9.x86_64.rpm 432 kB/s | 32 kB 00:00 2023-12-03T11:36:29.588 INFO:teuthology.orchestra.run.smithi131.stdout:(63/129): libosinfo-1.10.0-1.el9.x86_64.rpm 4.1 MB/s | 312 kB 00:00 2023-12-03T11:36:29.613 INFO:teuthology.orchestra.run.smithi131.stdout:(64/129): libsbc-1.4-9.el9.x86_64.rpm 881 kB/s | 44 kB 00:00 2023-12-03T11:36:29.638 INFO:teuthology.orchestra.run.smithi131.stdout:(65/129): libsndfile-1.0.31-8.el9.x86_64.rpm 2.7 MB/s | 205 kB 00:00 2023-12-03T11:36:29.664 INFO:teuthology.orchestra.run.smithi131.stdout:(66/129): libtheora-1.1.1-31.el9.x86_64.rpm 2.1 MB/s | 163 kB 00:00 2023-12-03T11:36:29.689 INFO:teuthology.orchestra.run.smithi131.stdout:(67/129): libtool-ltdl-2.4.6-45.el9.x86_64.rpm 728 kB/s | 36 kB 00:00 2023-12-03T11:36:29.714 INFO:teuthology.orchestra.run.smithi131.stdout:(68/129): libtiff-4.4.0-10.el9.x86_64.rpm 2.6 MB/s | 196 kB 00:00 2023-12-03T11:36:29.739 INFO:teuthology.orchestra.run.smithi131.stdout:(69/129): libtracker-sparql-3.1.2-3.el9.x86_64. 4.1 MB/s | 316 kB 00:00 2023-12-03T11:36:29.765 INFO:teuthology.orchestra.run.smithi131.stdout:(70/129): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 143 kB 00:00 2023-12-03T11:36:29.790 INFO:teuthology.orchestra.run.smithi131.stdout:(71/129): libwayland-client-1.21.0-1.el9.x86_64 650 kB/s | 32 kB 00:00 2023-12-03T11:36:29.815 INFO:teuthology.orchestra.run.smithi131.stdout:(72/129): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2023-12-03T11:36:29.841 INFO:teuthology.orchestra.run.smithi131.stdout:(73/129): libwayland-cursor-1.21.0-1.el9.x86_64 243 kB/s | 18 kB 00:00 2023-12-03T11:36:29.866 INFO:teuthology.orchestra.run.smithi131.stdout:(74/129): libwayland-egl-1.21.0-1.el9.x86_64.rp 157 kB/s | 12 kB 00:00 2023-12-03T11:36:29.891 INFO:teuthology.orchestra.run.smithi131.stdout:(75/129): libwayland-server-1.21.0-1.el9.x86_64 816 kB/s | 41 kB 00:00 2023-12-03T11:36:29.916 INFO:teuthology.orchestra.run.smithi131.stdout:(76/129): libwebp-1.2.0-8.el9.x86_64.rpm 3.6 MB/s | 276 kB 00:00 2023-12-03T11:36:29.942 INFO:teuthology.orchestra.run.smithi131.stdout:(77/129): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.7 MB/s | 132 kB 00:00 2023-12-03T11:36:29.967 INFO:teuthology.orchestra.run.smithi131.stdout:(78/129): libxshmfence-1.3-10.el9.x86_64.rpm 231 kB/s | 12 kB 00:00 2023-12-03T11:36:29.992 INFO:teuthology.orchestra.run.smithi131.stdout:(79/129): low-memory-monitor-2.1-4.el9.x86_64.r 464 kB/s | 35 kB 00:00 2023-12-03T11:36:30.018 INFO:teuthology.orchestra.run.smithi131.stdout:(80/129): lua-posix-35.0-8.el9.x86_64.rpm 1.7 MB/s | 131 kB 00:00 2023-12-03T11:36:30.043 INFO:teuthology.orchestra.run.smithi131.stdout:(81/129): mesa-libEGL-23.3.0~rc2-1.el9.x86_64.r 2.5 MB/s | 126 kB 00:00 2023-12-03T11:36:30.076 INFO:teuthology.orchestra.run.smithi131.stdout:(82/129): mesa-libGL-23.3.0~rc2-1.el9.x86_64.rp 2.0 MB/s | 167 kB 00:00 2023-12-03T11:36:30.102 INFO:teuthology.orchestra.run.smithi131.stdout:(83/129): mesa-libgbm-23.3.0~rc2-1.el9.x86_64.r 437 kB/s | 36 kB 00:00 2023-12-03T11:36:30.127 INFO:teuthology.orchestra.run.smithi131.stdout:(84/129): mesa-libglapi-23.3.0~rc2-1.el9.x86_64 876 kB/s | 44 kB 00:00 2023-12-03T11:36:30.402 INFO:teuthology.orchestra.run.smithi131.stdout:(85/129): mesa-vulkan-drivers-23.3.0~rc2-1.el9. 30 MB/s | 9.7 MB 00:00 2023-12-03T11:36:30.428 INFO:teuthology.orchestra.run.smithi131.stdout:(86/129): mkfontscale-1.2.1-3.el9.x86_64.rpm 96 kB/s | 31 kB 00:00 2023-12-03T11:36:30.453 INFO:teuthology.orchestra.run.smithi131.stdout:(87/129): openjpeg2-2.4.0-7.el9.x86_64.rpm 501 kB/s | 162 kB 00:00 2023-12-03T11:36:30.478 INFO:teuthology.orchestra.run.smithi131.stdout:(88/129): opus-1.3.1-10.el9.x86_64.rpm 2.6 MB/s | 199 kB 00:00 2023-12-03T11:36:30.512 INFO:teuthology.orchestra.run.smithi131.stdout:(89/129): osinfo-db-20230518-1.el9.noarch.rpm 4.6 MB/s | 273 kB 00:00 2023-12-03T11:36:30.537 INFO:teuthology.orchestra.run.smithi131.stdout:(90/129): orc-0.4.31-6.el9.x86_64.rpm 2.1 MB/s | 183 kB 00:00 2023-12-03T11:36:30.594 INFO:teuthology.orchestra.run.smithi131.stdout:(91/129): osinfo-db-tools-1.10.0-1.el9.x86_64.r 591 kB/s | 68 kB 00:00 2023-12-03T11:36:30.621 INFO:teuthology.orchestra.run.smithi131.stdout:(92/129): ostree-libs-2023.7-2.el9.x86_64.rpm 4.3 MB/s | 477 kB 00:00 2023-12-03T11:36:30.647 INFO:teuthology.orchestra.run.smithi131.stdout:(93/129): p11-kit-server-0.24.1-2.el9.x86_64.rp 3.7 MB/s | 198 kB 00:00 2023-12-03T11:36:30.672 INFO:teuthology.orchestra.run.smithi131.stdout:(94/129): pipewire-0.3.67-2.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2023-12-03T11:36:30.689 INFO:teuthology.orchestra.run.smithi131.stdout:(95/129): pipewire-alsa-0.3.67-2.el9.x86_64.rpm 818 kB/s | 55 kB 00:00 2023-12-03T11:36:30.714 INFO:teuthology.orchestra.run.smithi131.stdout:(96/129): pipewire-jack-audio-connection-kit-0. 3.0 MB/s | 126 kB 00:00 2023-12-03T11:36:30.765 INFO:teuthology.orchestra.run.smithi131.stdout:(97/129): pipewire-libs-0.3.67-2.el9.x86_64.rpm 19 MB/s | 1.7 MB 00:00 2023-12-03T11:36:30.782 INFO:teuthology.orchestra.run.smithi131.stdout:(98/129): pipewire-pulseaudio-0.3.67-2.el9.x86_ 195 kB/s | 18 kB 00:00 2023-12-03T11:36:30.815 INFO:teuthology.orchestra.run.smithi131.stdout:(99/129): poppler-21.01.0-19.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2023-12-03T11:36:30.840 INFO:teuthology.orchestra.run.smithi131.stdout:(100/129): poppler-glib-21.01.0-19.el9.x86_64.r 2.6 MB/s | 151 kB 00:00 2023-12-03T11:36:30.882 INFO:teuthology.orchestra.run.smithi131.stdout:(101/129): poppler-data-0.4.9-9.el9.noarch.rpm 19 MB/s | 1.8 MB 00:00 2023-12-03T11:36:30.916 INFO:teuthology.orchestra.run.smithi131.stdout:(102/129): pulseaudio-libs-15.0-2.el9.x86_64.rp 6.5 MB/s | 666 kB 00:00 2023-12-03T11:36:30.941 INFO:teuthology.orchestra.run.smithi131.stdout:(103/129): pulseaudio-utils-15.0-2.el9.x86_64.r 732 kB/s | 72 kB 00:00 2023-12-03T11:36:30.958 INFO:teuthology.orchestra.run.smithi131.stdout:(104/129): rtkit-0.11-28.el9.x86_64.rpm 1.3 MB/s | 55 kB 00:00 2023-12-03T11:36:30.984 INFO:teuthology.orchestra.run.smithi131.stdout:(105/129): sound-theme-freedesktop-0.8-17.el9.n 5.5 MB/s | 377 kB 00:00 2023-12-03T11:36:31.009 INFO:teuthology.orchestra.run.smithi131.stdout:(106/129): totem-pl-parser-3.26.6-2.el9.x86_64. 1.9 MB/s | 130 kB 00:00 2023-12-03T11:36:31.034 INFO:teuthology.orchestra.run.smithi131.stdout:(107/129): tracker-3.1.2-3.el9.x86_64.rpm 11 MB/s | 537 kB 00:00 2023-12-03T11:36:31.059 INFO:teuthology.orchestra.run.smithi131.stdout:(108/129): tracker-miners-3.1.2-3.el9.x86_64.rp 12 MB/s | 887 kB 00:00 2023-12-03T11:36:31.085 INFO:teuthology.orchestra.run.smithi131.stdout:(109/129): ttmkfdir-3.0.9-65.el9.x86_64.rpm 693 kB/s | 52 kB 00:00 2023-12-03T11:36:31.110 INFO:teuthology.orchestra.run.smithi131.stdout:(110/129): tzdata-java-2023c-1.el9.noarch.rpm 1.9 MB/s | 149 kB 00:00 2023-12-03T11:36:31.135 INFO:teuthology.orchestra.run.smithi131.stdout:(111/129): upower-0.99.11-11.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2023-12-03T11:36:31.169 INFO:teuthology.orchestra.run.smithi131.stdout:(112/129): vulkan-loader-1.3.250.1-1.el9.x86_64 1.6 MB/s | 140 kB 00:00 2023-12-03T11:36:31.194 INFO:teuthology.orchestra.run.smithi131.stdout:(113/129): webrtc-audio-processing-0.3.1-8.el9. 3.6 MB/s | 305 kB 00:00 2023-12-03T11:36:31.220 INFO:teuthology.orchestra.run.smithi131.stdout:(114/129): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-12-03T11:36:31.245 INFO:teuthology.orchestra.run.smithi131.stdout:(115/129): wireplumber-libs-0.4.14-1.el9.x86_64 4.4 MB/s | 337 kB 00:00 2023-12-03T11:36:31.270 INFO:teuthology.orchestra.run.smithi131.stdout:(116/129): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 557 kB/s | 41 kB 00:00 2023-12-03T11:36:31.295 INFO:teuthology.orchestra.run.smithi131.stdout:(117/129): xdg-desktop-portal-1.12.4-1.el9.x86_ 7.1 MB/s | 365 kB 00:00 2023-12-03T11:36:31.321 INFO:teuthology.orchestra.run.smithi131.stdout:(118/129): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 130 kB 00:00 2023-12-03T11:36:31.363 INFO:teuthology.orchestra.run.smithi131.stdout:(119/129): xkeyboard-config-2.33-2.el9.noarch.r 8.3 MB/s | 780 kB 00:00 2023-12-03T11:36:31.389 INFO:teuthology.orchestra.run.smithi131.stdout:(120/129): ModemManager-glib-1.20.2-1.el9.x86_6 5.0 MB/s | 334 kB 00:00 2023-12-03T11:36:31.413 INFO:teuthology.orchestra.run.smithi131.stdout:(121/129): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.4 MB/s | 499 kB 00:00 2023-12-03T11:36:31.439 INFO:teuthology.orchestra.run.smithi131.stdout:(122/129): bluez-libs-5.64-1.el9.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-12-03T11:36:31.464 INFO:teuthology.orchestra.run.smithi131.stdout:(123/129): bubblewrap-0.4.1-6.el9.x86_64.rpm 659 kB/s | 49 kB 00:00 2023-12-03T11:36:31.489 INFO:teuthology.orchestra.run.smithi131.stdout:(124/129): libpciaccess-0.16-6.el9.x86_64.rpm 534 kB/s | 27 kB 00:00 2023-12-03T11:36:31.539 INFO:teuthology.orchestra.run.smithi131.stdout:(125/129): cups-libs-2.3.3op2-22.el9.x86_64.rpm 2.6 MB/s | 262 kB 00:00 2023-12-03T11:36:31.565 INFO:teuthology.orchestra.run.smithi131.stdout:(126/129): lksctp-tools-1.0.19-2.el9.x86_64.rpm 900 kB/s | 90 kB 00:00 2023-12-03T11:36:31.615 INFO:teuthology.orchestra.run.smithi131.stdout:(127/129): libX11-xcb-1.7.0-8.el9.x86_64.rpm 219 kB/s | 11 kB 00:00 2023-12-03T11:36:31.632 INFO:teuthology.orchestra.run.smithi131.stdout:(128/129): avahi-glib-0.8-12.el9.x86_64.rpm 104 kB/s | 15 kB 00:00 2023-12-03T11:36:31.708 INFO:teuthology.orchestra.run.smithi131.stdout:(129/129): flac-libs-1.3.3-12.el9.x86_64.rpm 1.5 MB/s | 218 kB 00:00 2023-12-03T11:36:31.710 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-12-03T11:36:31.711 INFO:teuthology.orchestra.run.smithi131.stdout:Total 18 MB/s | 102 MB 00:05 2023-12-03T11:36:31.746 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-12-03T11:36:31.837 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-12-03T11:36:31.837 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-12-03T11:36:32.857 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-12-03T11:36:32.858 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-12-03T11:36:37.478 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2023-12-03T11:36:37.533 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2023-12-03T11:36:37.685 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-12-03T11:36:37.761 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXi-1.7.10-8.el9.x86_64 1/129 2023-12-03T11:36:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 2/129 2023-12-03T11:36:37.826 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 3/129 2023-12-03T11:36:37.864 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 4/129 2023-12-03T11:36:37.987 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 5/129 2023-12-03T11:36:38.067 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : atk-2.36.0-5.el9.x86_64 6/129 2023-12-03T11:36:38.102 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : alsa-lib-1.2.9-1.el9.x86_64 7/129 2023-12-03T11:36:38.132 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libX11-xcb-1.7.0-8.el9.x86_64 8/129 2023-12-03T11:36:38.172 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cups-libs-1:2.3.3op2-22.el9.x86_64 9/129 2023-12-03T11:36:38.203 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : opus-1.3.1-10.el9.x86_64 10/129 2023-12-03T11:36:38.238 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 11/129 2023-12-03T11:36:38.265 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtool-ltdl-2.4.6-45.el9.x86_64 12/129 2023-12-03T11:36:38.292 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 13/129 2023-12-03T11:36:38.382 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lcms2-2.12-3.el9.x86_64 14/129 2023-12-03T11:36:38.429 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 15/129 2023-12-03T11:36:38.472 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 16/129 2023-12-03T11:36:38.503 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 17/129 2023-12-03T11:36:38.529 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 18/129 2023-12-03T11:36:38.555 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 19/129 2023-12-03T11:36:38.580 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mesa-libglapi-23.3.0~rc2-1.el9.x86_64 20/129 2023-12-03T11:36:38.605 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 21/129 2023-12-03T11:36:38.634 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 22/129 2023-12-03T11:36:38.666 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 23/129 2023-12-03T11:36:38.707 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 24/129 2023-12-03T11:36:38.815 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 25/129 2023-12-03T11:36:38.876 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 26/129 2023-12-03T11:36:38.923 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gtk-update-icon-cache-3.24.31-2.el9.x86_64 27/129 2023-12-03T11:36:38.981 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : dconf-0.40.0-6.el9.x86_64 28/129 2023-12-03T11:36:39.039 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 28/129 2023-12-03T11:36:39.077 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 29/129 2023-12-03T11:36:39.130 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 30/129 2023-12-03T11:36:39.170 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 31/129 2023-12-03T11:36:39.207 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 32/129 2023-12-03T11:36:39.256 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 33/129 2023-12-03T11:36:39.313 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 34/129 2023-12-03T11:36:39.349 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 35/129 2023-12-03T11:36:39.379 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 36/129 2023-12-03T11:36:39.411 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : avahi-glib-0.8-12.el9.x86_64 37/129 2023-12-03T11:36:39.440 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 38/129 2023-12-03T11:36:39.470 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpciaccess-0.16-6.el9.x86_64 39/129 2023-12-03T11:36:39.499 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libdrm-2.4.117-1.el9.x86_64 40/129 2023-12-03T11:36:39.525 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mesa-libgbm-23.3.0~rc2-1.el9.x86_64 41/129 2023-12-03T11:36:39.552 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 42/129 2023-12-03T11:36:39.590 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mesa-libEGL-23.3.0~rc2-1.el9.x86_64 43/129 2023-12-03T11:36:39.825 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : vulkan-loader-1.3.250.1-1.el9.x86_64 44/129 2023-12-03T11:36:39.864 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mesa-vulkan-drivers-23.3.0~rc2-1.el9.x86_64 45/129 2023-12-03T11:36:39.896 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bubblewrap-0.4.1-6.el9.x86_64 46/129 2023-12-03T11:36:39.928 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bluez-libs-5.64-1.el9.x86_64 47/129 2023-12-03T11:36:40.124 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 48/129 2023-12-03T11:36:40.162 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 49/129 2023-12-03T11:36:40.194 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 50/129 2023-12-03T11:36:40.224 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 51/129 2023-12-03T11:36:40.274 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 52/129 2023-12-03T11:36:40.311 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : upower-0.99.11-11.el9.x86_64 53/129 2023-12-03T11:36:40.325 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 53/129 2023-12-03T11:36:40.325 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2023-12-03T11:36:40.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:36:40.516 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : tzdata-java-2023c-1.el9.noarch 54/129 2023-12-03T11:36:40.592 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 55/129 2023-12-03T11:36:40.652 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 56/129 2023-12-03T11:36:40.677 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 57/129 2023-12-03T11:36:40.684 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 57/129 2023-12-03T11:36:41.141 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 58/129 2023-12-03T11:36:41.166 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rtkit-0.11-28.el9.x86_64 58/129 2023-12-03T11:36:41.179 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rtkit-0.11-28.el9.x86_64 58/129 2023-12-03T11:36:41.179 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2023-12-03T11:36:41.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:36:41.384 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 59/129 2023-12-03T11:36:41.417 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : p11-kit-server-0.24.1-2.el9.x86_64 60/129 2023-12-03T11:36:41.466 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ostree-libs-2023.7-2.el9.x86_64 61/129 2023-12-03T11:36:41.942 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 62/129 2023-12-03T11:36:42.003 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : osinfo-db-20230518-1.el9.noarch 63/129 2023-12-03T11:36:42.042 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 64/129 2023-12-03T11:36:42.075 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : orc-0.4.31-6.el9.x86_64 65/129 2023-12-03T11:36:42.128 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 66/129 2023-12-03T11:36:42.157 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-posix-35.0-8.el9.x86_64 67/129 2023-12-03T11:36:42.184 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 68/129 2023-12-03T11:36:42.206 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 69/129 2023-12-03T11:36:42.217 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 69/129 2023-12-03T11:36:42.218 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2023-12-03T11:36:42.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:36:42.273 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 70/129 2023-12-03T11:36:42.310 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 71/129 2023-12-03T11:36:42.338 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libsbc-1.4-9.el9.x86_64 72/129 2023-12-03T11:36:42.368 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 73/129 2023-12-03T11:36:42.850 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 74/129 2023-12-03T11:36:42.882 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 74/129 2023-12-03T11:36:42.900 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 74/129 2023-12-03T11:36:42.931 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 75/129 2023-12-03T11:36:42.987 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libiptcdata-1.0.5-9.el9.x86_64 76/129 2023-12-03T11:36:43.030 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 77/129 2023-12-03T11:36:43.056 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 78/129 2023-12-03T11:36:43.099 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 79/129 2023-12-03T11:36:43.129 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 80/129 2023-12-03T11:36:43.407 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 80/129 2023-12-03T11:36:43.455 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libexif-0.6.22-6.el9.x86_64 81/129 2023-12-03T11:36:43.493 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 82/129 2023-12-03T11:36:43.526 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libasyncns-0.8-22.el9.x86_64 83/129 2023-12-03T11:36:43.555 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 84/129 2023-12-03T11:36:43.587 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 85/129 2023-12-03T11:36:43.612 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : mesa-libGL-23.3.0~rc2-1.el9.x86_64 86/129 2023-12-03T11:36:43.639 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libXv-1.0.11-16.el9.x86_64 87/129 2023-12-03T11:36:43.667 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 88/129 2023-12-03T11:36:43.712 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtiff-4.4.0-10.el9.x86_64 89/129 2023-12-03T11:36:43.743 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 90/129 2023-12-03T11:36:43.799 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 91/129 2023-12-03T11:36:43.835 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : poppler-21.01.0-19.el9.x86_64 92/129 2023-12-03T11:36:43.868 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : poppler-glib-21.01.0-19.el9.x86_64 93/129 2023-12-03T11:36:44.458 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 94/129 2023-12-03T11:36:44.495 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 95/129 2023-12-03T11:36:45.140 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 95/129 2023-12-03T11:36:45.182 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 96/129 2023-12-03T11:36:45.218 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gsm-1.0.19-6.el9.x86_64 97/129 2023-12-03T11:36:45.293 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 98/129 2023-12-03T11:36:45.343 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 99/129 2023-12-03T11:36:45.367 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcanberra-0.30-27.el9.x86_64 100/129 2023-12-03T11:36:45.391 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 100/129 2023-12-03T11:36:45.422 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pulseaudio-utils-15.0-2.el9.x86_64 101/129 2023-12-03T11:36:45.531 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : graphene-1.10.6-2.el9.x86_64 102/129 2023-12-03T11:36:45.586 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 103/129 2023-12-03T11:36:45.612 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : giflib-5.2.1-9.el9.x86_64 104/129 2023-12-03T11:36:45.643 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flatpak-session-helper-1.12.8-1.el9.x86_64 105/129 2023-12-03T11:36:45.667 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flatpak-selinux-1.12.8-1.el9.noarch 106/129 2023-12-03T11:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: flatpak-selinux-1.12.8-1.el9.noarch 106/129 2023-12-03T11:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 107/129 2023-12-03T11:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 108/129 2023-12-03T11:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pipewire-0.3.67-2.el9.x86_64 108/129 2023-12-03T11:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: pipewire-0.3.67-2.el9.x86_64 108/129 2023-12-03T11:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2023-12-03T11:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pipewire-libs-0.3.67-2.el9.x86_64 109/129 2023-12-03T11:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 110/129 2023-12-03T11:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 111/129 2023-12-03T11:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: flatpak-1.12.8-1.el9.x86_64 112/129 2023-12-03T11:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flatpak-1.12.8-1.el9.x86_64 112/129 2023-12-03T11:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xdg-desktop-portal-1.12.4-1.el9.x86_64 113/129 2023-12-03T11:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: xdg-desktop-portal-1.12.4-1.el9.x86_64 113/129 2023-12-03T11:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 114/129 2023-12-03T11:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 115/129 2023-12-03T11:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : tracker-3.1.2-3.el9.x86_64 116/129 2023-12-03T11:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 116/129 2023-12-03T11:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : tracker-miners-3.1.2-3.el9.x86_64 117/129 2023-12-03T11:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: tracker-miners-3.1.2-3.el9.x86_64 117/129 2023-12-03T11:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 118/129 2023-12-03T11:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 119/129 2023-12-03T11:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 120/129 2023-12-03T11:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 121/129 2023-12-03T11:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 121/129 2023-12-03T11:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gtk3-3.24.31-2.el9.x86_64 122/129 2023-12-03T11:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 123/129 2023-12-03T11:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 124/129 2023-12-03T11:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 125/129 2023-12-03T11:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 125/129 2023-12-03T11:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 126/129 2023-12-03T11:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 126/129 2023-12-03T11:37:02.191 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pipewire-alsa-0.3.67-2.el9.x86_64 127/129 2023-12-03T11:37:02.221 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 128/129 2023-12-03T11:37:02.244 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pipewire-pulseaudio-0.3.67-2.el9.x86_64 129/129 2023-12-03T11:37:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: pipewire-pulseaudio-0.3.67-2.el9.x86_64 129/129 2023-12-03T11:37:02.259 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2023-12-03T11:37:02.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:02.282 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 129/129 2023-12-03T11:37:02.288 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 129/129 2023-12-03T11:37:02.311 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 129/129 2023-12-03T11:37:02.321 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 129/129 2023-12-03T11:37:02.322 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2023-12-03T11:37:02.322 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2023-12-03T11:37:02.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:02.383 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 129/129 2023-12-03T11:37:02.455 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 129/129 2023-12-03T11:37:06.293 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: pipewire-pulseaudio-0.3.67-2.el9.x86_64 129/129 2023-12-03T11:37:06.293 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 1/129 2023-12-03T11:37:06.293 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 2/129 2023-12-03T11:37:06.293 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : alsa-lib-1.2.9-1.el9.x86_64 3/129 2023-12-03T11:37:06.293 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 4/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 5/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : atk-2.36.0-5.el9.x86_64 6/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 7/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 8/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 9/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 10/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 11/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 12/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 13/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flatpak-1.12.8-1.el9.x86_64 14/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flatpak-selinux-1.12.8-1.el9.noarch 15/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flatpak-session-helper-1.12.8-1.el9.x86_64 16/129 2023-12-03T11:37:06.294 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 17/129 2023-12-03T11:37:06.295 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 18/129 2023-12-03T11:37:06.295 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 19/129 2023-12-03T11:37:06.295 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 20/129 2023-12-03T11:37:06.295 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 21/129 2023-12-03T11:37:06.295 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 22/129 2023-12-03T11:37:06.295 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gstreamer1-plugins-base-1.22.1-1.el9.x86_64 23/129 2023-12-03T11:37:06.295 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gtk-update-icon-cache-3.24.31-2.el9.x86_64 24/129 2023-12-03T11:37:06.295 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 25/129 2023-12-03T11:37:06.295 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gtk3-3.24.31-2.el9.x86_64 26/129 2023-12-03T11:37:06.295 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 27/129 2023-12-03T11:37:06.295 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 28/129 2023-12-03T11:37:06.304 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 29/129 2023-12-03T11:37:06.304 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x 30/129 2023-12-03T11:37:06.304 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el 31/129 2023-12-03T11:37:06.304 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 32/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 33/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lcms2-2.12-3.el9.x86_64 34/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 35/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 36/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 37/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 38/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 39/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 40/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 41/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 42/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 43/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 44/129 2023-12-03T11:37:06.305 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 45/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 46/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 47/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 48/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libdrm-2.4.117-1.el9.x86_64 49/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 50/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 51/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 52/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 53/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 54/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 55/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 56/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 57/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 58/129 2023-12-03T11:37:06.306 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libiptcdata-1.0.5-9.el9.x86_64 59/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 60/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 61/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 62/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 63/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsbc-1.4-9.el9.x86_64 64/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 65/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 66/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtiff-4.4.0-10.el9.x86_64 67/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtool-ltdl-2.4.6-45.el9.x86_64 68/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 69/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 70/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 71/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 72/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 73/129 2023-12-03T11:37:06.307 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 74/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 75/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 76/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 77/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 78/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 79/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 80/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mesa-libEGL-23.3.0~rc2-1.el9.x86_64 81/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mesa-libGL-23.3.0~rc2-1.el9.x86_64 82/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mesa-libgbm-23.3.0~rc2-1.el9.x86_64 83/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mesa-libglapi-23.3.0~rc2-1.el9.x86_64 84/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mesa-vulkan-drivers-23.3.0~rc2-1.el9.x86_64 85/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 86/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 87/129 2023-12-03T11:37:06.308 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : opus-1.3.1-10.el9.x86_64 88/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : orc-0.4.31-6.el9.x86_64 89/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : osinfo-db-20230518-1.el9.noarch 90/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 91/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ostree-libs-2023.7-2.el9.x86_64 92/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : p11-kit-server-0.24.1-2.el9.x86_64 93/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pipewire-0.3.67-2.el9.x86_64 94/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pipewire-alsa-0.3.67-2.el9.x86_64 95/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pipewire-jack-audio-connection-kit-0.3.67-2.el9. 96/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pipewire-libs-0.3.67-2.el9.x86_64 97/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pipewire-pulseaudio-0.3.67-2.el9.x86_64 98/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : poppler-21.01.0-19.el9.x86_64 99/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 100/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : poppler-glib-21.01.0-19.el9.x86_64 101/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 102/129 2023-12-03T11:37:06.309 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pulseaudio-utils-15.0-2.el9.x86_64 103/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rtkit-0.11-28.el9.x86_64 104/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 105/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 106/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 107/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : tracker-miners-3.1.2-3.el9.x86_64 108/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 109/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : tzdata-java-2023c-1.el9.noarch 110/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : upower-0.99.11-11.el9.x86_64 111/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : vulkan-loader-1.3.250.1-1.el9.x86_64 112/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 113/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 114/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 115/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 116/129 2023-12-03T11:37:06.310 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xdg-desktop-portal-1.12.4-1.el9.x86_64 117/129 2023-12-03T11:37:06.311 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 118/129 2023-12-03T11:37:06.311 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 119/129 2023-12-03T11:37:06.311 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 120/129 2023-12-03T11:37:06.311 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 121/129 2023-12-03T11:37:06.311 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bluez-libs-5.64-1.el9.x86_64 122/129 2023-12-03T11:37:06.311 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bubblewrap-0.4.1-6.el9.x86_64 123/129 2023-12-03T11:37:06.311 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cups-libs-1:2.3.3op2-22.el9.x86_64 124/129 2023-12-03T11:37:06.311 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpciaccess-0.16-6.el9.x86_64 125/129 2023-12-03T11:37:06.311 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 126/129 2023-12-03T11:37:06.311 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : avahi-glib-0.8-12.el9.x86_64 127/129 2023-12-03T11:37:06.311 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 128/129 2023-12-03T11:37:08.323 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libX11-xcb-1.7.0-8.el9.x86_64 129/129 2023-12-03T11:37:08.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:08.323 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2023-12-03T11:37:08.323 INFO:teuthology.orchestra.run.smithi131.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2023-12-03T11:37:08.323 INFO:teuthology.orchestra.run.smithi131.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2023-12-03T11:37:08.323 INFO:teuthology.orchestra.run.smithi131.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2023-12-03T11:37:08.323 INFO:teuthology.orchestra.run.smithi131.stdout: alsa-lib-1.2.9-1.el9.x86_64 2023-12-03T11:37:08.323 INFO:teuthology.orchestra.run.smithi131.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2023-12-03T11:37:08.323 INFO:teuthology.orchestra.run.smithi131.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2023-12-03T11:37:08.323 INFO:teuthology.orchestra.run.smithi131.stdout: atk-2.36.0-5.el9.x86_64 2023-12-03T11:37:08.323 INFO:teuthology.orchestra.run.smithi131.stdout: avahi-glib-0.8-12.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: bluez-libs-5.64-1.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: bubblewrap-0.4.1-6.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: colord-libs-1.4.5-4.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: copy-jdk-configs-4.0-3.el9.noarch 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: cups-libs-1:2.3.3op2-22.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: dconf-0.40.0-6.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: exiv2-0.27.5-2.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: flac-libs-1.3.3-12.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak-1.12.8-1.el9.x86_64 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak-selinux-1.12.8-1.el9.noarch 2023-12-03T11:37:08.324 INFO:teuthology.orchestra.run.smithi131.stdout: flatpak-session-helper-1.12.8-1.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: gdk-pixbuf2-modules-2.42.6-3.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: geoclue2-2.6.0-7.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: giflib-5.2.1-9.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: graphene-1.10.6-2.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: gsm-1.0.19-6.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: gstreamer1-1.22.1-2.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: gstreamer1-plugins-base-1.22.1-1.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: gtk-update-icon-cache-3.24.31-2.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: gtk2-2.24.33-8.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: gtk3-3.24.31-2.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: iso-codes-4.6.0-3.el9.noarch 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2023-12-03T11:37:08.325 INFO:teuthology.orchestra.run.smithi131.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: jbigkit-libs-2.1-23.el9.x86_64 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: lcms2-2.12-3.el9.x86_64 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: libX11-xcb-1.7.0-8.el9.x86_64 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: libXcomposite-0.4.5-7.el9.x86_64 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: libXcursor-1.2.0-7.el9.x86_64 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: libXdamage-1.1.5-7.el9.x86_64 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: libXfixes-5.0.3-16.el9.x86_64 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: libXi-1.7.10-8.el9.x86_64 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: libXinerama-1.1.4-10.el9.x86_64 2023-12-03T11:37:08.326 INFO:teuthology.orchestra.run.smithi131.stdout: libXrandr-1.5.2-8.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libXtst-1.2.3-16.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libXv-1.0.11-16.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libasyncns-0.8-22.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libcanberra-0.30-27.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libdrm-2.4.117-1.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libepoxy-1.5.5-4.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libexif-0.6.22-6.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libfontenc-1.1.3-17.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libgexiv2-0.12.3-1.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2023-12-03T11:37:08.327 INFO:teuthology.orchestra.run.smithi131.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libgsf-1.14.47-5.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libgxps-0.3.2-3.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libiptcdata-1.0.5-9.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libldac-2.0.2.3-10.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libnotify-0.7.9-8.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libogg-2:1.3.4-6.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libosinfo-1.10.0-1.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libpciaccess-0.16-6.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libsbc-1.4-9.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libsndfile-1.0.31-8.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libtheora-1:1.1.1-31.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libtiff-4.4.0-10.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-ltdl-2.4.6-45.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2023-12-03T11:37:08.328 INFO:teuthology.orchestra.run.smithi131.stdout: libvisual-1:0.4.0-34.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-client-1.21.0-1.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: libwayland-server-1.21.0-1.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: libwebp-1.2.0-8.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: libxshmfence-1.3-10.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: low-memory-monitor-2.1-4.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: lua-posix-35.0-8.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libEGL-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libGL-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:37:08.329 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libgbm-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-libglapi-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: mesa-vulkan-drivers-23.3.0~rc2-1.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: mkfontscale-1.2.1-3.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: openjpeg2-2.4.0-7.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: opus-1.3.1-10.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: orc-0.4.31-6.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: osinfo-db-20230518-1.el9.noarch 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: ostree-libs-2023.7-2.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: p11-kit-server-0.24.1-2.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-0.3.67-2.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-alsa-0.3.67-2.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-jack-audio-connection-kit-0.3.67-2.el9.x86_64 2023-12-03T11:37:08.330 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-libs-0.3.67-2.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: pipewire-pulseaudio-0.3.67-2.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: poppler-21.01.0-19.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: poppler-data-0.4.9-9.el9.noarch 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: poppler-glib-21.01.0-19.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: pulseaudio-utils-15.0-2.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: rtkit-0.11-28.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: tracker-3.1.2-3.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: tracker-miners-3.1.2-3.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: tzdata-java-2023c-1.el9.noarch 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: upower-0.99.11-11.el9.x86_64 2023-12-03T11:37:08.331 INFO:teuthology.orchestra.run.smithi131.stdout: vulkan-loader-1.3.250.1-1.el9.x86_64 2023-12-03T11:37:08.332 INFO:teuthology.orchestra.run.smithi131.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2023-12-03T11:37:08.332 INFO:teuthology.orchestra.run.smithi131.stdout: wireplumber-0.4.14-1.el9.x86_64 2023-12-03T11:37:08.332 INFO:teuthology.orchestra.run.smithi131.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2023-12-03T11:37:08.332 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2023-12-03T11:37:08.332 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-desktop-portal-1.12.4-1.el9.x86_64 2023-12-03T11:37:08.332 INFO:teuthology.orchestra.run.smithi131.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2023-12-03T11:37:08.332 INFO:teuthology.orchestra.run.smithi131.stdout: xkeyboard-config-2.33-2.el9.noarch 2023-12-03T11:37:08.332 INFO:teuthology.orchestra.run.smithi131.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2023-12-03T11:37:08.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:08.332 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-12-03T11:37:08.644 INFO:teuthology.orchestra.run.smithi131.stdout: Gradle will be installed under /opt/gradle 2023-12-03T11:37:08.680 INFO:teuthology.orchestra.run.smithi131.stderr:--2023-12-03 11:37:08-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2023-12-03T11:37:08.840 INFO:teuthology.orchestra.run.smithi131.stderr:Resolving services.gradle.org (services.gradle.org)... 104.17.129.37, 104.17.128.37, 2606:4700::6811:8025, ... 2023-12-03T11:37:08.850 INFO:teuthology.orchestra.run.smithi131.stderr:Connecting to services.gradle.org (services.gradle.org)|104.17.129.37|:443... connected. 2023-12-03T11:37:08.912 INFO:teuthology.orchestra.run.smithi131.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2023-12-03T11:37:08.912 INFO:teuthology.orchestra.run.smithi131.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2023-12-03T11:37:08.912 INFO:teuthology.orchestra.run.smithi131.stderr:--2023-12-03 11:37:08-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2023-12-03T11:37:08.912 INFO:teuthology.orchestra.run.smithi131.stderr:Resolving github.com (github.com)... 140.82.114.4 2023-12-03T11:37:08.923 INFO:teuthology.orchestra.run.smithi131.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2023-12-03T11:37:09.066 INFO:teuthology.orchestra.run.smithi131.stderr:HTTP request sent, awaiting response... 302 Found 2023-12-03T11:37:09.066 INFO:teuthology.orchestra.run.smithi131.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20231203%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20231203T113709Z&X-Amz-Expires=300&X-Amz-Signature=b51de9c3c5b7240089e1ec7056ef5b8295e6ae41ba602f134c6c5b0267a35b02&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2023-12-03T11:37:09.066 INFO:teuthology.orchestra.run.smithi131.stderr:--2023-12-03 11:37:09-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20231203%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20231203T113709Z&X-Amz-Expires=300&X-Amz-Signature=b51de9c3c5b7240089e1ec7056ef5b8295e6ae41ba602f134c6c5b0267a35b02&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2023-12-03T11:37:09.085 INFO:teuthology.orchestra.run.smithi131.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.111.133, 185.199.110.133, ... 2023-12-03T11:37:09.280 INFO:teuthology.orchestra.run.smithi131.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2023-12-03T11:37:10.076 INFO:teuthology.orchestra.run.smithi131.stderr:HTTP request sent, awaiting response... 200 OK 2023-12-03T11:37:10.077 INFO:teuthology.orchestra.run.smithi131.stderr:Length: 95129672 (91M) [application/octet-stream] 2023-12-03T11:37:10.077 INFO:teuthology.orchestra.run.smithi131.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2023-12-03T11:37:10.077 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-12-03T11:37:10.462 INFO:teuthology.orchestra.run.smithi131.stderr: 0K .......... .......... .......... .......... .......... 0% 130K 11m57s 2023-12-03T11:37:10.528 INFO:teuthology.orchestra.run.smithi131.stderr: 50K .......... .......... .......... .......... .......... 0% 755K 7m0s 2023-12-03T11:37:10.665 INFO:teuthology.orchestra.run.smithi131.stderr: 100K .......... .......... .......... .......... .......... 0% 365K 6m4s 2023-12-03T11:37:10.708 INFO:teuthology.orchestra.run.smithi131.stderr: 150K .......... .......... .......... .......... .......... 0% 1.14M 4m53s 2023-12-03T11:37:10.740 INFO:teuthology.orchestra.run.smithi131.stderr: 200K .......... .......... .......... .......... .......... 0% 1.50M 4m6s 2023-12-03T11:37:10.770 INFO:teuthology.orchestra.run.smithi131.stderr: 250K .......... .......... .......... .......... .......... 0% 1.65M 3m34s 2023-12-03T11:37:10.864 INFO:teuthology.orchestra.run.smithi131.stderr: 300K .......... .......... .......... .......... .......... 0% 530K 3m28s 2023-12-03T11:37:10.894 INFO:teuthology.orchestra.run.smithi131.stderr: 350K .......... .......... .......... .......... .......... 0% 2.03M 3m8s 2023-12-03T11:37:10.914 INFO:teuthology.orchestra.run.smithi131.stderr: 400K .......... .......... .......... .......... .......... 0% 1.91M 2m52s 2023-12-03T11:37:10.930 INFO:teuthology.orchestra.run.smithi131.stderr: 450K .......... .......... .......... .......... .......... 0% 2.93M 2m38s 2023-12-03T11:37:10.946 INFO:teuthology.orchestra.run.smithi131.stderr: 500K .......... .......... .......... .......... .......... 0% 3.08M 2m26s 2023-12-03T11:37:10.959 INFO:teuthology.orchestra.run.smithi131.stderr: 550K .......... .......... .......... .......... .......... 0% 3.88M 2m16s 2023-12-03T11:37:10.972 INFO:teuthology.orchestra.run.smithi131.stderr: 600K .......... .......... .......... .......... .......... 0% 3.58M 2m7s 2023-12-03T11:37:10.985 INFO:teuthology.orchestra.run.smithi131.stderr: 650K .......... .......... .......... .......... .......... 0% 3.84M 2m0s 2023-12-03T11:37:11.059 INFO:teuthology.orchestra.run.smithi131.stderr: 700K .......... .......... .......... .......... .......... 0% 675K 2m1s 2023-12-03T11:37:11.072 INFO:teuthology.orchestra.run.smithi131.stderr: 750K .......... .......... .......... .......... .......... 0% 3.76M 1m55s 2023-12-03T11:37:11.083 INFO:teuthology.orchestra.run.smithi131.stderr: 800K .......... .......... .......... .......... .......... 0% 4.55M 1m49s 2023-12-03T11:37:11.093 INFO:teuthology.orchestra.run.smithi131.stderr: 850K .......... .......... .......... .......... .......... 0% 4.83M 1m44s 2023-12-03T11:37:11.105 INFO:teuthology.orchestra.run.smithi131.stderr: 900K .......... .......... .......... .......... .......... 1% 4.27M 1m40s 2023-12-03T11:37:11.111 INFO:teuthology.orchestra.run.smithi131.stderr: 950K .......... .......... .......... .......... .......... 1% 7.55M 95s 2023-12-03T11:37:11.119 INFO:teuthology.orchestra.run.smithi131.stderr: 1000K .......... .......... .......... .......... .......... 1% 5.73M 91s 2023-12-03T11:37:11.130 INFO:teuthology.orchestra.run.smithi131.stderr: 1050K .......... .......... .......... .......... .......... 1% 4.52M 88s 2023-12-03T11:37:11.137 INFO:teuthology.orchestra.run.smithi131.stderr: 1100K .......... .......... .......... .......... .......... 1% 7.29M 85s 2023-12-03T11:37:11.145 INFO:teuthology.orchestra.run.smithi131.stderr: 1150K .......... .......... .......... .......... .......... 1% 6.19M 82s 2023-12-03T11:37:11.151 INFO:teuthology.orchestra.run.smithi131.stderr: 1200K .......... .......... .......... .......... .......... 1% 7.30M 79s 2023-12-03T11:37:11.158 INFO:teuthology.orchestra.run.smithi131.stderr: 1250K .......... .......... .......... .......... .......... 1% 7.56M 76s 2023-12-03T11:37:11.164 INFO:teuthology.orchestra.run.smithi131.stderr: 1300K .......... .......... .......... .......... .......... 1% 7.80M 74s 2023-12-03T11:37:11.169 INFO:teuthology.orchestra.run.smithi131.stderr: 1350K .......... .......... .......... .......... .......... 1% 9.27M 71s 2023-12-03T11:37:11.176 INFO:teuthology.orchestra.run.smithi131.stderr: 1400K .......... .......... .......... .......... .......... 1% 7.97M 69s 2023-12-03T11:37:11.238 INFO:teuthology.orchestra.run.smithi131.stderr: 1450K .......... .......... .......... .......... .......... 1% 802K 71s 2023-12-03T11:37:11.245 INFO:teuthology.orchestra.run.smithi131.stderr: 1500K .......... .......... .......... .......... .......... 1% 7.41M 69s 2023-12-03T11:37:11.251 INFO:teuthology.orchestra.run.smithi131.stderr: 1550K .......... .......... .......... .......... .......... 1% 7.78M 67s 2023-12-03T11:37:11.257 INFO:teuthology.orchestra.run.smithi131.stderr: 1600K .......... .......... .......... .......... .......... 1% 8.25M 65s 2023-12-03T11:37:11.262 INFO:teuthology.orchestra.run.smithi131.stderr: 1650K .......... .......... .......... .......... .......... 1% 8.53M 64s 2023-12-03T11:37:11.268 INFO:teuthology.orchestra.run.smithi131.stderr: 1700K .......... .......... .......... .......... .......... 1% 9.01M 62s 2023-12-03T11:37:11.273 INFO:teuthology.orchestra.run.smithi131.stderr: 1750K .......... .......... .......... .......... .......... 1% 8.52M 61s 2023-12-03T11:37:11.278 INFO:teuthology.orchestra.run.smithi131.stderr: 1800K .......... .......... .......... .......... .......... 1% 11.2M 59s 2023-12-03T11:37:11.285 INFO:teuthology.orchestra.run.smithi131.stderr: 1850K .......... .......... .......... .......... .......... 2% 7.32M 58s 2023-12-03T11:37:11.291 INFO:teuthology.orchestra.run.smithi131.stderr: 1900K .......... .......... .......... .......... .......... 2% 7.78M 57s 2023-12-03T11:37:11.296 INFO:teuthology.orchestra.run.smithi131.stderr: 1950K .......... .......... .......... .......... .......... 2% 9.27M 55s 2023-12-03T11:37:11.301 INFO:teuthology.orchestra.run.smithi131.stderr: 2000K .......... .......... .......... .......... .......... 2% 11.1M 54s 2023-12-03T11:37:11.305 INFO:teuthology.orchestra.run.smithi131.stderr: 2050K .......... .......... .......... .......... .......... 2% 11.3M 53s 2023-12-03T11:37:11.310 INFO:teuthology.orchestra.run.smithi131.stderr: 2100K .......... .......... .......... .......... .......... 2% 9.88M 52s 2023-12-03T11:37:11.314 INFO:teuthology.orchestra.run.smithi131.stderr: 2150K .......... .......... .......... .......... .......... 2% 12.9M 51s 2023-12-03T11:37:11.319 INFO:teuthology.orchestra.run.smithi131.stderr: 2200K .......... .......... .......... .......... .......... 2% 9.83M 50s 2023-12-03T11:37:11.323 INFO:teuthology.orchestra.run.smithi131.stderr: 2250K .......... .......... .......... .......... .......... 2% 9.86M 49s 2023-12-03T11:37:11.328 INFO:teuthology.orchestra.run.smithi131.stderr: 2300K .......... .......... .......... .......... .......... 2% 10.4M 48s 2023-12-03T11:37:11.332 INFO:teuthology.orchestra.run.smithi131.stderr: 2350K .......... .......... .......... .......... .......... 2% 14.2M 47s 2023-12-03T11:37:11.336 INFO:teuthology.orchestra.run.smithi131.stderr: 2400K .......... .......... .......... .......... .......... 2% 10.9M 47s 2023-12-03T11:37:11.340 INFO:teuthology.orchestra.run.smithi131.stderr: 2450K .......... .......... .......... .......... .......... 2% 12.2M 46s 2023-12-03T11:37:11.343 INFO:teuthology.orchestra.run.smithi131.stderr: 2500K .......... .......... .......... .......... .......... 2% 14.8M 45s 2023-12-03T11:37:11.348 INFO:teuthology.orchestra.run.smithi131.stderr: 2550K .......... .......... .......... .......... .......... 2% 12.5M 44s 2023-12-03T11:37:11.355 INFO:teuthology.orchestra.run.smithi131.stderr: 2600K .......... .......... .......... .......... .......... 2% 6.78M 44s 2023-12-03T11:37:11.355 INFO:teuthology.orchestra.run.smithi131.stderr: 2650K .......... .......... .......... .......... .......... 2% 56.9M 43s 2023-12-03T11:37:11.359 INFO:teuthology.orchestra.run.smithi131.stderr: 2700K .......... .......... .......... .......... .......... 2% 12.9M 42s 2023-12-03T11:37:11.363 INFO:teuthology.orchestra.run.smithi131.stderr: 2750K .......... .......... .......... .......... .......... 3% 12.8M 41s 2023-12-03T11:37:11.366 INFO:teuthology.orchestra.run.smithi131.stderr: 2800K .......... .......... .......... .......... .......... 3% 15.9M 41s 2023-12-03T11:37:11.369 INFO:teuthology.orchestra.run.smithi131.stderr: 2850K .......... .......... .......... .......... .......... 3% 15.6M 40s 2023-12-03T11:37:11.420 INFO:teuthology.orchestra.run.smithi131.stderr: 2900K .......... .......... .......... .......... .......... 3% 988K 41s 2023-12-03T11:37:11.424 INFO:teuthology.orchestra.run.smithi131.stderr: 2950K .......... .......... .......... .......... .......... 3% 11.7M 40s 2023-12-03T11:37:11.429 INFO:teuthology.orchestra.run.smithi131.stderr: 3000K .......... .......... .......... .......... .......... 3% 11.0M 40s 2023-12-03T11:37:11.430 INFO:teuthology.orchestra.run.smithi131.stderr: 3050K .......... .......... .......... .......... .......... 3% 27.3M 39s 2023-12-03T11:37:11.433 INFO:teuthology.orchestra.run.smithi131.stderr: 3100K .......... .......... .......... .......... .......... 3% 16.0M 39s 2023-12-03T11:37:11.439 INFO:teuthology.orchestra.run.smithi131.stderr: 3150K .......... .......... .......... .......... .......... 3% 9.67M 38s 2023-12-03T11:37:11.440 INFO:teuthology.orchestra.run.smithi131.stderr: 3200K .......... .......... .......... .......... .......... 3% 33.6M 38s 2023-12-03T11:37:11.443 INFO:teuthology.orchestra.run.smithi131.stderr: 3250K .......... .......... .......... .......... .......... 3% 14.0M 37s 2023-12-03T11:37:11.446 INFO:teuthology.orchestra.run.smithi131.stderr: 3300K .......... .......... .......... .......... .......... 3% 18.0M 37s 2023-12-03T11:37:11.449 INFO:teuthology.orchestra.run.smithi131.stderr: 3350K .......... .......... .......... .......... .......... 3% 16.2M 36s 2023-12-03T11:37:11.452 INFO:teuthology.orchestra.run.smithi131.stderr: 3400K .......... .......... .......... .......... .......... 3% 15.8M 36s 2023-12-03T11:37:11.455 INFO:teuthology.orchestra.run.smithi131.stderr: 3450K .......... .......... .......... .......... .......... 3% 15.4M 35s 2023-12-03T11:37:11.458 INFO:teuthology.orchestra.run.smithi131.stderr: 3500K .......... .......... .......... .......... .......... 3% 17.6M 35s 2023-12-03T11:37:11.461 INFO:teuthology.orchestra.run.smithi131.stderr: 3550K .......... .......... .......... .......... .......... 3% 16.7M 34s 2023-12-03T11:37:11.465 INFO:teuthology.orchestra.run.smithi131.stderr: 3600K .......... .......... .......... .......... .......... 3% 12.6M 34s 2023-12-03T11:37:11.467 INFO:teuthology.orchestra.run.smithi131.stderr: 3650K .......... .......... .......... .......... .......... 3% 22.8M 34s 2023-12-03T11:37:11.471 INFO:teuthology.orchestra.run.smithi131.stderr: 3700K .......... .......... .......... .......... .......... 4% 11.3M 33s 2023-12-03T11:37:11.474 INFO:teuthology.orchestra.run.smithi131.stderr: 3750K .......... .......... .......... .......... .......... 4% 15.9M 33s 2023-12-03T11:37:11.477 INFO:teuthology.orchestra.run.smithi131.stderr: 3800K .......... .......... .......... .......... .......... 4% 19.9M 32s 2023-12-03T11:37:11.481 INFO:teuthology.orchestra.run.smithi131.stderr: 3850K .......... .......... .......... .......... .......... 4% 11.1M 32s 2023-12-03T11:37:11.484 INFO:teuthology.orchestra.run.smithi131.stderr: 3900K .......... .......... .......... .......... .......... 4% 18.8M 32s 2023-12-03T11:37:11.487 INFO:teuthology.orchestra.run.smithi131.stderr: 3950K .......... .......... .......... .......... .......... 4% 17.9M 31s 2023-12-03T11:37:11.489 INFO:teuthology.orchestra.run.smithi131.stderr: 4000K .......... .......... .......... .......... .......... 4% 17.8M 31s 2023-12-03T11:37:11.492 INFO:teuthology.orchestra.run.smithi131.stderr: 4050K .......... .......... .......... .......... .......... 4% 17.7M 31s 2023-12-03T11:37:11.494 INFO:teuthology.orchestra.run.smithi131.stderr: 4100K .......... .......... .......... .......... .......... 4% 21.4M 30s 2023-12-03T11:37:11.496 INFO:teuthology.orchestra.run.smithi131.stderr: 4150K .......... .......... .......... .......... .......... 4% 28.3M 30s 2023-12-03T11:37:11.499 INFO:teuthology.orchestra.run.smithi131.stderr: 4200K .......... .......... .......... .......... .......... 4% 16.2M 30s 2023-12-03T11:37:11.501 INFO:teuthology.orchestra.run.smithi131.stderr: 4250K .......... .......... .......... .......... .......... 4% 23.7M 29s 2023-12-03T11:37:11.505 INFO:teuthology.orchestra.run.smithi131.stderr: 4300K .......... .......... .......... .......... .......... 4% 14.3M 29s 2023-12-03T11:37:11.507 INFO:teuthology.orchestra.run.smithi131.stderr: 4350K .......... .......... .......... .......... .......... 4% 19.5M 29s 2023-12-03T11:37:11.521 INFO:teuthology.orchestra.run.smithi131.stderr: 4400K .......... .......... .......... .......... .......... 4% 4.48M 29s 2023-12-03T11:37:11.521 INFO:teuthology.orchestra.run.smithi131.stderr: 4450K .......... .......... .......... .......... .......... 4% 79.8M 28s 2023-12-03T11:37:11.521 INFO:teuthology.orchestra.run.smithi131.stderr: 4500K .......... .......... .......... .......... .......... 4% 85.6M 28s 2023-12-03T11:37:11.521 INFO:teuthology.orchestra.run.smithi131.stderr: 4550K .......... .......... .......... .......... .......... 4% 119M 28s 2023-12-03T11:37:11.521 INFO:teuthology.orchestra.run.smithi131.stderr: 4600K .......... .......... .......... .......... .......... 5% 102M 27s 2023-12-03T11:37:11.522 INFO:teuthology.orchestra.run.smithi131.stderr: 4650K .......... .......... .......... .......... .......... 5% 24.9M 27s 2023-12-03T11:37:11.524 INFO:teuthology.orchestra.run.smithi131.stderr: 4700K .......... .......... .......... .......... .......... 5% 26.9M 27s 2023-12-03T11:37:11.525 INFO:teuthology.orchestra.run.smithi131.stderr: 4750K .......... .......... .......... .......... .......... 5% 29.7M 27s 2023-12-03T11:37:11.527 INFO:teuthology.orchestra.run.smithi131.stderr: 4800K .......... .......... .......... .......... .......... 5% 25.9M 26s 2023-12-03T11:37:11.531 INFO:teuthology.orchestra.run.smithi131.stderr: 4850K .......... .......... .......... .......... .......... 5% 14.5M 26s 2023-12-03T11:37:11.533 INFO:teuthology.orchestra.run.smithi131.stderr: 4900K .......... .......... .......... .......... .......... 5% 21.3M 26s 2023-12-03T11:37:11.535 INFO:teuthology.orchestra.run.smithi131.stderr: 4950K .......... .......... .......... .......... .......... 5% 23.7M 26s 2023-12-03T11:37:11.536 INFO:teuthology.orchestra.run.smithi131.stderr: 5000K .......... .......... .......... .......... .......... 5% 31.9M 25s 2023-12-03T11:37:11.539 INFO:teuthology.orchestra.run.smithi131.stderr: 5050K .......... .......... .......... .......... .......... 5% 19.0M 25s 2023-12-03T11:37:11.543 INFO:teuthology.orchestra.run.smithi131.stderr: 5100K .......... .......... .......... .......... .......... 5% 12.1M 25s 2023-12-03T11:37:11.544 INFO:teuthology.orchestra.run.smithi131.stderr: 5150K .......... .......... .......... .......... .......... 5% 42.1M 25s 2023-12-03T11:37:11.547 INFO:teuthology.orchestra.run.smithi131.stderr: 5200K .......... .......... .......... .......... .......... 5% 21.6M 25s 2023-12-03T11:37:11.551 INFO:teuthology.orchestra.run.smithi131.stderr: 5250K .......... .......... .......... .......... .......... 5% 13.1M 24s 2023-12-03T11:37:11.551 INFO:teuthology.orchestra.run.smithi131.stderr: 5300K .......... .......... .......... .......... .......... 5% 67.3M 24s 2023-12-03T11:37:11.553 INFO:teuthology.orchestra.run.smithi131.stderr: 5350K .......... .......... .......... .......... .......... 5% 23.8M 24s 2023-12-03T11:37:11.554 INFO:teuthology.orchestra.run.smithi131.stderr: 5400K .......... .......... .......... .......... .......... 5% 41.6M 24s 2023-12-03T11:37:11.557 INFO:teuthology.orchestra.run.smithi131.stderr: 5450K .......... .......... .......... .......... .......... 5% 23.1M 24s 2023-12-03T11:37:11.558 INFO:teuthology.orchestra.run.smithi131.stderr: 5500K .......... .......... .......... .......... .......... 5% 25.8M 23s 2023-12-03T11:37:11.559 INFO:teuthology.orchestra.run.smithi131.stderr: 5550K .......... .......... .......... .......... .......... 6% 39.5M 23s 2023-12-03T11:37:11.561 INFO:teuthology.orchestra.run.smithi131.stderr: 5600K .......... .......... .......... .......... .......... 6% 35.9M 23s 2023-12-03T11:37:11.563 INFO:teuthology.orchestra.run.smithi131.stderr: 5650K .......... .......... .......... .......... .......... 6% 24.9M 23s 2023-12-03T11:37:11.564 INFO:teuthology.orchestra.run.smithi131.stderr: 5700K .......... .......... .......... .......... .......... 6% 28.8M 23s 2023-12-03T11:37:11.566 INFO:teuthology.orchestra.run.smithi131.stderr: 5750K .......... .......... .......... .......... .......... 6% 37.7M 22s 2023-12-03T11:37:11.568 INFO:teuthology.orchestra.run.smithi131.stderr: 5800K .......... .......... .......... .......... .......... 6% 25.5M 22s 2023-12-03T11:37:11.569 INFO:teuthology.orchestra.run.smithi131.stderr: 5850K .......... .......... .......... .......... .......... 6% 40.8M 22s 2023-12-03T11:37:11.617 INFO:teuthology.orchestra.run.smithi131.stderr: 5900K .......... .......... .......... .......... .......... 6% 1.03M 23s 2023-12-03T11:37:11.617 INFO:teuthology.orchestra.run.smithi131.stderr: 5950K .......... .......... .......... .......... .......... 6% 56.8M 22s 2023-12-03T11:37:11.620 INFO:teuthology.orchestra.run.smithi131.stderr: 6000K .......... .......... .......... .......... .......... 6% 19.1M 22s 2023-12-03T11:37:11.621 INFO:teuthology.orchestra.run.smithi131.stderr: 6050K .......... .......... .......... .......... .......... 6% 34.5M 22s 2023-12-03T11:37:11.625 INFO:teuthology.orchestra.run.smithi131.stderr: 6100K .......... .......... .......... .......... .......... 6% 17.0M 22s 2023-12-03T11:37:11.626 INFO:teuthology.orchestra.run.smithi131.stderr: 6150K .......... .......... .......... .......... .......... 6% 29.1M 22s 2023-12-03T11:37:11.627 INFO:teuthology.orchestra.run.smithi131.stderr: 6200K .......... .......... .......... .......... .......... 6% 40.8M 22s 2023-12-03T11:37:11.629 INFO:teuthology.orchestra.run.smithi131.stderr: 6250K .......... .......... .......... .......... .......... 6% 27.3M 21s 2023-12-03T11:37:11.630 INFO:teuthology.orchestra.run.smithi131.stderr: 6300K .......... .......... .......... .......... .......... 6% 39.9M 21s 2023-12-03T11:37:11.633 INFO:teuthology.orchestra.run.smithi131.stderr: 6350K .......... .......... .......... .......... .......... 6% 14.5M 21s 2023-12-03T11:37:11.635 INFO:teuthology.orchestra.run.smithi131.stderr: 6400K .......... .......... .......... .......... .......... 6% 26.6M 21s 2023-12-03T11:37:11.637 INFO:teuthology.orchestra.run.smithi131.stderr: 6450K .......... .......... .......... .......... .......... 6% 29.1M 21s 2023-12-03T11:37:11.639 INFO:teuthology.orchestra.run.smithi131.stderr: 6500K .......... .......... .......... .......... .......... 7% 26.4M 21s 2023-12-03T11:37:11.640 INFO:teuthology.orchestra.run.smithi131.stderr: 6550K .......... .......... .......... .......... .......... 7% 51.2M 20s 2023-12-03T11:37:11.642 INFO:teuthology.orchestra.run.smithi131.stderr: 6600K .......... .......... .......... .......... .......... 7% 25.1M 20s 2023-12-03T11:37:11.643 INFO:teuthology.orchestra.run.smithi131.stderr: 6650K .......... .......... .......... .......... .......... 7% 40.0M 20s 2023-12-03T11:37:11.645 INFO:teuthology.orchestra.run.smithi131.stderr: 6700K .......... .......... .......... .......... .......... 7% 27.8M 20s 2023-12-03T11:37:11.647 INFO:teuthology.orchestra.run.smithi131.stderr: 6750K .......... .......... .......... .......... .......... 7% 47.3M 20s 2023-12-03T11:37:11.647 INFO:teuthology.orchestra.run.smithi131.stderr: 6800K .......... .......... .......... .......... .......... 7% 29.4M 20s 2023-12-03T11:37:11.649 INFO:teuthology.orchestra.run.smithi131.stderr: 6850K .......... .......... .......... .......... .......... 7% 37.4M 20s 2023-12-03T11:37:11.651 INFO:teuthology.orchestra.run.smithi131.stderr: 6900K .......... .......... .......... .......... .......... 7% 26.2M 19s 2023-12-03T11:37:11.652 INFO:teuthology.orchestra.run.smithi131.stderr: 6950K .......... .......... .......... .......... .......... 7% 26.7M 19s 2023-12-03T11:37:11.653 INFO:teuthology.orchestra.run.smithi131.stderr: 7000K .......... .......... .......... .......... .......... 7% 50.1M 19s 2023-12-03T11:37:11.655 INFO:teuthology.orchestra.run.smithi131.stderr: 7050K .......... .......... .......... .......... .......... 7% 28.0M 19s 2023-12-03T11:37:11.659 INFO:teuthology.orchestra.run.smithi131.stderr: 7100K .......... .......... .......... .......... .......... 7% 17.0M 19s 2023-12-03T11:37:11.659 INFO:teuthology.orchestra.run.smithi131.stderr: 7150K .......... .......... .......... .......... .......... 7% 74.0M 19s 2023-12-03T11:37:11.661 INFO:teuthology.orchestra.run.smithi131.stderr: 7200K .......... .......... .......... .......... .......... 7% 26.7M 19s 2023-12-03T11:37:11.662 INFO:teuthology.orchestra.run.smithi131.stderr: 7250K .......... .......... .......... .......... .......... 7% 38.2M 19s 2023-12-03T11:37:11.664 INFO:teuthology.orchestra.run.smithi131.stderr: 7300K .......... .......... .......... .......... .......... 7% 25.0M 18s 2023-12-03T11:37:11.666 INFO:teuthology.orchestra.run.smithi131.stderr: 7350K .......... .......... .......... .......... .......... 7% 23.0M 18s 2023-12-03T11:37:11.667 INFO:teuthology.orchestra.run.smithi131.stderr: 7400K .......... .......... .......... .......... .......... 8% 39.9M 18s 2023-12-03T11:37:11.668 INFO:teuthology.orchestra.run.smithi131.stderr: 7450K .......... .......... .......... .......... .......... 8% 37.9M 18s 2023-12-03T11:37:11.677 INFO:teuthology.orchestra.run.smithi131.stderr: 7500K .......... .......... .......... .......... .......... 8% 8.41M 18s 2023-12-03T11:37:11.677 INFO:teuthology.orchestra.run.smithi131.stderr: 7550K .......... .......... .......... .......... .......... 8% 233M 18s 2023-12-03T11:37:11.677 INFO:teuthology.orchestra.run.smithi131.stderr: 7600K .......... .......... .......... .......... .......... 8% 232M 18s 2023-12-03T11:37:11.677 INFO:teuthology.orchestra.run.smithi131.stderr: 7650K .......... .......... .......... .......... .......... 8% 29.7M 18s 2023-12-03T11:37:11.680 INFO:teuthology.orchestra.run.smithi131.stderr: 7700K .......... .......... .......... .......... .......... 8% 14.7M 18s 2023-12-03T11:37:11.684 INFO:teuthology.orchestra.run.smithi131.stderr: 7750K .......... .......... .......... .......... .......... 8% 12.6M 18s 2023-12-03T11:37:11.684 INFO:teuthology.orchestra.run.smithi131.stderr: 7800K .......... .......... .......... .......... .......... 8% 79.5M 17s 2023-12-03T11:37:11.696 INFO:teuthology.orchestra.run.smithi131.stderr: 7850K .......... .......... .......... .......... .......... 8% 4.33M 17s 2023-12-03T11:37:11.697 INFO:teuthology.orchestra.run.smithi131.stderr: 7900K .......... .......... .......... .......... .......... 8% 46.0M 17s 2023-12-03T11:37:11.704 INFO:teuthology.orchestra.run.smithi131.stderr: 7950K .......... .......... .......... .......... .......... 8% 9.29M 17s 2023-12-03T11:37:11.704 INFO:teuthology.orchestra.run.smithi131.stderr: 8000K .......... .......... .......... .......... .......... 8% 130M 17s 2023-12-03T11:37:11.704 INFO:teuthology.orchestra.run.smithi131.stderr: 8050K .......... .......... .......... .......... .......... 8% 117M 17s 2023-12-03T11:37:11.704 INFO:teuthology.orchestra.run.smithi131.stderr: 8100K .......... .......... .......... .......... .......... 8% 83.1M 17s 2023-12-03T11:37:11.704 INFO:teuthology.orchestra.run.smithi131.stderr: 8150K .......... .......... .......... .......... .......... 8% 71.0M 17s 2023-12-03T11:37:11.708 INFO:teuthology.orchestra.run.smithi131.stderr: 8200K .......... .......... .......... .......... .......... 8% 10.9M 17s 2023-12-03T11:37:11.712 INFO:teuthology.orchestra.run.smithi131.stderr: 8250K .......... .......... .......... .......... .......... 8% 13.0M 17s 2023-12-03T11:37:11.721 INFO:teuthology.orchestra.run.smithi131.stderr: 8300K .......... .......... .......... .......... .......... 8% 5.45M 17s 2023-12-03T11:37:11.723 INFO:teuthology.orchestra.run.smithi131.stderr: 8350K .......... .......... .......... .......... .......... 9% 28.1M 17s 2023-12-03T11:37:11.723 INFO:teuthology.orchestra.run.smithi131.stderr: 8400K .......... .......... .......... .......... .......... 9% 88.2M 16s 2023-12-03T11:37:11.725 INFO:teuthology.orchestra.run.smithi131.stderr: 8450K .......... .......... .......... .......... .......... 9% 33.6M 16s 2023-12-03T11:37:11.726 INFO:teuthology.orchestra.run.smithi131.stderr: 8500K .......... .......... .......... .......... .......... 9% 35.3M 16s 2023-12-03T11:37:11.727 INFO:teuthology.orchestra.run.smithi131.stderr: 8550K .......... .......... .......... .......... .......... 9% 44.1M 16s 2023-12-03T11:37:11.729 INFO:teuthology.orchestra.run.smithi131.stderr: 8600K .......... .......... .......... .......... .......... 9% 24.6M 16s 2023-12-03T11:37:11.731 INFO:teuthology.orchestra.run.smithi131.stderr: 8650K .......... .......... .......... .......... .......... 9% 32.5M 16s 2023-12-03T11:37:11.734 INFO:teuthology.orchestra.run.smithi131.stderr: 8700K .......... .......... .......... .......... .......... 9% 16.6M 16s 2023-12-03T11:37:11.737 INFO:teuthology.orchestra.run.smithi131.stderr: 8750K .......... .......... .......... .......... .......... 9% 13.8M 16s 2023-12-03T11:37:11.738 INFO:teuthology.orchestra.run.smithi131.stderr: 8800K .......... .......... .......... .......... .......... 9% 44.8M 16s 2023-12-03T11:37:11.740 INFO:teuthology.orchestra.run.smithi131.stderr: 8850K .......... .......... .......... .......... .......... 9% 27.8M 16s 2023-12-03T11:37:11.742 INFO:teuthology.orchestra.run.smithi131.stderr: 8900K .......... .......... .......... .......... .......... 9% 27.9M 16s 2023-12-03T11:37:11.743 INFO:teuthology.orchestra.run.smithi131.stderr: 8950K .......... .......... .......... .......... .......... 9% 32.7M 16s 2023-12-03T11:37:11.748 INFO:teuthology.orchestra.run.smithi131.stderr: 9000K .......... .......... .......... .......... .......... 9% 10.6M 15s 2023-12-03T11:37:11.750 INFO:teuthology.orchestra.run.smithi131.stderr: 9050K .......... .......... .......... .......... .......... 9% 21.2M 15s 2023-12-03T11:37:11.754 INFO:teuthology.orchestra.run.smithi131.stderr: 9100K .......... .......... .......... .......... .......... 9% 12.4M 15s 2023-12-03T11:37:11.756 INFO:teuthology.orchestra.run.smithi131.stderr: 9150K .......... .......... .......... .......... .......... 9% 25.4M 15s 2023-12-03T11:37:11.757 INFO:teuthology.orchestra.run.smithi131.stderr: 9200K .......... .......... .......... .......... .......... 9% 56.8M 15s 2023-12-03T11:37:11.759 INFO:teuthology.orchestra.run.smithi131.stderr: 9250K .......... .......... .......... .......... .......... 10% 21.3M 15s 2023-12-03T11:37:11.761 INFO:teuthology.orchestra.run.smithi131.stderr: 9300K .......... .......... .......... .......... .......... 10% 26.5M 15s 2023-12-03T11:37:11.763 INFO:teuthology.orchestra.run.smithi131.stderr: 9350K .......... .......... .......... .......... .......... 10% 21.6M 15s 2023-12-03T11:37:11.766 INFO:teuthology.orchestra.run.smithi131.stderr: 9400K .......... .......... .......... .......... .......... 10% 23.5M 15s 2023-12-03T11:37:11.766 INFO:teuthology.orchestra.run.smithi131.stderr: 9450K .......... .......... .......... .......... .......... 10% 129M 15s 2023-12-03T11:37:11.768 INFO:teuthology.orchestra.run.smithi131.stderr: 9500K .......... .......... .......... .......... .......... 10% 21.0M 15s 2023-12-03T11:37:11.770 INFO:teuthology.orchestra.run.smithi131.stderr: 9550K .......... .......... .......... .......... .......... 10% 24.1M 15s 2023-12-03T11:37:11.773 INFO:teuthology.orchestra.run.smithi131.stderr: 9600K .......... .......... .......... .......... .......... 10% 22.1M 15s 2023-12-03T11:37:11.773 INFO:teuthology.orchestra.run.smithi131.stderr: 9650K .......... .......... .......... .......... .......... 10% 103M 15s 2023-12-03T11:37:11.775 INFO:teuthology.orchestra.run.smithi131.stderr: 9700K .......... .......... .......... .......... .......... 10% 24.3M 14s 2023-12-03T11:37:11.777 INFO:teuthology.orchestra.run.smithi131.stderr: 9750K .......... .......... .......... .......... .......... 10% 22.7M 14s 2023-12-03T11:37:11.825 INFO:teuthology.orchestra.run.smithi131.stderr: 9800K .......... .......... .......... .......... .......... 10% 1.03M 15s 2023-12-03T11:37:11.826 INFO:teuthology.orchestra.run.smithi131.stderr: 9850K .......... .......... .......... .......... .......... 10% 22.3M 15s 2023-12-03T11:37:11.827 INFO:teuthology.orchestra.run.smithi131.stderr: 9900K .......... .......... .......... .......... .......... 10% 61.9M 15s 2023-12-03T11:37:11.829 INFO:teuthology.orchestra.run.smithi131.stderr: 9950K .......... .......... .......... .......... .......... 10% 22.5M 15s 2023-12-03T11:37:11.832 INFO:teuthology.orchestra.run.smithi131.stderr: 10000K .......... .......... .......... .......... .......... 10% 19.1M 14s 2023-12-03T11:37:11.834 INFO:teuthology.orchestra.run.smithi131.stderr: 10050K .......... .......... .......... .......... .......... 10% 32.8M 14s 2023-12-03T11:37:11.836 INFO:teuthology.orchestra.run.smithi131.stderr: 10100K .......... .......... .......... .......... .......... 10% 25.1M 14s 2023-12-03T11:37:11.836 INFO:teuthology.orchestra.run.smithi131.stderr: 10150K .......... .......... .......... .......... .......... 10% 65.1M 14s 2023-12-03T11:37:11.839 INFO:teuthology.orchestra.run.smithi131.stderr: 10200K .......... .......... .......... .......... .......... 11% 21.6M 14s 2023-12-03T11:37:11.842 INFO:teuthology.orchestra.run.smithi131.stderr: 10250K .......... .......... .......... .......... .......... 11% 14.3M 14s 2023-12-03T11:37:11.845 INFO:teuthology.orchestra.run.smithi131.stderr: 10300K .......... .......... .......... .......... .......... 11% 21.5M 14s 2023-12-03T11:37:11.845 INFO:teuthology.orchestra.run.smithi131.stderr: 10350K .......... .......... .......... .......... .......... 11% 123M 14s 2023-12-03T11:37:11.847 INFO:teuthology.orchestra.run.smithi131.stderr: 10400K .......... .......... .......... .......... .......... 11% 24.5M 14s 2023-12-03T11:37:11.849 INFO:teuthology.orchestra.run.smithi131.stderr: 10450K .......... .......... .......... .......... .......... 11% 26.0M 14s 2023-12-03T11:37:11.851 INFO:teuthology.orchestra.run.smithi131.stderr: 10500K .......... .......... .......... .......... .......... 11% 21.9M 14s 2023-12-03T11:37:11.853 INFO:teuthology.orchestra.run.smithi131.stderr: 10550K .......... .......... .......... .......... .......... 11% 29.1M 14s 2023-12-03T11:37:11.853 INFO:teuthology.orchestra.run.smithi131.stderr: 10600K .......... .......... .......... .......... .......... 11% 111M 14s 2023-12-03T11:37:11.855 INFO:teuthology.orchestra.run.smithi131.stderr: 10650K .......... .......... .......... .......... .......... 11% 28.3M 14s 2023-12-03T11:37:11.859 INFO:teuthology.orchestra.run.smithi131.stderr: 10700K .......... .......... .......... .......... .......... 11% 12.6M 14s 2023-12-03T11:37:11.859 INFO:teuthology.orchestra.run.smithi131.stderr: 10750K .......... .......... .......... .......... .......... 11% 105M 14s 2023-12-03T11:37:11.861 INFO:teuthology.orchestra.run.smithi131.stderr: 10800K .......... .......... .......... .......... .......... 11% 31.0M 13s 2023-12-03T11:37:11.863 INFO:teuthology.orchestra.run.smithi131.stderr: 10850K .......... .......... .......... .......... .......... 11% 29.2M 13s 2023-12-03T11:37:11.863 INFO:teuthology.orchestra.run.smithi131.stderr: 10900K .......... .......... .......... .......... .......... 11% 112M 13s 2023-12-03T11:37:11.872 INFO:teuthology.orchestra.run.smithi131.stderr: 10950K .......... .......... .......... .......... .......... 11% 7.62M 13s 2023-12-03T11:37:11.872 INFO:teuthology.orchestra.run.smithi131.stderr: 11000K .......... .......... .......... .......... .......... 11% 64.2M 13s 2023-12-03T11:37:11.872 INFO:teuthology.orchestra.run.smithi131.stderr: 11050K .......... .......... .......... .......... .......... 11% 98.2M 13s 2023-12-03T11:37:11.872 INFO:teuthology.orchestra.run.smithi131.stderr: 11100K .......... .......... .......... .......... .......... 12% 108M 13s 2023-12-03T11:37:11.872 INFO:teuthology.orchestra.run.smithi131.stderr: 11150K .......... .......... .......... .......... .......... 12% 108M 13s 2023-12-03T11:37:11.873 INFO:teuthology.orchestra.run.smithi131.stderr: 11200K .......... .......... .......... .......... .......... 12% 36.3M 13s 2023-12-03T11:37:11.875 INFO:teuthology.orchestra.run.smithi131.stderr: 11250K .......... .......... .......... .......... .......... 12% 21.6M 13s 2023-12-03T11:37:11.878 INFO:teuthology.orchestra.run.smithi131.stderr: 11300K .......... .......... .......... .......... .......... 12% 19.2M 13s 2023-12-03T11:37:11.885 INFO:teuthology.orchestra.run.smithi131.stderr: 11350K .......... .......... .......... .......... .......... 12% 7.61M 13s 2023-12-03T11:37:11.885 INFO:teuthology.orchestra.run.smithi131.stderr: 11400K .......... .......... .......... .......... .......... 12% 114M 13s 2023-12-03T11:37:11.886 INFO:teuthology.orchestra.run.smithi131.stderr: 11450K .......... .......... .......... .......... .......... 12% 52.3M 13s 2023-12-03T11:37:11.887 INFO:teuthology.orchestra.run.smithi131.stderr: 11500K .......... .......... .......... .......... .......... 12% 46.5M 13s 2023-12-03T11:37:11.890 INFO:teuthology.orchestra.run.smithi131.stderr: 11550K .......... .......... .......... .......... .......... 12% 117M 13s 2023-12-03T11:37:11.892 INFO:teuthology.orchestra.run.smithi131.stderr: 11600K .......... .......... .......... .......... .......... 12% 8.59M 13s 2023-12-03T11:37:11.895 INFO:teuthology.orchestra.run.smithi131.stderr: 11650K .......... .......... .......... .......... .......... 12% 18.8M 13s 2023-12-03T11:37:11.907 INFO:teuthology.orchestra.run.smithi131.stderr: 11700K .......... .......... .......... .......... .......... 12% 4.03M 13s 2023-12-03T11:37:11.909 INFO:teuthology.orchestra.run.smithi131.stderr: 11750K .......... .......... .......... .......... .......... 12% 36.5M 13s 2023-12-03T11:37:11.909 INFO:teuthology.orchestra.run.smithi131.stderr: 11800K .......... .......... .......... .......... .......... 12% 105M 13s 2023-12-03T11:37:11.917 INFO:teuthology.orchestra.run.smithi131.stderr: 11850K .......... .......... .......... .......... .......... 12% 7.89M 13s 2023-12-03T11:37:11.917 INFO:teuthology.orchestra.run.smithi131.stderr: 11900K .......... .......... .......... .......... .......... 12% 92.0M 12s 2023-12-03T11:37:11.917 INFO:teuthology.orchestra.run.smithi131.stderr: 11950K .......... .......... .......... .......... .......... 12% 76.4M 12s 2023-12-03T11:37:11.920 INFO:teuthology.orchestra.run.smithi131.stderr: 12000K .......... .......... .......... .......... .......... 12% 16.7M 12s 2023-12-03T11:37:11.920 INFO:teuthology.orchestra.run.smithi131.stderr: 12050K .......... .......... .......... .......... .......... 13% 115M 12s 2023-12-03T11:37:11.923 INFO:teuthology.orchestra.run.smithi131.stderr: 12100K .......... .......... .......... .......... .......... 13% 13.8M 12s 2023-12-03T11:37:11.925 INFO:teuthology.orchestra.run.smithi131.stderr: 12150K .......... .......... .......... .......... .......... 13% 19.4M 12s 2023-12-03T11:37:11.936 INFO:teuthology.orchestra.run.smithi131.stderr: 12200K .......... .......... .......... .......... .......... 13% 4.69M 12s 2023-12-03T11:37:11.936 INFO:teuthology.orchestra.run.smithi131.stderr: 12250K .......... .......... .......... .......... .......... 13% 129M 12s 2023-12-03T11:37:11.939 INFO:teuthology.orchestra.run.smithi131.stderr: 12300K .......... .......... .......... .......... .......... 13% 23.2M 12s 2023-12-03T11:37:11.939 INFO:teuthology.orchestra.run.smithi131.stderr: 12350K .......... .......... .......... .......... .......... 13% 61.4M 12s 2023-12-03T11:37:11.941 INFO:teuthology.orchestra.run.smithi131.stderr: 12400K .......... .......... .......... .......... .......... 13% 26.9M 12s 2023-12-03T11:37:11.943 INFO:teuthology.orchestra.run.smithi131.stderr: 12450K .......... .......... .......... .......... .......... 13% 20.7M 12s 2023-12-03T11:37:11.944 INFO:teuthology.orchestra.run.smithi131.stderr: 12500K .......... .......... .......... .......... .......... 13% 71.7M 12s 2023-12-03T11:37:11.946 INFO:teuthology.orchestra.run.smithi131.stderr: 12550K .......... .......... .......... .......... .......... 13% 28.3M 12s 2023-12-03T11:37:11.949 INFO:teuthology.orchestra.run.smithi131.stderr: 12600K .......... .......... .......... .......... .......... 13% 15.5M 12s 2023-12-03T11:37:11.952 INFO:teuthology.orchestra.run.smithi131.stderr: 12650K .......... .......... .......... .......... .......... 13% 14.1M 12s 2023-12-03T11:37:11.958 INFO:teuthology.orchestra.run.smithi131.stderr: 12700K .......... .......... .......... .......... .......... 13% 60.2M 12s 2023-12-03T11:37:11.958 INFO:teuthology.orchestra.run.smithi131.stderr: 12750K .......... .......... .......... .......... .......... 13% 17.9M 12s 2023-12-03T11:37:11.959 INFO:teuthology.orchestra.run.smithi131.stderr: 12800K .......... .......... .......... .......... .......... 13% 16.6M 12s 2023-12-03T11:37:11.961 INFO:teuthology.orchestra.run.smithi131.stderr: 12850K .......... .......... .......... .......... .......... 13% 25.6M 12s 2023-12-03T11:37:11.966 INFO:teuthology.orchestra.run.smithi131.stderr: 12900K .......... .......... .......... .......... .......... 13% 10.1M 12s 2023-12-03T11:37:11.970 INFO:teuthology.orchestra.run.smithi131.stderr: 12950K .......... .......... .......... .......... .......... 13% 95.3M 12s 2023-12-03T11:37:11.970 INFO:teuthology.orchestra.run.smithi131.stderr: 13000K .......... .......... .......... .......... .......... 14% 12.2M 12s 2023-12-03T11:37:11.972 INFO:teuthology.orchestra.run.smithi131.stderr: 13050K .......... .......... .......... .......... .......... 14% 24.7M 12s 2023-12-03T11:37:11.975 INFO:teuthology.orchestra.run.smithi131.stderr: 13100K .......... .......... .......... .......... .......... 14% 22.1M 12s 2023-12-03T11:37:11.977 INFO:teuthology.orchestra.run.smithi131.stderr: 13150K .......... .......... .......... .......... .......... 14% 22.2M 11s 2023-12-03T11:37:11.978 INFO:teuthology.orchestra.run.smithi131.stderr: 13200K .......... .......... .......... .......... .......... 14% 40.2M 11s 2023-12-03T11:37:11.979 INFO:teuthology.orchestra.run.smithi131.stderr: 13250K .......... .......... .......... .......... .......... 14% 30.4M 11s 2023-12-03T11:37:11.981 INFO:teuthology.orchestra.run.smithi131.stderr: 13300K .......... .......... .......... .......... .......... 14% 22.8M 11s 2023-12-03T11:37:11.984 INFO:teuthology.orchestra.run.smithi131.stderr: 13350K .......... .......... .......... .......... .......... 14% 21.9M 11s 2023-12-03T11:37:11.985 INFO:teuthology.orchestra.run.smithi131.stderr: 13400K .......... .......... .......... .......... .......... 14% 60.4M 11s 2023-12-03T11:37:11.987 INFO:teuthology.orchestra.run.smithi131.stderr: 13450K .......... .......... .......... .......... .......... 14% 20.4M 11s 2023-12-03T11:37:11.989 INFO:teuthology.orchestra.run.smithi131.stderr: 13500K .......... .......... .......... .......... .......... 14% 23.6M 11s 2023-12-03T11:37:11.991 INFO:teuthology.orchestra.run.smithi131.stderr: 13550K .......... .......... .......... .......... .......... 14% 25.6M 11s 2023-12-03T11:37:11.994 INFO:teuthology.orchestra.run.smithi131.stderr: 13600K .......... .......... .......... .......... .......... 14% 18.9M 11s 2023-12-03T11:37:11.994 INFO:teuthology.orchestra.run.smithi131.stderr: 13650K .......... .......... .......... .......... .......... 14% 120M 11s 2023-12-03T11:37:12.042 INFO:teuthology.orchestra.run.smithi131.stderr: 13700K .......... .......... .......... .......... .......... 14% 1.02M 11s 2023-12-03T11:37:12.043 INFO:teuthology.orchestra.run.smithi131.stderr: 13750K .......... .......... .......... .......... .......... 14% 73.1M 11s 2023-12-03T11:37:12.045 INFO:teuthology.orchestra.run.smithi131.stderr: 13800K .......... .......... .......... .......... .......... 14% 24.4M 11s 2023-12-03T11:37:12.047 INFO:teuthology.orchestra.run.smithi131.stderr: 13850K .......... .......... .......... .......... .......... 14% 25.0M 11s 2023-12-03T11:37:12.048 INFO:teuthology.orchestra.run.smithi131.stderr: 13900K .......... .......... .......... .......... .......... 15% 32.1M 11s 2023-12-03T11:37:12.050 INFO:teuthology.orchestra.run.smithi131.stderr: 13950K .......... .......... .......... .......... .......... 15% 24.0M 11s 2023-12-03T11:37:12.052 INFO:teuthology.orchestra.run.smithi131.stderr: 14000K .......... .......... .......... .......... .......... 15% 32.3M 11s 2023-12-03T11:37:12.054 INFO:teuthology.orchestra.run.smithi131.stderr: 14050K .......... .......... .......... .......... .......... 15% 26.4M 11s 2023-12-03T11:37:12.057 INFO:teuthology.orchestra.run.smithi131.stderr: 14100K .......... .......... .......... .......... .......... 15% 15.7M 11s 2023-12-03T11:37:12.058 INFO:teuthology.orchestra.run.smithi131.stderr: 14150K .......... .......... .......... .......... .......... 15% 36.5M 11s 2023-12-03T11:37:12.061 INFO:teuthology.orchestra.run.smithi131.stderr: 14200K .......... .......... .......... .......... .......... 15% 15.7M 11s 2023-12-03T11:37:12.063 INFO:teuthology.orchestra.run.smithi131.stderr: 14250K .......... .......... .......... .......... .......... 15% 30.9M 11s 2023-12-03T11:37:12.065 INFO:teuthology.orchestra.run.smithi131.stderr: 14300K .......... .......... .......... .......... .......... 15% 31.4M 11s 2023-12-03T11:37:12.065 INFO:teuthology.orchestra.run.smithi131.stderr: 14350K .......... .......... .......... .......... .......... 15% 70.8M 11s 2023-12-03T11:37:12.067 INFO:teuthology.orchestra.run.smithi131.stderr: 14400K .......... .......... .......... .......... .......... 15% 22.5M 11s 2023-12-03T11:37:12.069 INFO:teuthology.orchestra.run.smithi131.stderr: 14450K .......... .......... .......... .......... .......... 15% 20.7M 11s 2023-12-03T11:37:12.071 INFO:teuthology.orchestra.run.smithi131.stderr: 14500K .......... .......... .......... .......... .......... 15% 26.2M 11s 2023-12-03T11:37:12.076 INFO:teuthology.orchestra.run.smithi131.stderr: 14550K .......... .......... .......... .......... .......... 15% 12.2M 11s 2023-12-03T11:37:12.076 INFO:teuthology.orchestra.run.smithi131.stderr: 14600K .......... .......... .......... .......... .......... 15% 75.2M 11s 2023-12-03T11:37:12.076 INFO:teuthology.orchestra.run.smithi131.stderr: 14650K .......... .......... .......... .......... .......... 15% 58.8M 11s 2023-12-03T11:37:12.078 INFO:teuthology.orchestra.run.smithi131.stderr: 14700K .......... .......... .......... .......... .......... 15% 37.9M 11s 2023-12-03T11:37:12.080 INFO:teuthology.orchestra.run.smithi131.stderr: 14750K .......... .......... .......... .......... .......... 15% 26.8M 11s 2023-12-03T11:37:12.088 INFO:teuthology.orchestra.run.smithi131.stderr: 14800K .......... .......... .......... .......... .......... 15% 7.91M 11s 2023-12-03T11:37:12.088 INFO:teuthology.orchestra.run.smithi131.stderr: 14850K .......... .......... .......... .......... .......... 16% 74.1M 11s 2023-12-03T11:37:12.088 INFO:teuthology.orchestra.run.smithi131.stderr: 14900K .......... .......... .......... .......... .......... 16% 59.5M 10s 2023-12-03T11:37:12.089 INFO:teuthology.orchestra.run.smithi131.stderr: 14950K .......... .......... .......... .......... .......... 16% 33.8M 10s 2023-12-03T11:37:12.090 INFO:teuthology.orchestra.run.smithi131.stderr: 15000K .......... .......... .......... .......... .......... 16% 38.6M 10s 2023-12-03T11:37:12.091 INFO:teuthology.orchestra.run.smithi131.stderr: 15050K .......... .......... .......... .......... .......... 16% 45.1M 10s 2023-12-03T11:37:12.092 INFO:teuthology.orchestra.run.smithi131.stderr: 15100K .......... .......... .......... .......... .......... 16% 33.8M 10s 2023-12-03T11:37:12.093 INFO:teuthology.orchestra.run.smithi131.stderr: 15150K .......... .......... .......... .......... .......... 16% 63.5M 10s 2023-12-03T11:37:12.096 INFO:teuthology.orchestra.run.smithi131.stderr: 15200K .......... .......... .......... .......... .......... 16% 22.5M 10s 2023-12-03T11:37:12.102 INFO:teuthology.orchestra.run.smithi131.stderr: 15250K .......... .......... .......... .......... .......... 16% 7.20M 10s 2023-12-03T11:37:12.103 INFO:teuthology.orchestra.run.smithi131.stderr: 15300K .......... .......... .......... .......... .......... 16% 44.2M 10s 2023-12-03T11:37:12.105 INFO:teuthology.orchestra.run.smithi131.stderr: 15350K .......... .......... .......... .......... .......... 16% 31.6M 10s 2023-12-03T11:37:12.106 INFO:teuthology.orchestra.run.smithi131.stderr: 15400K .......... .......... .......... .......... .......... 16% 61.5M 10s 2023-12-03T11:37:12.108 INFO:teuthology.orchestra.run.smithi131.stderr: 15450K .......... .......... .......... .......... .......... 16% 18.3M 10s 2023-12-03T11:37:12.111 INFO:teuthology.orchestra.run.smithi131.stderr: 15500K .......... .......... .......... .......... .......... 16% 17.7M 10s 2023-12-03T11:37:12.114 INFO:teuthology.orchestra.run.smithi131.stderr: 15550K .......... .......... .......... .......... .......... 16% 15.8M 10s 2023-12-03T11:37:12.127 INFO:teuthology.orchestra.run.smithi131.stderr: 15600K .......... .......... .......... .......... .......... 16% 3.75M 10s 2023-12-03T11:37:12.129 INFO:teuthology.orchestra.run.smithi131.stderr: 15650K .......... .......... .......... .......... .......... 16% 30.0M 10s 2023-12-03T11:37:12.135 INFO:teuthology.orchestra.run.smithi131.stderr: 15700K .......... .......... .......... .......... .......... 16% 8.48M 10s 2023-12-03T11:37:12.136 INFO:teuthology.orchestra.run.smithi131.stderr: 15750K .......... .......... .......... .......... .......... 17% 47.2M 10s 2023-12-03T11:37:12.136 INFO:teuthology.orchestra.run.smithi131.stderr: 15800K .......... .......... .......... .......... .......... 17% 82.0M 10s 2023-12-03T11:37:12.138 INFO:teuthology.orchestra.run.smithi131.stderr: 15850K .......... .......... .......... .......... .......... 17% 32.4M 10s 2023-12-03T11:37:12.140 INFO:teuthology.orchestra.run.smithi131.stderr: 15900K .......... .......... .......... .......... .......... 17% 22.1M 10s 2023-12-03T11:37:12.142 INFO:teuthology.orchestra.run.smithi131.stderr: 15950K .......... .......... .......... .......... .......... 17% 20.9M 10s 2023-12-03T11:37:12.144 INFO:teuthology.orchestra.run.smithi131.stderr: 16000K .......... .......... .......... .......... .......... 17% 31.7M 10s 2023-12-03T11:37:12.157 INFO:teuthology.orchestra.run.smithi131.stderr: 16050K .......... .......... .......... .......... .......... 17% 4.00M 10s 2023-12-03T11:37:12.159 INFO:teuthology.orchestra.run.smithi131.stderr: 16100K .......... .......... .......... .......... .......... 17% 22.8M 10s 2023-12-03T11:37:12.161 INFO:teuthology.orchestra.run.smithi131.stderr: 16150K .......... .......... .......... .......... .......... 17% 23.0M 10s 2023-12-03T11:37:12.161 INFO:teuthology.orchestra.run.smithi131.stderr: 16200K .......... .......... .......... .......... .......... 17% 81.6M 10s 2023-12-03T11:37:12.162 INFO:teuthology.orchestra.run.smithi131.stderr: 16250K .......... .......... .......... .......... .......... 17% 30.8M 10s 2023-12-03T11:37:12.163 INFO:teuthology.orchestra.run.smithi131.stderr: 16300K .......... .......... .......... .......... .......... 17% 43.8M 10s 2023-12-03T11:37:12.166 INFO:teuthology.orchestra.run.smithi131.stderr: 16350K .......... .......... .......... .......... .......... 17% 20.9M 10s 2023-12-03T11:37:12.168 INFO:teuthology.orchestra.run.smithi131.stderr: 16400K .......... .......... .......... .......... .......... 17% 28.4M 10s 2023-12-03T11:37:12.171 INFO:teuthology.orchestra.run.smithi131.stderr: 16450K .......... .......... .......... .......... .......... 17% 14.4M 10s 2023-12-03T11:37:12.173 INFO:teuthology.orchestra.run.smithi131.stderr: 16500K .......... .......... .......... .......... .......... 17% 28.8M 10s 2023-12-03T11:37:12.176 INFO:teuthology.orchestra.run.smithi131.stderr: 16550K .......... .......... .......... .......... .......... 17% 16.6M 10s 2023-12-03T11:37:12.178 INFO:teuthology.orchestra.run.smithi131.stderr: 16600K .......... .......... .......... .......... .......... 17% 21.2M 10s 2023-12-03T11:37:12.180 INFO:teuthology.orchestra.run.smithi131.stderr: 16650K .......... .......... .......... .......... .......... 17% 22.4M 10s 2023-12-03T11:37:12.182 INFO:teuthology.orchestra.run.smithi131.stderr: 16700K .......... .......... .......... .......... .......... 18% 27.3M 10s 2023-12-03T11:37:12.186 INFO:teuthology.orchestra.run.smithi131.stderr: 16750K .......... .......... .......... .......... .......... 18% 11.5M 10s 2023-12-03T11:37:12.189 INFO:teuthology.orchestra.run.smithi131.stderr: 16800K .......... .......... .......... .......... .......... 18% 16.2M 10s 2023-12-03T11:37:12.194 INFO:teuthology.orchestra.run.smithi131.stderr: 16850K .......... .......... .......... .......... .......... 18% 12.3M 10s 2023-12-03T11:37:12.196 INFO:teuthology.orchestra.run.smithi131.stderr: 16900K .......... .......... .......... .......... .......... 18% 22.5M 9s 2023-12-03T11:37:12.196 INFO:teuthology.orchestra.run.smithi131.stderr: 16950K .......... .......... .......... .......... .......... 18% 84.5M 9s 2023-12-03T11:37:12.199 INFO:teuthology.orchestra.run.smithi131.stderr: 17000K .......... .......... .......... .......... .......... 18% 19.4M 9s 2023-12-03T11:37:12.201 INFO:teuthology.orchestra.run.smithi131.stderr: 17050K .......... .......... .......... .......... .......... 18% 17.0M 9s 2023-12-03T11:37:12.203 INFO:teuthology.orchestra.run.smithi131.stderr: 17100K .......... .......... .......... .......... .......... 18% 37.5M 9s 2023-12-03T11:37:12.205 INFO:teuthology.orchestra.run.smithi131.stderr: 17150K .......... .......... .......... .......... .......... 18% 23.5M 9s 2023-12-03T11:37:12.205 INFO:teuthology.orchestra.run.smithi131.stderr: 17200K .......... .......... .......... .......... .......... 18% 52.0M 9s 2023-12-03T11:37:12.208 INFO:teuthology.orchestra.run.smithi131.stderr: 17250K .......... .......... .......... .......... .......... 18% 20.5M 9s 2023-12-03T11:37:12.209 INFO:teuthology.orchestra.run.smithi131.stderr: 17300K .......... .......... .......... .......... .......... 18% 32.0M 9s 2023-12-03T11:37:12.212 INFO:teuthology.orchestra.run.smithi131.stderr: 17350K .......... .......... .......... .......... .......... 18% 22.0M 9s 2023-12-03T11:37:12.213 INFO:teuthology.orchestra.run.smithi131.stderr: 17400K .......... .......... .......... .......... .......... 18% 65.7M 9s 2023-12-03T11:37:12.214 INFO:teuthology.orchestra.run.smithi131.stderr: 17450K .......... .......... .......... .......... .......... 18% 26.9M 9s 2023-12-03T11:37:12.217 INFO:teuthology.orchestra.run.smithi131.stderr: 17500K .......... .......... .......... .......... .......... 18% 20.4M 9s 2023-12-03T11:37:12.220 INFO:teuthology.orchestra.run.smithi131.stderr: 17550K .......... .......... .......... .......... .......... 18% 16.8M 9s 2023-12-03T11:37:12.264 INFO:teuthology.orchestra.run.smithi131.stderr: 17600K .......... .......... .......... .......... .......... 18% 1.11M 9s 2023-12-03T11:37:12.265 INFO:teuthology.orchestra.run.smithi131.stderr: 17650K .......... .......... .......... .......... .......... 19% 34.7M 9s 2023-12-03T11:37:12.267 INFO:teuthology.orchestra.run.smithi131.stderr: 17700K .......... .......... .......... .......... .......... 19% 33.7M 9s 2023-12-03T11:37:12.269 INFO:teuthology.orchestra.run.smithi131.stderr: 17750K .......... .......... .......... .......... .......... 19% 22.9M 9s 2023-12-03T11:37:12.272 INFO:teuthology.orchestra.run.smithi131.stderr: 17800K .......... .......... .......... .......... .......... 19% 15.5M 9s 2023-12-03T11:37:12.272 INFO:teuthology.orchestra.run.smithi131.stderr: 17850K .......... .......... .......... .......... .......... 19% 73.5M 9s 2023-12-03T11:37:12.274 INFO:teuthology.orchestra.run.smithi131.stderr: 17900K .......... .......... .......... .......... .......... 19% 37.8M 9s 2023-12-03T11:37:12.276 INFO:teuthology.orchestra.run.smithi131.stderr: 17950K .......... .......... .......... .......... .......... 19% 22.1M 9s 2023-12-03T11:37:12.280 INFO:teuthology.orchestra.run.smithi131.stderr: 18000K .......... .......... .......... .......... .......... 19% 18.4M 9s 2023-12-03T11:37:12.282 INFO:teuthology.orchestra.run.smithi131.stderr: 18050K .......... .......... .......... .......... .......... 19% 12.6M 9s 2023-12-03T11:37:12.283 INFO:teuthology.orchestra.run.smithi131.stderr: 18100K .......... .......... .......... .......... .......... 19% 48.2M 9s 2023-12-03T11:37:12.285 INFO:teuthology.orchestra.run.smithi131.stderr: 18150K .......... .......... .......... .......... .......... 19% 26.3M 9s 2023-12-03T11:37:12.287 INFO:teuthology.orchestra.run.smithi131.stderr: 18200K .......... .......... .......... .......... .......... 19% 39.0M 9s 2023-12-03T11:37:12.289 INFO:teuthology.orchestra.run.smithi131.stderr: 18250K .......... .......... .......... .......... .......... 19% 23.9M 9s 2023-12-03T11:37:12.289 INFO:teuthology.orchestra.run.smithi131.stderr: 18300K .......... .......... .......... .......... .......... 19% 95.3M 9s 2023-12-03T11:37:12.292 INFO:teuthology.orchestra.run.smithi131.stderr: 18350K .......... .......... .......... .......... .......... 19% 16.0M 9s 2023-12-03T11:37:12.293 INFO:teuthology.orchestra.run.smithi131.stderr: 18400K .......... .......... .......... .......... .......... 19% 40.6M 9s 2023-12-03T11:37:12.297 INFO:teuthology.orchestra.run.smithi131.stderr: 18450K .......... .......... .......... .......... .......... 19% 13.7M 9s 2023-12-03T11:37:12.298 INFO:teuthology.orchestra.run.smithi131.stderr: 18500K .......... .......... .......... .......... .......... 19% 39.8M 9s 2023-12-03T11:37:12.299 INFO:teuthology.orchestra.run.smithi131.stderr: 18550K .......... .......... .......... .......... .......... 20% 47.8M 9s 2023-12-03T11:37:12.300 INFO:teuthology.orchestra.run.smithi131.stderr: 18600K .......... .......... .......... .......... .......... 20% 43.2M 9s 2023-12-03T11:37:12.302 INFO:teuthology.orchestra.run.smithi131.stderr: 18650K .......... .......... .......... .......... .......... 20% 41.3M 9s 2023-12-03T11:37:12.308 INFO:teuthology.orchestra.run.smithi131.stderr: 18700K .......... .......... .......... .......... .......... 20% 7.59M 9s 2023-12-03T11:37:12.310 INFO:teuthology.orchestra.run.smithi131.stderr: 18750K .......... .......... .......... .......... .......... 20% 46.1M 9s 2023-12-03T11:37:12.310 INFO:teuthology.orchestra.run.smithi131.stderr: 18800K .......... .......... .......... .......... .......... 20% 65.4M 9s 2023-12-03T11:37:12.311 INFO:teuthology.orchestra.run.smithi131.stderr: 18850K .......... .......... .......... .......... .......... 20% 35.6M 9s 2023-12-03T11:37:12.312 INFO:teuthology.orchestra.run.smithi131.stderr: 18900K .......... .......... .......... .......... .......... 20% 39.2M 9s 2023-12-03T11:37:12.313 INFO:teuthology.orchestra.run.smithi131.stderr: 18950K .......... .......... .......... .......... .......... 20% 44.6M 9s 2023-12-03T11:37:12.314 INFO:teuthology.orchestra.run.smithi131.stderr: 19000K .......... .......... .......... .......... .......... 20% 54.7M 9s 2023-12-03T11:37:12.316 INFO:teuthology.orchestra.run.smithi131.stderr: 19050K .......... .......... .......... .......... .......... 20% 32.0M 9s 2023-12-03T11:37:12.318 INFO:teuthology.orchestra.run.smithi131.stderr: 19100K .......... .......... .......... .......... .......... 20% 23.2M 9s 2023-12-03T11:37:12.325 INFO:teuthology.orchestra.run.smithi131.stderr: 19150K .......... .......... .......... .......... .......... 20% 6.89M 9s 2023-12-03T11:37:12.326 INFO:teuthology.orchestra.run.smithi131.stderr: 19200K .......... .......... .......... .......... .......... 20% 37.7M 9s 2023-12-03T11:37:12.327 INFO:teuthology.orchestra.run.smithi131.stderr: 19250K .......... .......... .......... .......... .......... 20% 53.0M 9s 2023-12-03T11:37:12.329 INFO:teuthology.orchestra.run.smithi131.stderr: 19300K .......... .......... .......... .......... .......... 20% 26.0M 9s 2023-12-03T11:37:12.334 INFO:teuthology.orchestra.run.smithi131.stderr: 19350K .......... .......... .......... .......... .......... 20% 9.91M 9s 2023-12-03T11:37:12.336 INFO:teuthology.orchestra.run.smithi131.stderr: 19400K .......... .......... .......... .......... .......... 20% 22.6M 9s 2023-12-03T11:37:12.351 INFO:teuthology.orchestra.run.smithi131.stderr: 19450K .......... .......... .......... .......... .......... 20% 27.7M 9s 2023-12-03T11:37:12.352 INFO:teuthology.orchestra.run.smithi131.stderr: 19500K .......... .......... .......... .......... .......... 21% 3.48M 9s 2023-12-03T11:37:12.354 INFO:teuthology.orchestra.run.smithi131.stderr: 19550K .......... .......... .......... .......... .......... 21% 24.1M 9s 2023-12-03T11:37:12.361 INFO:teuthology.orchestra.run.smithi131.stderr: 19600K .......... .......... .......... .......... .......... 21% 6.88M 9s 2023-12-03T11:37:12.363 INFO:teuthology.orchestra.run.smithi131.stderr: 19650K .......... .......... .......... .......... .......... 21% 44.2M 8s 2023-12-03T11:37:12.364 INFO:teuthology.orchestra.run.smithi131.stderr: 19700K .......... .......... .......... .......... .......... 21% 36.2M 8s 2023-12-03T11:37:12.364 INFO:teuthology.orchestra.run.smithi131.stderr: 19750K .......... .......... .......... .......... .......... 21% 53.6M 8s 2023-12-03T11:37:12.367 INFO:teuthology.orchestra.run.smithi131.stderr: 19800K .......... .......... .......... .......... .......... 21% 20.2M 8s 2023-12-03T11:37:12.369 INFO:teuthology.orchestra.run.smithi131.stderr: 19850K .......... .......... .......... .......... .......... 21% 22.0M 8s 2023-12-03T11:37:12.373 INFO:teuthology.orchestra.run.smithi131.stderr: 19900K .......... .......... .......... .......... .......... 21% 11.3M 8s 2023-12-03T11:37:12.384 INFO:teuthology.orchestra.run.smithi131.stderr: 19950K .......... .......... .......... .......... .......... 21% 4.80M 8s 2023-12-03T11:37:12.386 INFO:teuthology.orchestra.run.smithi131.stderr: 20000K .......... .......... .......... .......... .......... 21% 18.8M 8s 2023-12-03T11:37:12.389 INFO:teuthology.orchestra.run.smithi131.stderr: 20050K .......... .......... .......... .......... .......... 21% 19.9M 8s 2023-12-03T11:37:12.390 INFO:teuthology.orchestra.run.smithi131.stderr: 20100K .......... .......... .......... .......... .......... 21% 51.3M 8s 2023-12-03T11:37:12.392 INFO:teuthology.orchestra.run.smithi131.stderr: 20150K .......... .......... .......... .......... .......... 21% 20.3M 8s 2023-12-03T11:37:12.394 INFO:teuthology.orchestra.run.smithi131.stderr: 20200K .......... .......... .......... .......... .......... 21% 21.3M 8s 2023-12-03T11:37:12.395 INFO:teuthology.orchestra.run.smithi131.stderr: 20250K .......... .......... .......... .......... .......... 21% 45.7M 8s 2023-12-03T11:37:12.397 INFO:teuthology.orchestra.run.smithi131.stderr: 20300K .......... .......... .......... .......... .......... 21% 28.6M 8s 2023-12-03T11:37:12.401 INFO:teuthology.orchestra.run.smithi131.stderr: 20350K .......... .......... .......... .......... .......... 21% 14.6M 8s 2023-12-03T11:37:12.404 INFO:teuthology.orchestra.run.smithi131.stderr: 20400K .......... .......... .......... .......... .......... 22% 13.8M 8s 2023-12-03T11:37:12.406 INFO:teuthology.orchestra.run.smithi131.stderr: 20450K .......... .......... .......... .......... .......... 22% 28.3M 8s 2023-12-03T11:37:12.409 INFO:teuthology.orchestra.run.smithi131.stderr: 20500K .......... .......... .......... .......... .......... 22% 17.0M 8s 2023-12-03T11:37:12.410 INFO:teuthology.orchestra.run.smithi131.stderr: 20550K .......... .......... .......... .......... .......... 22% 27.5M 8s 2023-12-03T11:37:12.413 INFO:teuthology.orchestra.run.smithi131.stderr: 20600K .......... .......... .......... .......... .......... 22% 16.3M 8s 2023-12-03T11:37:12.416 INFO:teuthology.orchestra.run.smithi131.stderr: 20650K .......... .......... .......... .......... .......... 22% 15.7M 8s 2023-12-03T11:37:12.420 INFO:teuthology.orchestra.run.smithi131.stderr: 20700K .......... .......... .......... .......... .......... 22% 14.6M 8s 2023-12-03T11:37:12.424 INFO:teuthology.orchestra.run.smithi131.stderr: 20750K .......... .......... .......... .......... .......... 22% 11.5M 8s 2023-12-03T11:37:12.426 INFO:teuthology.orchestra.run.smithi131.stderr: 20800K .......... .......... .......... .......... .......... 22% 23.1M 8s 2023-12-03T11:37:12.428 INFO:teuthology.orchestra.run.smithi131.stderr: 20850K .......... .......... .......... .......... .......... 22% 23.3M 8s 2023-12-03T11:37:12.430 INFO:teuthology.orchestra.run.smithi131.stderr: 20900K .......... .......... .......... .......... .......... 22% 31.0M 8s 2023-12-03T11:37:12.431 INFO:teuthology.orchestra.run.smithi131.stderr: 20950K .......... .......... .......... .......... .......... 22% 32.8M 8s 2023-12-03T11:37:12.435 INFO:teuthology.orchestra.run.smithi131.stderr: 21000K .......... .......... .......... .......... .......... 22% 17.1M 8s 2023-12-03T11:37:12.436 INFO:teuthology.orchestra.run.smithi131.stderr: 21050K .......... .......... .......... .......... .......... 22% 25.6M 8s 2023-12-03T11:37:12.438 INFO:teuthology.orchestra.run.smithi131.stderr: 21100K .......... .......... .......... .......... .......... 22% 24.3M 8s 2023-12-03T11:37:12.439 INFO:teuthology.orchestra.run.smithi131.stderr: 21150K .......... .......... .......... .......... .......... 22% 32.7M 8s 2023-12-03T11:37:12.441 INFO:teuthology.orchestra.run.smithi131.stderr: 21200K .......... .......... .......... .......... .......... 22% 28.7M 8s 2023-12-03T11:37:12.443 INFO:teuthology.orchestra.run.smithi131.stderr: 21250K .......... .......... .......... .......... .......... 22% 22.4M 8s 2023-12-03T11:37:12.446 INFO:teuthology.orchestra.run.smithi131.stderr: 21300K .......... .......... .......... .......... .......... 22% 21.0M 8s 2023-12-03T11:37:12.446 INFO:teuthology.orchestra.run.smithi131.stderr: 21350K .......... .......... .......... .......... .......... 23% 83.4M 8s 2023-12-03T11:37:12.449 INFO:teuthology.orchestra.run.smithi131.stderr: 21400K .......... .......... .......... .......... .......... 23% 16.9M 8s 2023-12-03T11:37:12.489 INFO:teuthology.orchestra.run.smithi131.stderr: 21450K .......... .......... .......... .......... .......... 23% 1.24M 8s 2023-12-03T11:37:12.495 INFO:teuthology.orchestra.run.smithi131.stderr: 21500K .......... .......... .......... .......... .......... 23% 7.63M 8s 2023-12-03T11:37:12.498 INFO:teuthology.orchestra.run.smithi131.stderr: 21550K .......... .......... .......... .......... .......... 23% 17.7M 8s 2023-12-03T11:37:12.498 INFO:teuthology.orchestra.run.smithi131.stderr: 21600K .......... .......... .......... .......... .......... 23% 101M 8s 2023-12-03T11:37:12.501 INFO:teuthology.orchestra.run.smithi131.stderr: 21650K .......... .......... .......... .......... .......... 23% 18.3M 8s 2023-12-03T11:37:12.503 INFO:teuthology.orchestra.run.smithi131.stderr: 21700K .......... .......... .......... .......... .......... 23% 25.6M 8s 2023-12-03T11:37:12.505 INFO:teuthology.orchestra.run.smithi131.stderr: 21750K .......... .......... .......... .......... .......... 23% 27.2M 8s 2023-12-03T11:37:12.507 INFO:teuthology.orchestra.run.smithi131.stderr: 21800K .......... .......... .......... .......... .......... 23% 88.6M 8s 2023-12-03T11:37:12.507 INFO:teuthology.orchestra.run.smithi131.stderr: 21850K .......... .......... .......... .......... .......... 23% 27.4M 8s 2023-12-03T11:37:12.511 INFO:teuthology.orchestra.run.smithi131.stderr: 21900K .......... .......... .......... .......... .......... 23% 14.0M 8s 2023-12-03T11:37:12.514 INFO:teuthology.orchestra.run.smithi131.stderr: 21950K .......... .......... .......... .......... .......... 23% 22.4M 8s 2023-12-03T11:37:12.518 INFO:teuthology.orchestra.run.smithi131.stderr: 22000K .......... .......... .......... .......... .......... 23% 20.0M 8s 2023-12-03T11:37:12.518 INFO:teuthology.orchestra.run.smithi131.stderr: 22050K .......... .......... .......... .......... .......... 23% 36.7M 8s 2023-12-03T11:37:12.518 INFO:teuthology.orchestra.run.smithi131.stderr: 22100K .......... .......... .......... .......... .......... 23% 76.4M 8s 2023-12-03T11:37:12.520 INFO:teuthology.orchestra.run.smithi131.stderr: 22150K .......... .......... .......... .......... .......... 23% 27.7M 8s 2023-12-03T11:37:12.520 INFO:teuthology.orchestra.run.smithi131.stderr: 22200K .......... .......... .......... .......... .......... 23% 28.6M 8s 2023-12-03T11:37:12.523 INFO:teuthology.orchestra.run.smithi131.stderr: 22250K .......... .......... .......... .......... .......... 24% 21.9M 8s 2023-12-03T11:37:12.523 INFO:teuthology.orchestra.run.smithi131.stderr: 22300K .......... .......... .......... .......... .......... 24% 88.7M 8s 2023-12-03T11:37:12.527 INFO:teuthology.orchestra.run.smithi131.stderr: 22350K .......... .......... .......... .......... .......... 24% 14.2M 8s 2023-12-03T11:37:12.528 INFO:teuthology.orchestra.run.smithi131.stderr: 22400K .......... .......... .......... .......... .......... 24% 113M 8s 2023-12-03T11:37:12.529 INFO:teuthology.orchestra.run.smithi131.stderr: 22450K .......... .......... .......... .......... .......... 24% 35.9M 8s 2023-12-03T11:37:12.531 INFO:teuthology.orchestra.run.smithi131.stderr: 22500K .......... .......... .......... .......... .......... 24% 30.5M 8s 2023-12-03T11:37:12.531 INFO:teuthology.orchestra.run.smithi131.stderr: 22550K .......... .......... .......... .......... .......... 24% 69.6M 8s 2023-12-03T11:37:12.536 INFO:teuthology.orchestra.run.smithi131.stderr: 22600K .......... .......... .......... .......... .......... 24% 9.74M 8s 2023-12-03T11:37:12.537 INFO:teuthology.orchestra.run.smithi131.stderr: 22650K .......... .......... .......... .......... .......... 24% 50.5M 8s 2023-12-03T11:37:12.539 INFO:teuthology.orchestra.run.smithi131.stderr: 22700K .......... .......... .......... .......... .......... 24% 39.4M 8s 2023-12-03T11:37:12.541 INFO:teuthology.orchestra.run.smithi131.stderr: 22750K .......... .......... .......... .......... .......... 24% 31.4M 8s 2023-12-03T11:37:12.541 INFO:teuthology.orchestra.run.smithi131.stderr: 22800K .......... .......... .......... .......... .......... 24% 79.2M 8s 2023-12-03T11:37:12.541 INFO:teuthology.orchestra.run.smithi131.stderr: 22850K .......... .......... .......... .......... .......... 24% 61.5M 8s 2023-12-03T11:37:12.544 INFO:teuthology.orchestra.run.smithi131.stderr: 22900K .......... .......... .......... .......... .......... 24% 25.0M 8s 2023-12-03T11:37:12.545 INFO:teuthology.orchestra.run.smithi131.stderr: 22950K .......... .......... .......... .......... .......... 24% 26.4M 8s 2023-12-03T11:37:12.546 INFO:teuthology.orchestra.run.smithi131.stderr: 23000K .......... .......... .......... .......... .......... 24% 85.3M 7s 2023-12-03T11:37:12.552 INFO:teuthology.orchestra.run.smithi131.stderr: 23050K .......... .......... .......... .......... .......... 24% 8.21M 7s 2023-12-03T11:37:12.557 INFO:teuthology.orchestra.run.smithi131.stderr: 23100K .......... .......... .......... .......... .......... 24% 30.6M 7s 2023-12-03T11:37:12.557 INFO:teuthology.orchestra.run.smithi131.stderr: 23150K .......... .......... .......... .......... .......... 24% 27.1M 7s 2023-12-03T11:37:12.558 INFO:teuthology.orchestra.run.smithi131.stderr: 23200K .......... .......... .......... .......... .......... 25% 19.3M 7s 2023-12-03T11:37:12.560 INFO:teuthology.orchestra.run.smithi131.stderr: 23250K .......... .......... .......... .......... .......... 25% 18.2M 7s 2023-12-03T11:37:12.563 INFO:teuthology.orchestra.run.smithi131.stderr: 23300K .......... .......... .......... .......... .......... 25% 17.6M 7s 2023-12-03T11:37:12.575 INFO:teuthology.orchestra.run.smithi131.stderr: 23350K .......... .......... .......... .......... .......... 25% 4.12M 7s 2023-12-03T11:37:12.578 INFO:teuthology.orchestra.run.smithi131.stderr: 23400K .......... .......... .......... .......... .......... 25% 23.2M 7s 2023-12-03T11:37:12.582 INFO:teuthology.orchestra.run.smithi131.stderr: 23450K .......... .......... .......... .......... .......... 25% 8.75M 7s 2023-12-03T11:37:12.584 INFO:teuthology.orchestra.run.smithi131.stderr: 23500K .......... .......... .......... .......... .......... 25% 36.4M 7s 2023-12-03T11:37:12.585 INFO:teuthology.orchestra.run.smithi131.stderr: 23550K .......... .......... .......... .......... .......... 25% 39.7M 7s 2023-12-03T11:37:12.586 INFO:teuthology.orchestra.run.smithi131.stderr: 23600K .......... .......... .......... .......... .......... 25% 42.7M 7s 2023-12-03T11:37:12.588 INFO:teuthology.orchestra.run.smithi131.stderr: 23650K .......... .......... .......... .......... .......... 25% 24.8M 7s 2023-12-03T11:37:12.590 INFO:teuthology.orchestra.run.smithi131.stderr: 23700K .......... .......... .......... .......... .......... 25% 18.4M 7s 2023-12-03T11:37:12.592 INFO:teuthology.orchestra.run.smithi131.stderr: 23750K .......... .......... .......... .......... .......... 25% 32.5M 7s 2023-12-03T11:37:12.594 INFO:teuthology.orchestra.run.smithi131.stderr: 23800K .......... .......... .......... .......... .......... 25% 21.6M 7s 2023-12-03T11:37:12.605 INFO:teuthology.orchestra.run.smithi131.stderr: 23850K .......... .......... .......... .......... .......... 25% 4.67M 7s 2023-12-03T11:37:12.607 INFO:teuthology.orchestra.run.smithi131.stderr: 23900K .......... .......... .......... .......... .......... 25% 20.8M 7s 2023-12-03T11:37:12.608 INFO:teuthology.orchestra.run.smithi131.stderr: 23950K .......... .......... .......... .......... .......... 25% 54.2M 7s 2023-12-03T11:37:12.610 INFO:teuthology.orchestra.run.smithi131.stderr: 24000K .......... .......... .......... .......... .......... 25% 31.3M 7s 2023-12-03T11:37:12.612 INFO:teuthology.orchestra.run.smithi131.stderr: 24050K .......... .......... .......... .......... .......... 25% 31.4M 7s 2023-12-03T11:37:12.613 INFO:teuthology.orchestra.run.smithi131.stderr: 24100K .......... .......... .......... .......... .......... 25% 29.5M 7s 2023-12-03T11:37:12.614 INFO:teuthology.orchestra.run.smithi131.stderr: 24150K .......... .......... .......... .......... .......... 26% 34.7M 7s 2023-12-03T11:37:12.619 INFO:teuthology.orchestra.run.smithi131.stderr: 24200K .......... .......... .......... .......... .......... 26% 12.1M 7s 2023-12-03T11:37:12.619 INFO:teuthology.orchestra.run.smithi131.stderr: 24250K .......... .......... .......... .......... .......... 26% 78.8M 7s 2023-12-03T11:37:12.622 INFO:teuthology.orchestra.run.smithi131.stderr: 24300K .......... .......... .......... .......... .......... 26% 17.9M 7s 2023-12-03T11:37:12.625 INFO:teuthology.orchestra.run.smithi131.stderr: 24350K .......... .......... .......... .......... .......... 26% 16.3M 7s 2023-12-03T11:37:12.626 INFO:teuthology.orchestra.run.smithi131.stderr: 24400K .......... .......... .......... .......... .......... 26% 32.3M 7s 2023-12-03T11:37:12.629 INFO:teuthology.orchestra.run.smithi131.stderr: 24450K .......... .......... .......... .......... .......... 26% 17.8M 7s 2023-12-03T11:37:12.631 INFO:teuthology.orchestra.run.smithi131.stderr: 24500K .......... .......... .......... .......... .......... 26% 27.2M 7s 2023-12-03T11:37:12.636 INFO:teuthology.orchestra.run.smithi131.stderr: 24550K .......... .......... .......... .......... .......... 26% 10.3M 7s 2023-12-03T11:37:12.640 INFO:teuthology.orchestra.run.smithi131.stderr: 24600K .......... .......... .......... .......... .......... 26% 10.6M 7s 2023-12-03T11:37:12.641 INFO:teuthology.orchestra.run.smithi131.stderr: 24650K .......... .......... .......... .......... .......... 26% 53.6M 7s 2023-12-03T11:37:12.643 INFO:teuthology.orchestra.run.smithi131.stderr: 24700K .......... .......... .......... .......... .......... 26% 27.5M 7s 2023-12-03T11:37:12.644 INFO:teuthology.orchestra.run.smithi131.stderr: 24750K .......... .......... .......... .......... .......... 26% 28.5M 7s 2023-12-03T11:37:12.647 INFO:teuthology.orchestra.run.smithi131.stderr: 24800K .......... .......... .......... .......... .......... 26% 19.8M 7s 2023-12-03T11:37:12.648 INFO:teuthology.orchestra.run.smithi131.stderr: 24850K .......... .......... .......... .......... .......... 26% 76.5M 7s 2023-12-03T11:37:12.650 INFO:teuthology.orchestra.run.smithi131.stderr: 24900K .......... .......... .......... .......... .......... 26% 18.8M 7s 2023-12-03T11:37:12.652 INFO:teuthology.orchestra.run.smithi131.stderr: 24950K .......... .......... .......... .......... .......... 26% 24.8M 7s 2023-12-03T11:37:12.654 INFO:teuthology.orchestra.run.smithi131.stderr: 25000K .......... .......... .......... .......... .......... 26% 26.3M 7s 2023-12-03T11:37:12.656 INFO:teuthology.orchestra.run.smithi131.stderr: 25050K .......... .......... .......... .......... .......... 27% 20.8M 7s 2023-12-03T11:37:12.657 INFO:teuthology.orchestra.run.smithi131.stderr: 25100K .......... .......... .......... .......... .......... 27% 53.6M 7s 2023-12-03T11:37:12.659 INFO:teuthology.orchestra.run.smithi131.stderr: 25150K .......... .......... .......... .......... .......... 27% 22.9M 7s 2023-12-03T11:37:12.662 INFO:teuthology.orchestra.run.smithi131.stderr: 25200K .......... .......... .......... .......... .......... 27% 24.2M 7s 2023-12-03T11:37:12.663 INFO:teuthology.orchestra.run.smithi131.stderr: 25250K .......... .......... .......... .......... .......... 27% 25.6M 7s 2023-12-03T11:37:12.667 INFO:teuthology.orchestra.run.smithi131.stderr: 25300K .......... .......... .......... .......... .......... 27% 35.1M 7s 2023-12-03T11:37:12.700 INFO:teuthology.orchestra.run.smithi131.stderr: 25350K .......... .......... .......... .......... .......... 27% 1.39M 7s 2023-12-03T11:37:12.706 INFO:teuthology.orchestra.run.smithi131.stderr: 25400K .......... .......... .......... .......... .......... 27% 7.58M 7s 2023-12-03T11:37:12.708 INFO:teuthology.orchestra.run.smithi131.stderr: 25450K .......... .......... .......... .......... .......... 27% 25.2M 7s 2023-12-03T11:37:12.710 INFO:teuthology.orchestra.run.smithi131.stderr: 25500K .......... .......... .......... .......... .......... 27% 27.6M 7s 2023-12-03T11:37:12.713 INFO:teuthology.orchestra.run.smithi131.stderr: 25550K .......... .......... .......... .......... .......... 27% 46.8M 7s 2023-12-03T11:37:12.713 INFO:teuthology.orchestra.run.smithi131.stderr: 25600K .......... .......... .......... .......... .......... 27% 25.5M 7s 2023-12-03T11:37:12.715 INFO:teuthology.orchestra.run.smithi131.stderr: 25650K .......... .......... .......... .......... .......... 27% 24.9M 7s 2023-12-03T11:37:12.717 INFO:teuthology.orchestra.run.smithi131.stderr: 25700K .......... .......... .......... .......... .......... 27% 29.7M 7s 2023-12-03T11:37:12.719 INFO:teuthology.orchestra.run.smithi131.stderr: 25750K .......... .......... .......... .......... .......... 27% 25.4M 7s 2023-12-03T11:37:12.722 INFO:teuthology.orchestra.run.smithi131.stderr: 25800K .......... .......... .......... .......... .......... 27% 32.2M 7s 2023-12-03T11:37:12.723 INFO:teuthology.orchestra.run.smithi131.stderr: 25850K .......... .......... .......... .......... .......... 27% 15.5M 7s 2023-12-03T11:37:12.724 INFO:teuthology.orchestra.run.smithi131.stderr: 25900K .......... .......... .......... .......... .......... 27% 45.4M 7s 2023-12-03T11:37:12.726 INFO:teuthology.orchestra.run.smithi131.stderr: 25950K .......... .......... .......... .......... .......... 27% 32.0M 7s 2023-12-03T11:37:12.726 INFO:teuthology.orchestra.run.smithi131.stderr: 26000K .......... .......... .......... .......... .......... 28% 92.8M 7s 2023-12-03T11:37:12.728 INFO:teuthology.orchestra.run.smithi131.stderr: 26050K .......... .......... .......... .......... .......... 28% 23.4M 7s 2023-12-03T11:37:12.731 INFO:teuthology.orchestra.run.smithi131.stderr: 26100K .......... .......... .......... .......... .......... 28% 22.3M 7s 2023-12-03T11:37:12.732 INFO:teuthology.orchestra.run.smithi131.stderr: 26150K .......... .......... .......... .......... .......... 28% 46.8M 7s 2023-12-03T11:37:12.734 INFO:teuthology.orchestra.run.smithi131.stderr: 26200K .......... .......... .......... .......... .......... 28% 22.7M 7s 2023-12-03T11:37:12.735 INFO:teuthology.orchestra.run.smithi131.stderr: 26250K .......... .......... .......... .......... .......... 28% 37.6M 7s 2023-12-03T11:37:12.736 INFO:teuthology.orchestra.run.smithi131.stderr: 26300K .......... .......... .......... .......... .......... 28% 43.9M 7s 2023-12-03T11:37:12.737 INFO:teuthology.orchestra.run.smithi131.stderr: 26350K .......... .......... .......... .......... .......... 28% 65.5M 7s 2023-12-03T11:37:12.738 INFO:teuthology.orchestra.run.smithi131.stderr: 26400K .......... .......... .......... .......... .......... 28% 33.0M 7s 2023-12-03T11:37:12.744 INFO:teuthology.orchestra.run.smithi131.stderr: 26450K .......... .......... .......... .......... .......... 28% 10.5M 7s 2023-12-03T11:37:12.746 INFO:teuthology.orchestra.run.smithi131.stderr: 26500K .......... .......... .......... .......... .......... 28% 31.3M 7s 2023-12-03T11:37:12.746 INFO:teuthology.orchestra.run.smithi131.stderr: 26550K .......... .......... .......... .......... .......... 28% 91.2M 7s 2023-12-03T11:37:12.746 INFO:teuthology.orchestra.run.smithi131.stderr: 26600K .......... .......... .......... .......... .......... 28% 48.2M 7s 2023-12-03T11:37:12.748 INFO:teuthology.orchestra.run.smithi131.stderr: 26650K .......... .......... .......... .......... .......... 28% 33.7M 7s 2023-12-03T11:37:12.749 INFO:teuthology.orchestra.run.smithi131.stderr: 26700K .......... .......... .......... .......... .......... 28% 47.8M 7s 2023-12-03T11:37:12.750 INFO:teuthology.orchestra.run.smithi131.stderr: 26750K .......... .......... .......... .......... .......... 28% 38.4M 7s 2023-12-03T11:37:12.751 INFO:teuthology.orchestra.run.smithi131.stderr: 26800K .......... .......... .......... .......... .......... 28% 45.5M 7s 2023-12-03T11:37:12.753 INFO:teuthology.orchestra.run.smithi131.stderr: 26850K .......... .......... .......... .......... .......... 28% 26.9M 7s 2023-12-03T11:37:12.757 INFO:teuthology.orchestra.run.smithi131.stderr: 26900K .......... .......... .......... .......... .......... 29% 11.0M 7s 2023-12-03T11:37:12.760 INFO:teuthology.orchestra.run.smithi131.stderr: 26950K .......... .......... .......... .......... .......... 29% 18.4M 7s 2023-12-03T11:37:12.760 INFO:teuthology.orchestra.run.smithi131.stderr: 27000K .......... .......... .......... .......... .......... 29% 92.0M 7s 2023-12-03T11:37:12.762 INFO:teuthology.orchestra.run.smithi131.stderr: 27050K .......... .......... .......... .......... .......... 29% 29.9M 7s 2023-12-03T11:37:12.764 INFO:teuthology.orchestra.run.smithi131.stderr: 27100K .......... .......... .......... .......... .......... 29% 24.2M 7s 2023-12-03T11:37:12.768 INFO:teuthology.orchestra.run.smithi131.stderr: 27150K .......... .......... .......... .......... .......... 29% 13.1M 7s 2023-12-03T11:37:12.769 INFO:teuthology.orchestra.run.smithi131.stderr: 27200K .......... .......... .......... .......... .......... 29% 32.2M 6s 2023-12-03T11:37:12.781 INFO:teuthology.orchestra.run.smithi131.stderr: 27250K .......... .......... .......... .......... .......... 29% 4.09M 7s 2023-12-03T11:37:12.783 INFO:teuthology.orchestra.run.smithi131.stderr: 27300K .......... .......... .......... .......... .......... 29% 35.8M 6s 2023-12-03T11:37:12.787 INFO:teuthology.orchestra.run.smithi131.stderr: 27350K .......... .......... .......... .......... .......... 29% 10.2M 6s 2023-12-03T11:37:12.790 INFO:teuthology.orchestra.run.smithi131.stderr: 27400K .......... .......... .......... .......... .......... 29% 25.0M 6s 2023-12-03T11:37:12.790 INFO:teuthology.orchestra.run.smithi131.stderr: 27450K .......... .......... .......... .......... .......... 29% 83.9M 6s 2023-12-03T11:37:12.791 INFO:teuthology.orchestra.run.smithi131.stderr: 27500K .......... .......... .......... .......... .......... 29% 47.3M 6s 2023-12-03T11:37:12.793 INFO:teuthology.orchestra.run.smithi131.stderr: 27550K .......... .......... .......... .......... .......... 29% 25.2M 6s 2023-12-03T11:37:12.797 INFO:teuthology.orchestra.run.smithi131.stderr: 27600K .......... .......... .......... .......... .......... 29% 12.5M 6s 2023-12-03T11:37:12.799 INFO:teuthology.orchestra.run.smithi131.stderr: 27650K .......... .......... .......... .......... .......... 29% 22.0M 6s 2023-12-03T11:37:12.807 INFO:teuthology.orchestra.run.smithi131.stderr: 27700K .......... .......... .......... .......... .......... 29% 6.07M 6s 2023-12-03T11:37:12.810 INFO:teuthology.orchestra.run.smithi131.stderr: 27750K .......... .......... .......... .......... .......... 29% 17.6M 6s 2023-12-03T11:37:12.811 INFO:teuthology.orchestra.run.smithi131.stderr: 27800K .......... .......... .......... .......... .......... 29% 29.9M 6s 2023-12-03T11:37:12.813 INFO:teuthology.orchestra.run.smithi131.stderr: 27850K .......... .......... .......... .......... .......... 30% 31.8M 6s 2023-12-03T11:37:12.813 INFO:teuthology.orchestra.run.smithi131.stderr: 27900K .......... .......... .......... .......... .......... 30% 71.4M 6s 2023-12-03T11:37:12.815 INFO:teuthology.orchestra.run.smithi131.stderr: 27950K .......... .......... .......... .......... .......... 30% 35.9M 6s 2023-12-03T11:37:12.817 INFO:teuthology.orchestra.run.smithi131.stderr: 28000K .......... .......... .......... .......... .......... 30% 24.6M 6s 2023-12-03T11:37:12.819 INFO:teuthology.orchestra.run.smithi131.stderr: 28050K .......... .......... .......... .......... .......... 30% 18.5M 6s 2023-12-03T11:37:12.823 INFO:teuthology.orchestra.run.smithi131.stderr: 28100K .......... .......... .......... .......... .......... 30% 16.9M 6s 2023-12-03T11:37:12.823 INFO:teuthology.orchestra.run.smithi131.stderr: 28150K .......... .......... .......... .......... .......... 30% 52.5M 6s 2023-12-03T11:37:12.826 INFO:teuthology.orchestra.run.smithi131.stderr: 28200K .......... .......... .......... .......... .......... 30% 16.4M 6s 2023-12-03T11:37:12.828 INFO:teuthology.orchestra.run.smithi131.stderr: 28250K .......... .......... .......... .......... .......... 30% 27.9M 6s 2023-12-03T11:37:12.831 INFO:teuthology.orchestra.run.smithi131.stderr: 28300K .......... .......... .......... .......... .......... 30% 18.3M 6s 2023-12-03T11:37:12.832 INFO:teuthology.orchestra.run.smithi131.stderr: 28350K .......... .......... .......... .......... .......... 30% 41.0M 6s 2023-12-03T11:37:12.835 INFO:teuthology.orchestra.run.smithi131.stderr: 28400K .......... .......... .......... .......... .......... 30% 14.1M 6s 2023-12-03T11:37:12.842 INFO:teuthology.orchestra.run.smithi131.stderr: 28450K .......... .......... .......... .......... .......... 30% 7.68M 6s 2023-12-03T11:37:12.842 INFO:teuthology.orchestra.run.smithi131.stderr: 28500K .......... .......... .......... .......... .......... 30% 82.6M 6s 2023-12-03T11:37:12.845 INFO:teuthology.orchestra.run.smithi131.stderr: 28550K .......... .......... .......... .......... .......... 30% 26.6M 6s 2023-12-03T11:37:12.847 INFO:teuthology.orchestra.run.smithi131.stderr: 28600K .......... .......... .......... .......... .......... 30% 24.6M 6s 2023-12-03T11:37:12.847 INFO:teuthology.orchestra.run.smithi131.stderr: 28650K .......... .......... .......... .......... .......... 30% 85.0M 6s 2023-12-03T11:37:12.849 INFO:teuthology.orchestra.run.smithi131.stderr: 28700K .......... .......... .......... .......... .......... 30% 18.5M 6s 2023-12-03T11:37:12.851 INFO:teuthology.orchestra.run.smithi131.stderr: 28750K .......... .......... .......... .......... .......... 31% 23.8M 6s 2023-12-03T11:37:12.852 INFO:teuthology.orchestra.run.smithi131.stderr: 28800K .......... .......... .......... .......... .......... 31% 44.0M 6s 2023-12-03T11:37:12.855 INFO:teuthology.orchestra.run.smithi131.stderr: 28850K .......... .......... .......... .......... .......... 31% 26.0M 6s 2023-12-03T11:37:12.857 INFO:teuthology.orchestra.run.smithi131.stderr: 28900K .......... .......... .......... .......... .......... 31% 24.4M 6s 2023-12-03T11:37:12.859 INFO:teuthology.orchestra.run.smithi131.stderr: 28950K .......... .......... .......... .......... .......... 31% 18.3M 6s 2023-12-03T11:37:12.861 INFO:teuthology.orchestra.run.smithi131.stderr: 29000K .......... .......... .......... .......... .......... 31% 31.6M 6s 2023-12-03T11:37:12.861 INFO:teuthology.orchestra.run.smithi131.stderr: 29050K .......... .......... .......... .......... .......... 31% 49.8M 6s 2023-12-03T11:37:12.864 INFO:teuthology.orchestra.run.smithi131.stderr: 29100K .......... .......... .......... .......... .......... 31% 21.2M 6s 2023-12-03T11:37:12.867 INFO:teuthology.orchestra.run.smithi131.stderr: 29150K .......... .......... .......... .......... .......... 31% 18.0M 6s 2023-12-03T11:37:12.869 INFO:teuthology.orchestra.run.smithi131.stderr: 29200K .......... .......... .......... .......... .......... 31% 20.0M 6s 2023-12-03T11:37:12.903 INFO:teuthology.orchestra.run.smithi131.stderr: 29250K .......... .......... .......... .......... .......... 31% 1.44M 6s 2023-12-03T11:37:12.906 INFO:teuthology.orchestra.run.smithi131.stderr: 29300K .......... .......... .......... .......... .......... 31% 21.0M 6s 2023-12-03T11:37:12.909 INFO:teuthology.orchestra.run.smithi131.stderr: 29350K .......... .......... .......... .......... .......... 31% 13.8M 6s 2023-12-03T11:37:12.911 INFO:teuthology.orchestra.run.smithi131.stderr: 29400K .......... .......... .......... .......... .......... 31% 31.4M 6s 2023-12-03T11:37:12.912 INFO:teuthology.orchestra.run.smithi131.stderr: 29450K .......... .......... .......... .......... .......... 31% 23.8M 6s 2023-12-03T11:37:12.915 INFO:teuthology.orchestra.run.smithi131.stderr: 29500K .......... .......... .......... .......... .......... 31% 21.5M 6s 2023-12-03T11:37:12.917 INFO:teuthology.orchestra.run.smithi131.stderr: 29550K .......... .......... .......... .......... .......... 31% 72.0M 6s 2023-12-03T11:37:12.917 INFO:teuthology.orchestra.run.smithi131.stderr: 29600K .......... .......... .......... .......... .......... 31% 27.3M 6s 2023-12-03T11:37:12.920 INFO:teuthology.orchestra.run.smithi131.stderr: 29650K .......... .......... .......... .......... .......... 31% 16.3M 6s 2023-12-03T11:37:12.922 INFO:teuthology.orchestra.run.smithi131.stderr: 29700K .......... .......... .......... .......... .......... 32% 26.7M 6s 2023-12-03T11:37:12.925 INFO:teuthology.orchestra.run.smithi131.stderr: 29750K .......... .......... .......... .......... .......... 32% 19.0M 6s 2023-12-03T11:37:12.925 INFO:teuthology.orchestra.run.smithi131.stderr: 29800K .......... .......... .......... .......... .......... 32% 92.8M 6s 2023-12-03T11:37:12.927 INFO:teuthology.orchestra.run.smithi131.stderr: 29850K .......... .......... .......... .......... .......... 32% 31.0M 6s 2023-12-03T11:37:12.928 INFO:teuthology.orchestra.run.smithi131.stderr: 29900K .......... .......... .......... .......... .......... 32% 29.1M 6s 2023-12-03T11:37:12.931 INFO:teuthology.orchestra.run.smithi131.stderr: 29950K .......... .......... .......... .......... .......... 32% 25.5M 6s 2023-12-03T11:37:12.931 INFO:teuthology.orchestra.run.smithi131.stderr: 30000K .......... .......... .......... .......... .......... 32% 75.2M 6s 2023-12-03T11:37:12.933 INFO:teuthology.orchestra.run.smithi131.stderr: 30050K .......... .......... .......... .......... .......... 32% 21.3M 6s 2023-12-03T11:37:12.935 INFO:teuthology.orchestra.run.smithi131.stderr: 30100K .......... .......... .......... .......... .......... 32% 24.5M 6s 2023-12-03T11:37:12.937 INFO:teuthology.orchestra.run.smithi131.stderr: 30150K .......... .......... .......... .......... .......... 32% 26.7M 6s 2023-12-03T11:37:12.939 INFO:teuthology.orchestra.run.smithi131.stderr: 30200K .......... .......... .......... .......... .......... 32% 35.1M 6s 2023-12-03T11:37:12.939 INFO:teuthology.orchestra.run.smithi131.stderr: 30250K .......... .......... .......... .......... .......... 32% 56.3M 6s 2023-12-03T11:37:12.941 INFO:teuthology.orchestra.run.smithi131.stderr: 30300K .......... .......... .......... .......... .......... 32% 43.7M 6s 2023-12-03T11:37:12.946 INFO:teuthology.orchestra.run.smithi131.stderr: 30350K .......... .......... .......... .......... .......... 32% 8.95M 6s 2023-12-03T11:37:12.948 INFO:teuthology.orchestra.run.smithi131.stderr: 30400K .......... .......... .......... .......... .......... 32% 38.2M 6s 2023-12-03T11:37:12.949 INFO:teuthology.orchestra.run.smithi131.stderr: 30450K .......... .......... .......... .......... .......... 32% 42.2M 6s 2023-12-03T11:37:12.949 INFO:teuthology.orchestra.run.smithi131.stderr: 30500K .......... .......... .......... .......... .......... 32% 71.0M 6s 2023-12-03T11:37:12.950 INFO:teuthology.orchestra.run.smithi131.stderr: 30550K .......... .......... .......... .......... .......... 32% 42.6M 6s 2023-12-03T11:37:12.951 INFO:teuthology.orchestra.run.smithi131.stderr: 30600K .......... .......... .......... .......... .......... 32% 42.0M 6s 2023-12-03T11:37:12.953 INFO:teuthology.orchestra.run.smithi131.stderr: 30650K .......... .......... .......... .......... .......... 33% 24.7M 6s 2023-12-03T11:37:12.954 INFO:teuthology.orchestra.run.smithi131.stderr: 30700K .......... .......... .......... .......... .......... 33% 41.2M 6s 2023-12-03T11:37:12.956 INFO:teuthology.orchestra.run.smithi131.stderr: 30750K .......... .......... .......... .......... .......... 33% 35.6M 6s 2023-12-03T11:37:12.961 INFO:teuthology.orchestra.run.smithi131.stderr: 30800K .......... .......... .......... .......... .......... 33% 12.3M 6s 2023-12-03T11:37:12.963 INFO:teuthology.orchestra.run.smithi131.stderr: 30850K .......... .......... .......... .......... .......... 33% 15.0M 6s 2023-12-03T11:37:12.965 INFO:teuthology.orchestra.run.smithi131.stderr: 30900K .......... .......... .......... .......... .......... 33% 23.9M 6s 2023-12-03T11:37:12.966 INFO:teuthology.orchestra.run.smithi131.stderr: 30950K .......... .......... .......... .......... .......... 33% 69.5M 6s 2023-12-03T11:37:12.968 INFO:teuthology.orchestra.run.smithi131.stderr: 31000K .......... .......... .......... .......... .......... 33% 26.5M 6s 2023-12-03T11:37:12.971 INFO:teuthology.orchestra.run.smithi131.stderr: 31050K .......... .......... .......... .......... .......... 33% 13.5M 6s 2023-12-03T11:37:12.984 INFO:teuthology.orchestra.run.smithi131.stderr: 31100K .......... .......... .......... .......... .......... 33% 4.03M 6s 2023-12-03T11:37:12.985 INFO:teuthology.orchestra.run.smithi131.stderr: 31150K .......... .......... .......... .......... .......... 33% 27.9M 6s 2023-12-03T11:37:12.987 INFO:teuthology.orchestra.run.smithi131.stderr: 31200K .......... .......... .......... .......... .......... 33% 37.2M 6s 2023-12-03T11:37:12.993 INFO:teuthology.orchestra.run.smithi131.stderr: 31250K .......... .......... .......... .......... .......... 33% 8.13M 6s 2023-12-03T11:37:12.994 INFO:teuthology.orchestra.run.smithi131.stderr: 31300K .......... .......... .......... .......... .......... 33% 32.7M 6s 2023-12-03T11:37:12.996 INFO:teuthology.orchestra.run.smithi131.stderr: 31350K .......... .......... .......... .......... .......... 33% 35.4M 6s 2023-12-03T11:37:12.997 INFO:teuthology.orchestra.run.smithi131.stderr: 31400K .......... .......... .......... .......... .......... 33% 28.3M 6s 2023-12-03T11:37:12.998 INFO:teuthology.orchestra.run.smithi131.stderr: 31450K .......... .......... .......... .......... .......... 33% 34.0M 6s 2023-12-03T11:37:13.001 INFO:teuthology.orchestra.run.smithi131.stderr: 31500K .......... .......... .......... .......... .......... 33% 16.2M 6s 2023-12-03T11:37:13.003 INFO:teuthology.orchestra.run.smithi131.stderr: 31550K .......... .......... .......... .......... .......... 34% 29.3M 6s 2023-12-03T11:37:13.014 INFO:teuthology.orchestra.run.smithi131.stderr: 31600K .......... .......... .......... .......... .......... 34% 4.60M 6s 2023-12-03T11:37:13.014 INFO:teuthology.orchestra.run.smithi131.stderr: 31650K .......... .......... .......... .......... .......... 34% 90.5M 6s 2023-12-03T11:37:13.016 INFO:teuthology.orchestra.run.smithi131.stderr: 31700K .......... .......... .......... .......... .......... 34% 22.1M 6s 2023-12-03T11:37:13.018 INFO:teuthology.orchestra.run.smithi131.stderr: 31750K .......... .......... .......... .......... .......... 34% 37.7M 6s 2023-12-03T11:37:13.020 INFO:teuthology.orchestra.run.smithi131.stderr: 31800K .......... .......... .......... .......... .......... 34% 32.1M 6s 2023-12-03T11:37:13.021 INFO:teuthology.orchestra.run.smithi131.stderr: 31850K .......... .......... .......... .......... .......... 34% 24.4M 6s 2023-12-03T11:37:13.022 INFO:teuthology.orchestra.run.smithi131.stderr: 31900K .......... .......... .......... .......... .......... 34% 40.6M 6s 2023-12-03T11:37:13.026 INFO:teuthology.orchestra.run.smithi131.stderr: 31950K .......... .......... .......... .......... .......... 34% 12.5M 6s 2023-12-03T11:37:13.028 INFO:teuthology.orchestra.run.smithi131.stderr: 32000K .......... .......... .......... .......... .......... 34% 40.3M 6s 2023-12-03T11:37:13.030 INFO:teuthology.orchestra.run.smithi131.stderr: 32050K .......... .......... .......... .......... .......... 34% 22.1M 6s 2023-12-03T11:37:13.031 INFO:teuthology.orchestra.run.smithi131.stderr: 32100K .......... .......... .......... .......... .......... 34% 30.5M 6s 2023-12-03T11:37:13.034 INFO:teuthology.orchestra.run.smithi131.stderr: 32150K .......... .......... .......... .......... .......... 34% 16.9M 6s 2023-12-03T11:37:13.036 INFO:teuthology.orchestra.run.smithi131.stderr: 32200K .......... .......... .......... .......... .......... 34% 24.0M 6s 2023-12-03T11:37:13.038 INFO:teuthology.orchestra.run.smithi131.stderr: 32250K .......... .......... .......... .......... .......... 34% 22.4M 6s 2023-12-03T11:37:13.043 INFO:teuthology.orchestra.run.smithi131.stderr: 32300K .......... .......... .......... .......... .......... 34% 12.6M 6s 2023-12-03T11:37:13.047 INFO:teuthology.orchestra.run.smithi131.stderr: 32350K .......... .......... .......... .......... .......... 34% 11.3M 6s 2023-12-03T11:37:13.048 INFO:teuthology.orchestra.run.smithi131.stderr: 32400K .......... .......... .......... .......... .......... 34% 56.3M 6s 2023-12-03T11:37:13.049 INFO:teuthology.orchestra.run.smithi131.stderr: 32450K .......... .......... .......... .......... .......... 34% 31.9M 6s 2023-12-03T11:37:13.051 INFO:teuthology.orchestra.run.smithi131.stderr: 32500K .......... .......... .......... .......... .......... 35% 27.1M 6s 2023-12-03T11:37:13.051 INFO:teuthology.orchestra.run.smithi131.stderr: 32550K .......... .......... .......... .......... .......... 35% 77.5M 6s 2023-12-03T11:37:13.054 INFO:teuthology.orchestra.run.smithi131.stderr: 32600K .......... .......... .......... .......... .......... 35% 18.2M 5s 2023-12-03T11:37:13.057 INFO:teuthology.orchestra.run.smithi131.stderr: 32650K .......... .......... .......... .......... .......... 35% 16.8M 5s 2023-12-03T11:37:13.059 INFO:teuthology.orchestra.run.smithi131.stderr: 32700K .......... .......... .......... .......... .......... 35% 35.9M 5s 2023-12-03T11:37:13.060 INFO:teuthology.orchestra.run.smithi131.stderr: 32750K .......... .......... .......... .......... .......... 35% 26.3M 5s 2023-12-03T11:37:13.061 INFO:teuthology.orchestra.run.smithi131.stderr: 32800K .......... .......... .......... .......... .......... 35% 63.8M 5s 2023-12-03T11:37:13.064 INFO:teuthology.orchestra.run.smithi131.stderr: 32850K .......... .......... .......... .......... .......... 35% 17.9M 5s 2023-12-03T11:37:13.066 INFO:teuthology.orchestra.run.smithi131.stderr: 32900K .......... .......... .......... .......... .......... 35% 29.8M 5s 2023-12-03T11:37:13.067 INFO:teuthology.orchestra.run.smithi131.stderr: 32950K .......... .......... .......... .......... .......... 35% 24.1M 5s 2023-12-03T11:37:13.070 INFO:teuthology.orchestra.run.smithi131.stderr: 33000K .......... .......... .......... .......... .......... 35% 21.7M 5s 2023-12-03T11:37:13.071 INFO:teuthology.orchestra.run.smithi131.stderr: 33050K .......... .......... .......... .......... .......... 35% 30.4M 5s 2023-12-03T11:37:13.075 INFO:teuthology.orchestra.run.smithi131.stderr: 33100K .......... .......... .......... .......... .......... 35% 12.7M 5s 2023-12-03T11:37:13.107 INFO:teuthology.orchestra.run.smithi131.stderr: 33150K .......... .......... .......... .......... .......... 35% 1.55M 5s 2023-12-03T11:37:13.109 INFO:teuthology.orchestra.run.smithi131.stderr: 33200K .......... .......... .......... .......... .......... 35% 17.8M 5s 2023-12-03T11:37:13.111 INFO:teuthology.orchestra.run.smithi131.stderr: 33250K .......... .......... .......... .......... .......... 35% 45.3M 5s 2023-12-03T11:37:13.112 INFO:teuthology.orchestra.run.smithi131.stderr: 33300K .......... .......... .......... .......... .......... 35% 28.7M 5s 2023-12-03T11:37:13.114 INFO:teuthology.orchestra.run.smithi131.stderr: 33350K .......... .......... .......... .......... .......... 35% 27.1M 5s 2023-12-03T11:37:13.117 INFO:teuthology.orchestra.run.smithi131.stderr: 33400K .......... .......... .......... .......... .......... 36% 20.4M 5s 2023-12-03T11:37:13.119 INFO:teuthology.orchestra.run.smithi131.stderr: 33450K .......... .......... .......... .......... .......... 36% 26.8M 5s 2023-12-03T11:37:13.119 INFO:teuthology.orchestra.run.smithi131.stderr: 33500K .......... .......... .......... .......... .......... 36% 92.9M 5s 2023-12-03T11:37:13.122 INFO:teuthology.orchestra.run.smithi131.stderr: 33550K .......... .......... .......... .......... .......... 36% 15.6M 5s 2023-12-03T11:37:13.124 INFO:teuthology.orchestra.run.smithi131.stderr: 33600K .......... .......... .......... .......... .......... 36% 21.6M 5s 2023-12-03T11:37:13.126 INFO:teuthology.orchestra.run.smithi131.stderr: 33650K .......... .......... .......... .......... .......... 36% 27.9M 5s 2023-12-03T11:37:13.128 INFO:teuthology.orchestra.run.smithi131.stderr: 33700K .......... .......... .......... .......... .......... 36% 33.4M 5s 2023-12-03T11:37:13.128 INFO:teuthology.orchestra.run.smithi131.stderr: 33750K .......... .......... .......... .......... .......... 36% 69.4M 5s 2023-12-03T11:37:13.130 INFO:teuthology.orchestra.run.smithi131.stderr: 33800K .......... .......... .......... .......... .......... 36% 23.9M 5s 2023-12-03T11:37:13.132 INFO:teuthology.orchestra.run.smithi131.stderr: 33850K .......... .......... .......... .......... .......... 36% 32.7M 5s 2023-12-03T11:37:13.134 INFO:teuthology.orchestra.run.smithi131.stderr: 33900K .......... .......... .......... .......... .......... 36% 22.6M 5s 2023-12-03T11:37:13.136 INFO:teuthology.orchestra.run.smithi131.stderr: 33950K .......... .......... .......... .......... .......... 36% 23.8M 5s 2023-12-03T11:37:13.137 INFO:teuthology.orchestra.run.smithi131.stderr: 34000K .......... .......... .......... .......... .......... 36% 36.6M 5s 2023-12-03T11:37:13.139 INFO:teuthology.orchestra.run.smithi131.stderr: 34050K .......... .......... .......... .......... .......... 36% 43.7M 5s 2023-12-03T11:37:13.140 INFO:teuthology.orchestra.run.smithi131.stderr: 34100K .......... .......... .......... .......... .......... 36% 36.2M 5s 2023-12-03T11:37:13.142 INFO:teuthology.orchestra.run.smithi131.stderr: 34150K .......... .......... .......... .......... .......... 36% 28.2M 5s 2023-12-03T11:37:13.142 INFO:teuthology.orchestra.run.smithi131.stderr: 34200K .......... .......... .......... .......... .......... 36% 81.8M 5s 2023-12-03T11:37:13.149 INFO:teuthology.orchestra.run.smithi131.stderr: 34250K .......... .......... .......... .......... .......... 36% 9.46M 5s 2023-12-03T11:37:13.149 INFO:teuthology.orchestra.run.smithi131.stderr: 34300K .......... .......... .......... .......... .......... 36% 38.5M 5s 2023-12-03T11:37:13.150 INFO:teuthology.orchestra.run.smithi131.stderr: 34350K .......... .......... .......... .......... .......... 37% 35.3M 5s 2023-12-03T11:37:13.153 INFO:teuthology.orchestra.run.smithi131.stderr: 34400K .......... .......... .......... .......... .......... 37% 28.7M 5s 2023-12-03T11:37:13.153 INFO:teuthology.orchestra.run.smithi131.stderr: 34450K .......... .......... .......... .......... .......... 37% 84.6M 5s 2023-12-03T11:37:13.153 INFO:teuthology.orchestra.run.smithi131.stderr: 34500K .......... .......... .......... .......... .......... 37% 63.9M 5s 2023-12-03T11:37:13.155 INFO:teuthology.orchestra.run.smithi131.stderr: 34550K .......... .......... .......... .......... .......... 37% 21.9M 5s 2023-12-03T11:37:13.158 INFO:teuthology.orchestra.run.smithi131.stderr: 34600K .......... .......... .......... .......... .......... 37% 25.5M 5s 2023-12-03T11:37:13.158 INFO:teuthology.orchestra.run.smithi131.stderr: 34650K .......... .......... .......... .......... .......... 37% 86.2M 5s 2023-12-03T11:37:13.163 INFO:teuthology.orchestra.run.smithi131.stderr: 34700K .......... .......... .......... .......... .......... 37% 9.44M 5s 2023-12-03T11:37:13.166 INFO:teuthology.orchestra.run.smithi131.stderr: 34750K .......... .......... .......... .......... .......... 37% 17.7M 5s 2023-12-03T11:37:13.168 INFO:teuthology.orchestra.run.smithi131.stderr: 34800K .......... .......... .......... .......... .......... 37% 24.5M 5s 2023-12-03T11:37:13.169 INFO:teuthology.orchestra.run.smithi131.stderr: 34850K .......... .......... .......... .......... .......... 37% 31.6M 5s 2023-12-03T11:37:13.171 INFO:teuthology.orchestra.run.smithi131.stderr: 34900K .......... .......... .......... .......... .......... 37% 31.6M 5s 2023-12-03T11:37:13.175 INFO:teuthology.orchestra.run.smithi131.stderr: 34950K .......... .......... .......... .......... .......... 37% 11.1M 5s 2023-12-03T11:37:13.188 INFO:teuthology.orchestra.run.smithi131.stderr: 35000K .......... .......... .......... .......... .......... 37% 3.82M 5s 2023-12-03T11:37:13.190 INFO:teuthology.orchestra.run.smithi131.stderr: 35050K .......... .......... .......... .......... .......... 37% 26.4M 5s 2023-12-03T11:37:13.194 INFO:teuthology.orchestra.run.smithi131.stderr: 35100K .......... .......... .......... .......... .......... 37% 10.8M 5s 2023-12-03T11:37:13.196 INFO:teuthology.orchestra.run.smithi131.stderr: 35150K .......... .......... .......... .......... .......... 37% 27.3M 5s 2023-12-03T11:37:13.199 INFO:teuthology.orchestra.run.smithi131.stderr: 35200K .......... .......... .......... .......... .......... 37% 25.3M 5s 2023-12-03T11:37:13.199 INFO:teuthology.orchestra.run.smithi131.stderr: 35250K .......... .......... .......... .......... .......... 37% 40.9M 5s 2023-12-03T11:37:13.201 INFO:teuthology.orchestra.run.smithi131.stderr: 35300K .......... .......... .......... .......... .......... 38% 23.2M 5s 2023-12-03T11:37:13.203 INFO:teuthology.orchestra.run.smithi131.stderr: 35350K .......... .......... .......... .......... .......... 38% 35.0M 5s 2023-12-03T11:37:13.206 INFO:teuthology.orchestra.run.smithi131.stderr: 35400K .......... .......... .......... .......... .......... 38% 13.3M 5s 2023-12-03T11:37:13.216 INFO:teuthology.orchestra.run.smithi131.stderr: 35450K .......... .......... .......... .......... .......... 38% 5.13M 5s 2023-12-03T11:37:13.220 INFO:teuthology.orchestra.run.smithi131.stderr: 35500K .......... .......... .......... .......... .......... 38% 15.3M 5s 2023-12-03T11:37:13.222 INFO:teuthology.orchestra.run.smithi131.stderr: 35550K .......... .......... .......... .......... .......... 38% 22.5M 5s 2023-12-03T11:37:13.222 INFO:teuthology.orchestra.run.smithi131.stderr: 35600K .......... .......... .......... .......... .......... 38% 97.3M 5s 2023-12-03T11:37:13.224 INFO:teuthology.orchestra.run.smithi131.stderr: 35650K .......... .......... .......... .......... .......... 38% 23.6M 5s 2023-12-03T11:37:13.226 INFO:teuthology.orchestra.run.smithi131.stderr: 35700K .......... .......... .......... .......... .......... 38% 31.7M 5s 2023-12-03T11:37:13.227 INFO:teuthology.orchestra.run.smithi131.stderr: 35750K .......... .......... .......... .......... .......... 38% 26.3M 5s 2023-12-03T11:37:13.228 INFO:teuthology.orchestra.run.smithi131.stderr: 35800K .......... .......... .......... .......... .......... 38% 43.8M 5s 2023-12-03T11:37:13.233 INFO:teuthology.orchestra.run.smithi131.stderr: 35850K .......... .......... .......... .......... .......... 38% 9.88M 5s 2023-12-03T11:37:13.234 INFO:teuthology.orchestra.run.smithi131.stderr: 35900K .......... .......... .......... .......... .......... 38% 75.9M 5s 2023-12-03T11:37:13.237 INFO:teuthology.orchestra.run.smithi131.stderr: 35950K .......... .......... .......... .......... .......... 38% 14.8M 5s 2023-12-03T11:37:13.239 INFO:teuthology.orchestra.run.smithi131.stderr: 36000K .......... .......... .......... .......... .......... 38% 29.1M 5s 2023-12-03T11:37:13.243 INFO:teuthology.orchestra.run.smithi131.stderr: 36050K .......... .......... .......... .......... .......... 38% 15.4M 5s 2023-12-03T11:37:13.243 INFO:teuthology.orchestra.run.smithi131.stderr: 36100K .......... .......... .......... .......... .......... 38% 94.6M 5s 2023-12-03T11:37:13.246 INFO:teuthology.orchestra.run.smithi131.stderr: 36150K .......... .......... .......... .......... .......... 38% 13.9M 5s 2023-12-03T11:37:13.248 INFO:teuthology.orchestra.run.smithi131.stderr: 36200K .......... .......... .......... .......... .......... 39% 20.5M 5s 2023-12-03T11:37:13.254 INFO:teuthology.orchestra.run.smithi131.stderr: 36250K .......... .......... .......... .......... .......... 39% 8.92M 5s 2023-12-03T11:37:13.256 INFO:teuthology.orchestra.run.smithi131.stderr: 36300K .......... .......... .......... .......... .......... 39% 37.4M 5s 2023-12-03T11:37:13.256 INFO:teuthology.orchestra.run.smithi131.stderr: 36350K .......... .......... .......... .......... .......... 39% 80.5M 5s 2023-12-03T11:37:13.258 INFO:teuthology.orchestra.run.smithi131.stderr: 36400K .......... .......... .......... .......... .......... 39% 25.4M 5s 2023-12-03T11:37:13.260 INFO:teuthology.orchestra.run.smithi131.stderr: 36450K .......... .......... .......... .......... .......... 39% 24.8M 5s 2023-12-03T11:37:13.262 INFO:teuthology.orchestra.run.smithi131.stderr: 36500K .......... .......... .......... .......... .......... 39% 22.1M 5s 2023-12-03T11:37:13.263 INFO:teuthology.orchestra.run.smithi131.stderr: 36550K .......... .......... .......... .......... .......... 39% 30.9M 5s 2023-12-03T11:37:13.265 INFO:teuthology.orchestra.run.smithi131.stderr: 36600K .......... .......... .......... .......... .......... 39% 30.8M 5s 2023-12-03T11:37:13.267 INFO:teuthology.orchestra.run.smithi131.stderr: 36650K .......... .......... .......... .......... .......... 39% 27.6M 5s 2023-12-03T11:37:13.269 INFO:teuthology.orchestra.run.smithi131.stderr: 36700K .......... .......... .......... .......... .......... 39% 23.4M 5s 2023-12-03T11:37:13.271 INFO:teuthology.orchestra.run.smithi131.stderr: 36750K .......... .......... .......... .......... .......... 39% 27.1M 5s 2023-12-03T11:37:13.273 INFO:teuthology.orchestra.run.smithi131.stderr: 36800K .......... .......... .......... .......... .......... 39% 26.5M 5s 2023-12-03T11:37:13.275 INFO:teuthology.orchestra.run.smithi131.stderr: 36850K .......... .......... .......... .......... .......... 39% 21.4M 5s 2023-12-03T11:37:13.276 INFO:teuthology.orchestra.run.smithi131.stderr: 36900K .......... .......... .......... .......... .......... 39% 29.8M 5s 2023-12-03T11:37:13.279 INFO:teuthology.orchestra.run.smithi131.stderr: 36950K .......... .......... .......... .......... .......... 39% 16.7M 5s 2023-12-03T11:37:13.307 INFO:teuthology.orchestra.run.smithi131.stderr: 37000K .......... .......... .......... .......... .......... 39% 1.77M 5s 2023-12-03T11:37:13.312 INFO:teuthology.orchestra.run.smithi131.stderr: 37050K .......... .......... .......... .......... .......... 39% 10.9M 5s 2023-12-03T11:37:13.315 INFO:teuthology.orchestra.run.smithi131.stderr: 37100K .......... .......... .......... .......... .......... 39% 13.6M 5s 2023-12-03T11:37:13.317 INFO:teuthology.orchestra.run.smithi131.stderr: 37150K .......... .......... .......... .......... .......... 40% 26.0M 5s 2023-12-03T11:37:13.319 INFO:teuthology.orchestra.run.smithi131.stderr: 37200K .......... .......... .......... .......... .......... 40% 29.2M 5s 2023-12-03T11:37:13.319 INFO:teuthology.orchestra.run.smithi131.stderr: 37250K .......... .......... .......... .......... .......... 40% 93.5M 5s 2023-12-03T11:37:13.322 INFO:teuthology.orchestra.run.smithi131.stderr: 37300K .......... .......... .......... .......... .......... 40% 20.1M 5s 2023-12-03T11:37:13.323 INFO:teuthology.orchestra.run.smithi131.stderr: 37350K .......... .......... .......... .......... .......... 40% 32.9M 5s 2023-12-03T11:37:13.326 INFO:teuthology.orchestra.run.smithi131.stderr: 37400K .......... .......... .......... .......... .......... 40% 17.3M 5s 2023-12-03T11:37:13.327 INFO:teuthology.orchestra.run.smithi131.stderr: 37450K .......... .......... .......... .......... .......... 40% 50.6M 5s 2023-12-03T11:37:13.329 INFO:teuthology.orchestra.run.smithi131.stderr: 37500K .......... .......... .......... .......... .......... 40% 17.8M 5s 2023-12-03T11:37:13.332 INFO:teuthology.orchestra.run.smithi131.stderr: 37550K .......... .......... .......... .......... .......... 40% 22.2M 5s 2023-12-03T11:37:13.333 INFO:teuthology.orchestra.run.smithi131.stderr: 37600K .......... .......... .......... .......... .......... 40% 60.8M 5s 2023-12-03T11:37:13.335 INFO:teuthology.orchestra.run.smithi131.stderr: 37650K .......... .......... .......... .......... .......... 40% 22.6M 5s 2023-12-03T11:37:13.335 INFO:teuthology.orchestra.run.smithi131.stderr: 37700K .......... .......... .......... .......... .......... 40% 98.0M 5s 2023-12-03T11:37:13.337 INFO:teuthology.orchestra.run.smithi131.stderr: 37750K .......... .......... .......... .......... .......... 40% 31.7M 5s 2023-12-03T11:37:13.339 INFO:teuthology.orchestra.run.smithi131.stderr: 37800K .......... .......... .......... .......... .......... 40% 25.6M 5s 2023-12-03T11:37:13.341 INFO:teuthology.orchestra.run.smithi131.stderr: 37850K .......... .......... .......... .......... .......... 40% 19.0M 5s 2023-12-03T11:37:13.344 INFO:teuthology.orchestra.run.smithi131.stderr: 37900K .......... .......... .......... .......... .......... 40% 22.5M 5s 2023-12-03T11:37:13.344 INFO:teuthology.orchestra.run.smithi131.stderr: 37950K .......... .......... .......... .......... .......... 40% 75.6M 5s 2023-12-03T11:37:13.346 INFO:teuthology.orchestra.run.smithi131.stderr: 38000K .......... .......... .......... .......... .......... 40% 34.8M 5s 2023-12-03T11:37:13.347 INFO:teuthology.orchestra.run.smithi131.stderr: 38050K .......... .......... .......... .......... .......... 41% 26.1M 5s 2023-12-03T11:37:13.351 INFO:teuthology.orchestra.run.smithi131.stderr: 38100K .......... .......... .......... .......... .......... 41% 12.0M 5s 2023-12-03T11:37:13.354 INFO:teuthology.orchestra.run.smithi131.stderr: 38150K .......... .......... .......... .......... .......... 41% 19.5M 5s 2023-12-03T11:37:13.355 INFO:teuthology.orchestra.run.smithi131.stderr: 38200K .......... .......... .......... .......... .......... 41% 50.4M 5s 2023-12-03T11:37:13.356 INFO:teuthology.orchestra.run.smithi131.stderr: 38250K .......... .......... .......... .......... .......... 41% 47.5M 5s 2023-12-03T11:37:13.359 INFO:teuthology.orchestra.run.smithi131.stderr: 38300K .......... .......... .......... .......... .......... 41% 27.4M 5s 2023-12-03T11:37:13.359 INFO:teuthology.orchestra.run.smithi131.stderr: 38350K .......... .......... .......... .......... .......... 41% 53.5M 5s 2023-12-03T11:37:13.362 INFO:teuthology.orchestra.run.smithi131.stderr: 38400K .......... .......... .......... .......... .......... 41% 20.3M 5s 2023-12-03T11:37:13.362 INFO:teuthology.orchestra.run.smithi131.stderr: 38450K .......... .......... .......... .......... .......... 41% 69.7M 5s 2023-12-03T11:37:13.364 INFO:teuthology.orchestra.run.smithi131.stderr: 38500K .......... .......... .......... .......... .......... 41% 28.0M 5s 2023-12-03T11:37:13.367 INFO:teuthology.orchestra.run.smithi131.stderr: 38550K .......... .......... .......... .......... .......... 41% 12.8M 5s 2023-12-03T11:37:13.371 INFO:teuthology.orchestra.run.smithi131.stderr: 38600K .......... .......... .......... .......... .......... 41% 15.1M 5s 2023-12-03T11:37:13.372 INFO:teuthology.orchestra.run.smithi131.stderr: 38650K .......... .......... .......... .......... .......... 41% 27.5M 5s 2023-12-03T11:37:13.375 INFO:teuthology.orchestra.run.smithi131.stderr: 38700K .......... .......... .......... .......... .......... 41% 22.5M 5s 2023-12-03T11:37:13.376 INFO:teuthology.orchestra.run.smithi131.stderr: 38750K .......... .......... .......... .......... .......... 41% 28.9M 5s 2023-12-03T11:37:13.379 INFO:teuthology.orchestra.run.smithi131.stderr: 38800K .......... .......... .......... .......... .......... 41% 16.2M 5s 2023-12-03T11:37:13.394 INFO:teuthology.orchestra.run.smithi131.stderr: 38850K .......... .......... .......... .......... .......... 41% 3.37M 5s 2023-12-03T11:37:13.396 INFO:teuthology.orchestra.run.smithi131.stderr: 38900K .......... .......... .......... .......... .......... 41% 22.8M 5s 2023-12-03T11:37:13.398 INFO:teuthology.orchestra.run.smithi131.stderr: 38950K .......... .......... .......... .......... .......... 41% 19.5M 5s 2023-12-03T11:37:13.403 INFO:teuthology.orchestra.run.smithi131.stderr: 39000K .......... .......... .......... .......... .......... 42% 11.1M 5s 2023-12-03T11:37:13.407 INFO:teuthology.orchestra.run.smithi131.stderr: 39050K .......... .......... .......... .......... .......... 42% 12.3M 5s 2023-12-03T11:37:13.407 INFO:teuthology.orchestra.run.smithi131.stderr: 39100K .......... .......... .......... .......... .......... 42% 75.9M 5s 2023-12-03T11:37:13.409 INFO:teuthology.orchestra.run.smithi131.stderr: 39150K .......... .......... .......... .......... .......... 42% 21.6M 5s 2023-12-03T11:37:13.412 INFO:teuthology.orchestra.run.smithi131.stderr: 39200K .......... .......... .......... .......... .......... 42% 22.5M 5s 2023-12-03T11:37:13.416 INFO:teuthology.orchestra.run.smithi131.stderr: 39250K .......... .......... .......... .......... .......... 42% 11.1M 5s 2023-12-03T11:37:13.419 INFO:teuthology.orchestra.run.smithi131.stderr: 39300K .......... .......... .......... .......... .......... 42% 17.3M 5s 2023-12-03T11:37:13.428 INFO:teuthology.orchestra.run.smithi131.stderr: 39350K .......... .......... .......... .......... .......... 42% 5.44M 5s 2023-12-03T11:37:13.432 INFO:teuthology.orchestra.run.smithi131.stderr: 39400K .......... .......... .......... .......... .......... 42% 10.7M 5s 2023-12-03T11:37:13.435 INFO:teuthology.orchestra.run.smithi131.stderr: 39450K .......... .......... .......... .......... .......... 42% 25.4M 5s 2023-12-03T11:37:13.438 INFO:teuthology.orchestra.run.smithi131.stderr: 39500K .......... .......... .......... .......... .......... 42% 18.3M 5s 2023-12-03T11:37:13.440 INFO:teuthology.orchestra.run.smithi131.stderr: 39550K .......... .......... .......... .......... .......... 42% 20.1M 5s 2023-12-03T11:37:13.440 INFO:teuthology.orchestra.run.smithi131.stderr: 39600K .......... .......... .......... .......... .......... 42% 92.8M 5s 2023-12-03T11:37:13.442 INFO:teuthology.orchestra.run.smithi131.stderr: 39650K .......... .......... .......... .......... .......... 42% 22.9M 5s 2023-12-03T11:37:13.448 INFO:teuthology.orchestra.run.smithi131.stderr: 39700K .......... .......... .......... .......... .......... 42% 9.10M 5s 2023-12-03T11:37:13.450 INFO:teuthology.orchestra.run.smithi131.stderr: 39750K .......... .......... .......... .......... .......... 42% 21.2M 5s 2023-12-03T11:37:13.452 INFO:teuthology.orchestra.run.smithi131.stderr: 39800K .......... .......... .......... .......... .......... 42% 22.7M 4s 2023-12-03T11:37:13.454 INFO:teuthology.orchestra.run.smithi131.stderr: 39850K .......... .......... .......... .......... .......... 42% 22.3M 4s 2023-12-03T11:37:13.458 INFO:teuthology.orchestra.run.smithi131.stderr: 39900K .......... .......... .......... .......... .......... 43% 12.8M 4s 2023-12-03T11:37:13.460 INFO:teuthology.orchestra.run.smithi131.stderr: 39950K .......... .......... .......... .......... .......... 43% 21.9M 4s 2023-12-03T11:37:13.463 INFO:teuthology.orchestra.run.smithi131.stderr: 40000K .......... .......... .......... .......... .......... 43% 17.9M 4s 2023-12-03T11:37:13.465 INFO:teuthology.orchestra.run.smithi131.stderr: 40050K .......... .......... .......... .......... .......... 43% 25.5M 4s 2023-12-03T11:37:13.473 INFO:teuthology.orchestra.run.smithi131.stderr: 40100K .......... .......... .......... .......... .......... 43% 6.49M 4s 2023-12-03T11:37:13.474 INFO:teuthology.orchestra.run.smithi131.stderr: 40150K .......... .......... .......... .......... .......... 43% 25.5M 4s 2023-12-03T11:37:13.477 INFO:teuthology.orchestra.run.smithi131.stderr: 40200K .......... .......... .......... .......... .......... 43% 26.3M 4s 2023-12-03T11:37:13.477 INFO:teuthology.orchestra.run.smithi131.stderr: 40250K .......... .......... .......... .......... .......... 43% 76.0M 4s 2023-12-03T11:37:13.479 INFO:teuthology.orchestra.run.smithi131.stderr: 40300K .......... .......... .......... .......... .......... 43% 26.7M 4s 2023-12-03T11:37:13.481 INFO:teuthology.orchestra.run.smithi131.stderr: 40350K .......... .......... .......... .......... .......... 43% 18.3M 4s 2023-12-03T11:37:13.485 INFO:teuthology.orchestra.run.smithi131.stderr: 40400K .......... .......... .......... .......... .......... 43% 13.7M 4s 2023-12-03T11:37:13.487 INFO:teuthology.orchestra.run.smithi131.stderr: 40450K .......... .......... .......... .......... .......... 43% 26.6M 4s 2023-12-03T11:37:13.490 INFO:teuthology.orchestra.run.smithi131.stderr: 40500K .......... .......... .......... .......... .......... 43% 22.5M 4s 2023-12-03T11:37:13.490 INFO:teuthology.orchestra.run.smithi131.stderr: 40550K .......... .......... .......... .......... .......... 43% 91.2M 4s 2023-12-03T11:37:13.492 INFO:teuthology.orchestra.run.smithi131.stderr: 40600K .......... .......... .......... .......... .......... 43% 24.0M 4s 2023-12-03T11:37:13.495 INFO:teuthology.orchestra.run.smithi131.stderr: 40650K .......... .......... .......... .......... .......... 43% 14.6M 4s 2023-12-03T11:37:13.497 INFO:teuthology.orchestra.run.smithi131.stderr: 40700K .......... .......... .......... .......... .......... 43% 23.2M 4s 2023-12-03T11:37:13.498 INFO:teuthology.orchestra.run.smithi131.stderr: 40750K .......... .......... .......... .......... .......... 43% 38.7M 4s 2023-12-03T11:37:13.501 INFO:teuthology.orchestra.run.smithi131.stderr: 40800K .......... .......... .......... .......... .......... 43% 16.3M 4s 2023-12-03T11:37:13.505 INFO:teuthology.orchestra.run.smithi131.stderr: 40850K .......... .......... .......... .......... .......... 44% 12.8M 4s 2023-12-03T11:37:13.534 INFO:teuthology.orchestra.run.smithi131.stderr: 40900K .......... .......... .......... .......... .......... 44% 1.67M 4s 2023-12-03T11:37:13.539 INFO:teuthology.orchestra.run.smithi131.stderr: 40950K .......... .......... .......... .......... .......... 44% 10.7M 4s 2023-12-03T11:37:13.541 INFO:teuthology.orchestra.run.smithi131.stderr: 41000K .......... .......... .......... .......... .......... 44% 24.8M 4s 2023-12-03T11:37:13.543 INFO:teuthology.orchestra.run.smithi131.stderr: 41050K .......... .......... .......... .......... .......... 44% 30.7M 4s 2023-12-03T11:37:13.545 INFO:teuthology.orchestra.run.smithi131.stderr: 41100K .......... .......... .......... .......... .......... 44% 26.6M 4s 2023-12-03T11:37:13.546 INFO:teuthology.orchestra.run.smithi131.stderr: 41150K .......... .......... .......... .......... .......... 44% 26.6M 4s 2023-12-03T11:37:13.548 INFO:teuthology.orchestra.run.smithi131.stderr: 41200K .......... .......... .......... .......... .......... 44% 31.5M 4s 2023-12-03T11:37:13.549 INFO:teuthology.orchestra.run.smithi131.stderr: 41250K .......... .......... .......... .......... .......... 44% 37.9M 4s 2023-12-03T11:37:13.553 INFO:teuthology.orchestra.run.smithi131.stderr: 41300K .......... .......... .......... .......... .......... 44% 13.2M 4s 2023-12-03T11:37:13.555 INFO:teuthology.orchestra.run.smithi131.stderr: 41350K .......... .......... .......... .......... .......... 44% 20.9M 4s 2023-12-03T11:37:13.557 INFO:teuthology.orchestra.run.smithi131.stderr: 41400K .......... .......... .......... .......... .......... 44% 23.9M 4s 2023-12-03T11:37:13.559 INFO:teuthology.orchestra.run.smithi131.stderr: 41450K .......... .......... .......... .......... .......... 44% 37.4M 4s 2023-12-03T11:37:13.559 INFO:teuthology.orchestra.run.smithi131.stderr: 41500K .......... .......... .......... .......... .......... 44% 68.7M 4s 2023-12-03T11:37:13.562 INFO:teuthology.orchestra.run.smithi131.stderr: 41550K .......... .......... .......... .......... .......... 44% 23.0M 4s 2023-12-03T11:37:13.563 INFO:teuthology.orchestra.run.smithi131.stderr: 41600K .......... .......... .......... .......... .......... 44% 25.1M 4s 2023-12-03T11:37:13.564 INFO:teuthology.orchestra.run.smithi131.stderr: 41650K .......... .......... .......... .......... .......... 44% 90.5M 4s 2023-12-03T11:37:13.566 INFO:teuthology.orchestra.run.smithi131.stderr: 41700K .......... .......... .......... .......... .......... 44% 22.3M 4s 2023-12-03T11:37:13.569 INFO:teuthology.orchestra.run.smithi131.stderr: 41750K .......... .......... .......... .......... .......... 44% 16.7M 4s 2023-12-03T11:37:13.570 INFO:teuthology.orchestra.run.smithi131.stderr: 41800K .......... .......... .......... .......... .......... 45% 34.3M 4s 2023-12-03T11:37:13.572 INFO:teuthology.orchestra.run.smithi131.stderr: 41850K .......... .......... .......... .......... .......... 45% 26.6M 4s 2023-12-03T11:37:13.574 INFO:teuthology.orchestra.run.smithi131.stderr: 41900K .......... .......... .......... .......... .......... 45% 20.7M 4s 2023-12-03T11:37:13.575 INFO:teuthology.orchestra.run.smithi131.stderr: 41950K .......... .......... .......... .......... .......... 45% 49.4M 4s 2023-12-03T11:37:13.579 INFO:teuthology.orchestra.run.smithi131.stderr: 42000K .......... .......... .......... .......... .......... 45% 11.4M 4s 2023-12-03T11:37:13.581 INFO:teuthology.orchestra.run.smithi131.stderr: 42050K .......... .......... .......... .......... .......... 45% 30.9M 4s 2023-12-03T11:37:13.584 INFO:teuthology.orchestra.run.smithi131.stderr: 42100K .......... .......... .......... .......... .......... 45% 25.9M 4s 2023-12-03T11:37:13.584 INFO:teuthology.orchestra.run.smithi131.stderr: 42150K .......... .......... .......... .......... .......... 45% 99.1M 4s 2023-12-03T11:37:13.586 INFO:teuthology.orchestra.run.smithi131.stderr: 42200K .......... .......... .......... .......... .......... 45% 23.5M 4s 2023-12-03T11:37:13.586 INFO:teuthology.orchestra.run.smithi131.stderr: 42250K .......... .......... .......... .......... .......... 45% 68.2M 4s 2023-12-03T11:37:13.589 INFO:teuthology.orchestra.run.smithi131.stderr: 42300K .......... .......... .......... .......... .......... 45% 18.0M 4s 2023-12-03T11:37:13.592 INFO:teuthology.orchestra.run.smithi131.stderr: 42350K .......... .......... .......... .......... .......... 45% 21.3M 4s 2023-12-03T11:37:13.592 INFO:teuthology.orchestra.run.smithi131.stderr: 42400K .......... .......... .......... .......... .......... 45% 74.2M 4s 2023-12-03T11:37:13.594 INFO:teuthology.orchestra.run.smithi131.stderr: 42450K .......... .......... .......... .......... .......... 45% 26.7M 4s 2023-12-03T11:37:13.601 INFO:teuthology.orchestra.run.smithi131.stderr: 42500K .......... .......... .......... .......... .......... 45% 7.36M 4s 2023-12-03T11:37:13.602 INFO:teuthology.orchestra.run.smithi131.stderr: 42550K .......... .......... .......... .......... .......... 45% 31.1M 4s 2023-12-03T11:37:13.603 INFO:teuthology.orchestra.run.smithi131.stderr: 42600K .......... .......... .......... .......... .......... 45% 33.6M 4s 2023-12-03T11:37:13.606 INFO:teuthology.orchestra.run.smithi131.stderr: 42650K .......... .......... .......... .......... .......... 45% 22.1M 4s 2023-12-03T11:37:13.609 INFO:teuthology.orchestra.run.smithi131.stderr: 42700K .......... .......... .......... .......... .......... 46% 12.6M 4s 2023-12-03T11:37:13.623 INFO:teuthology.orchestra.run.smithi131.stderr: 42750K .......... .......... .......... .......... .......... 46% 3.59M 4s 2023-12-03T11:37:13.627 INFO:teuthology.orchestra.run.smithi131.stderr: 42800K .......... .......... .......... .......... .......... 46% 12.6M 4s 2023-12-03T11:37:13.628 INFO:teuthology.orchestra.run.smithi131.stderr: 42850K .......... .......... .......... .......... .......... 46% 34.0M 4s 2023-12-03T11:37:13.635 INFO:teuthology.orchestra.run.smithi131.stderr: 42900K .......... .......... .......... .......... .......... 46% 7.64M 4s 2023-12-03T11:37:13.638 INFO:teuthology.orchestra.run.smithi131.stderr: 42950K .......... .......... .......... .......... .......... 46% 15.7M 4s 2023-12-03T11:37:13.640 INFO:teuthology.orchestra.run.smithi131.stderr: 43000K .......... .......... .......... .......... .......... 46% 28.3M 4s 2023-12-03T11:37:13.643 INFO:teuthology.orchestra.run.smithi131.stderr: 43050K .......... .......... .......... .......... .......... 46% 17.9M 4s 2023-12-03T11:37:13.643 INFO:teuthology.orchestra.run.smithi131.stderr: 43100K .......... .......... .......... .......... .......... 46% 45.6M 4s 2023-12-03T11:37:13.649 INFO:teuthology.orchestra.run.smithi131.stderr: 43150K .......... .......... .......... .......... .......... 46% 8.54M 4s 2023-12-03T11:37:13.652 INFO:teuthology.orchestra.run.smithi131.stderr: 43200K .......... .......... .......... .......... .......... 46% 17.3M 4s 2023-12-03T11:37:13.662 INFO:teuthology.orchestra.run.smithi131.stderr: 43250K .......... .......... .......... .......... .......... 46% 5.03M 4s 2023-12-03T11:37:13.666 INFO:teuthology.orchestra.run.smithi131.stderr: 43300K .......... .......... .......... .......... .......... 46% 11.0M 4s 2023-12-03T11:37:13.667 INFO:teuthology.orchestra.run.smithi131.stderr: 43350K .......... .......... .......... .......... .......... 46% 61.8M 4s 2023-12-03T11:37:13.673 INFO:teuthology.orchestra.run.smithi131.stderr: 43400K .......... .......... .......... .......... .......... 46% 9.54M 4s 2023-12-03T11:37:13.673 INFO:teuthology.orchestra.run.smithi131.stderr: 43450K .......... .......... .......... .......... .......... 46% 125M 4s 2023-12-03T11:37:13.675 INFO:teuthology.orchestra.run.smithi131.stderr: 43500K .......... .......... .......... .......... .......... 46% 31.1M 4s 2023-12-03T11:37:13.675 INFO:teuthology.orchestra.run.smithi131.stderr: 43550K .......... .......... .......... .......... .......... 46% 76.1M 4s 2023-12-03T11:37:13.680 INFO:teuthology.orchestra.run.smithi131.stderr: 43600K .......... .......... .......... .......... .......... 46% 9.61M 4s 2023-12-03T11:37:13.683 INFO:teuthology.orchestra.run.smithi131.stderr: 43650K .......... .......... .......... .......... .......... 47% 18.3M 4s 2023-12-03T11:37:13.684 INFO:teuthology.orchestra.run.smithi131.stderr: 43700K .......... .......... .......... .......... .......... 47% 25.1M 4s 2023-12-03T11:37:13.689 INFO:teuthology.orchestra.run.smithi131.stderr: 43750K .......... .......... .......... .......... .......... 47% 11.3M 4s 2023-12-03T11:37:13.691 INFO:teuthology.orchestra.run.smithi131.stderr: 43800K .......... .......... .......... .......... .......... 47% 23.1M 4s 2023-12-03T11:37:13.694 INFO:teuthology.orchestra.run.smithi131.stderr: 43850K .......... .......... .......... .......... .......... 47% 17.4M 4s 2023-12-03T11:37:13.697 INFO:teuthology.orchestra.run.smithi131.stderr: 43900K .......... .......... .......... .......... .......... 47% 14.3M 4s 2023-12-03T11:37:13.700 INFO:teuthology.orchestra.run.smithi131.stderr: 43950K .......... .......... .......... .......... .......... 47% 18.3M 4s 2023-12-03T11:37:13.705 INFO:teuthology.orchestra.run.smithi131.stderr: 44000K .......... .......... .......... .......... .......... 47% 9.68M 4s 2023-12-03T11:37:13.707 INFO:teuthology.orchestra.run.smithi131.stderr: 44050K .......... .......... .......... .......... .......... 47% 30.3M 4s 2023-12-03T11:37:13.709 INFO:teuthology.orchestra.run.smithi131.stderr: 44100K .......... .......... .......... .......... .......... 47% 26.8M 4s 2023-12-03T11:37:13.711 INFO:teuthology.orchestra.run.smithi131.stderr: 44150K .......... .......... .......... .......... .......... 47% 21.0M 4s 2023-12-03T11:37:13.712 INFO:teuthology.orchestra.run.smithi131.stderr: 44200K .......... .......... .......... .......... .......... 47% 25.6M 4s 2023-12-03T11:37:13.714 INFO:teuthology.orchestra.run.smithi131.stderr: 44250K .......... .......... .......... .......... .......... 47% 45.1M 4s 2023-12-03T11:37:13.717 INFO:teuthology.orchestra.run.smithi131.stderr: 44300K .......... .......... .......... .......... .......... 47% 16.1M 4s 2023-12-03T11:37:13.719 INFO:teuthology.orchestra.run.smithi131.stderr: 44350K .......... .......... .......... .......... .......... 47% 27.3M 4s 2023-12-03T11:37:13.721 INFO:teuthology.orchestra.run.smithi131.stderr: 44400K .......... .......... .......... .......... .......... 47% 26.2M 4s 2023-12-03T11:37:13.723 INFO:teuthology.orchestra.run.smithi131.stderr: 44450K .......... .......... .......... .......... .......... 47% 22.5M 4s 2023-12-03T11:37:13.724 INFO:teuthology.orchestra.run.smithi131.stderr: 44500K .......... .......... .......... .......... .......... 47% 29.3M 4s 2023-12-03T11:37:13.726 INFO:teuthology.orchestra.run.smithi131.stderr: 44550K .......... .......... .......... .......... .......... 48% 24.2M 4s 2023-12-03T11:37:13.729 INFO:teuthology.orchestra.run.smithi131.stderr: 44600K .......... .......... .......... .......... .......... 48% 20.2M 4s 2023-12-03T11:37:13.730 INFO:teuthology.orchestra.run.smithi131.stderr: 44650K .......... .......... .......... .......... .......... 48% 29.7M 4s 2023-12-03T11:37:13.732 INFO:teuthology.orchestra.run.smithi131.stderr: 44700K .......... .......... .......... .......... .......... 48% 36.1M 4s 2023-12-03T11:37:13.735 INFO:teuthology.orchestra.run.smithi131.stderr: 44750K .......... .......... .......... .......... .......... 48% 13.0M 4s 2023-12-03T11:37:13.763 INFO:teuthology.orchestra.run.smithi131.stderr: 44800K .......... .......... .......... .......... .......... 48% 1.88M 4s 2023-12-03T11:37:13.765 INFO:teuthology.orchestra.run.smithi131.stderr: 44850K .......... .......... .......... .......... .......... 48% 12.0M 4s 2023-12-03T11:37:13.767 INFO:teuthology.orchestra.run.smithi131.stderr: 44900K .......... .......... .......... .......... .......... 48% 21.2M 4s 2023-12-03T11:37:13.769 INFO:teuthology.orchestra.run.smithi131.stderr: 44950K .......... .......... .......... .......... .......... 48% 44.4M 4s 2023-12-03T11:37:13.770 INFO:teuthology.orchestra.run.smithi131.stderr: 45000K .......... .......... .......... .......... .......... 48% 29.7M 4s 2023-12-03T11:37:13.772 INFO:teuthology.orchestra.run.smithi131.stderr: 45050K .......... .......... .......... .......... .......... 48% 37.8M 4s 2023-12-03T11:37:13.774 INFO:teuthology.orchestra.run.smithi131.stderr: 45100K .......... .......... .......... .......... .......... 48% 26.4M 4s 2023-12-03T11:37:13.775 INFO:teuthology.orchestra.run.smithi131.stderr: 45150K .......... .......... .......... .......... .......... 48% 25.8M 4s 2023-12-03T11:37:13.777 INFO:teuthology.orchestra.run.smithi131.stderr: 45200K .......... .......... .......... .......... .......... 48% 36.1M 4s 2023-12-03T11:37:13.779 INFO:teuthology.orchestra.run.smithi131.stderr: 45250K .......... .......... .......... .......... .......... 48% 21.5M 4s 2023-12-03T11:37:13.780 INFO:teuthology.orchestra.run.smithi131.stderr: 45300K .......... .......... .......... .......... .......... 48% 41.8M 4s 2023-12-03T11:37:13.783 INFO:teuthology.orchestra.run.smithi131.stderr: 45350K .......... .......... .......... .......... .......... 48% 23.4M 4s 2023-12-03T11:37:13.785 INFO:teuthology.orchestra.run.smithi131.stderr: 45400K .......... .......... .......... .......... .......... 48% 21.4M 4s 2023-12-03T11:37:13.785 INFO:teuthology.orchestra.run.smithi131.stderr: 45450K .......... .......... .......... .......... .......... 48% 54.9M 4s 2023-12-03T11:37:13.788 INFO:teuthology.orchestra.run.smithi131.stderr: 45500K .......... .......... .......... .......... .......... 49% 37.6M 4s 2023-12-03T11:37:13.789 INFO:teuthology.orchestra.run.smithi131.stderr: 45550K .......... .......... .......... .......... .......... 49% 91.1M 4s 2023-12-03T11:37:13.790 INFO:teuthology.orchestra.run.smithi131.stderr: 45600K .......... .......... .......... .......... .......... 49% 22.9M 4s 2023-12-03T11:37:13.791 INFO:teuthology.orchestra.run.smithi131.stderr: 45650K .......... .......... .......... .......... .......... 49% 34.2M 4s 2023-12-03T11:37:13.792 INFO:teuthology.orchestra.run.smithi131.stderr: 45700K .......... .......... .......... .......... .......... 49% 43.8M 4s 2023-12-03T11:37:13.794 INFO:teuthology.orchestra.run.smithi131.stderr: 45750K .......... .......... .......... .......... .......... 49% 23.9M 4s 2023-12-03T11:37:13.796 INFO:teuthology.orchestra.run.smithi131.stderr: 45800K .......... .......... .......... .......... .......... 49% 25.9M 4s 2023-12-03T11:37:13.799 INFO:teuthology.orchestra.run.smithi131.stderr: 45850K .......... .......... .......... .......... .......... 49% 15.9M 4s 2023-12-03T11:37:13.803 INFO:teuthology.orchestra.run.smithi131.stderr: 45900K .......... .......... .......... .......... .......... 49% 33.2M 4s 2023-12-03T11:37:13.803 INFO:teuthology.orchestra.run.smithi131.stderr: 45950K .......... .......... .......... .......... .......... 49% 29.8M 4s 2023-12-03T11:37:13.804 INFO:teuthology.orchestra.run.smithi131.stderr: 46000K .......... .......... .......... .......... .......... 49% 24.0M 4s 2023-12-03T11:37:13.807 INFO:teuthology.orchestra.run.smithi131.stderr: 46050K .......... .......... .......... .......... .......... 49% 39.7M 4s 2023-12-03T11:37:13.807 INFO:teuthology.orchestra.run.smithi131.stderr: 46100K .......... .......... .......... .......... .......... 49% 70.6M 4s 2023-12-03T11:37:13.807 INFO:teuthology.orchestra.run.smithi131.stderr: 46150K .......... .......... .......... .......... .......... 49% 36.9M 4s 2023-12-03T11:37:13.809 INFO:teuthology.orchestra.run.smithi131.stderr: 46200K .......... .......... .......... .......... .......... 49% 24.9M 4s 2023-12-03T11:37:13.811 INFO:teuthology.orchestra.run.smithi131.stderr: 46250K .......... .......... .......... .......... .......... 49% 27.1M 4s 2023-12-03T11:37:13.814 INFO:teuthology.orchestra.run.smithi131.stderr: 46300K .......... .......... .......... .......... .......... 49% 20.3M 4s 2023-12-03T11:37:13.816 INFO:teuthology.orchestra.run.smithi131.stderr: 46350K .......... .......... .......... .......... .......... 49% 20.7M 4s 2023-12-03T11:37:13.819 INFO:teuthology.orchestra.run.smithi131.stderr: 46400K .......... .......... .......... .......... .......... 49% 16.4M 4s 2023-12-03T11:37:13.822 INFO:teuthology.orchestra.run.smithi131.stderr: 46450K .......... .......... .......... .......... .......... 50% 18.4M 4s 2023-12-03T11:37:13.823 INFO:teuthology.orchestra.run.smithi131.stderr: 46500K .......... .......... .......... .......... .......... 50% 35.8M 4s 2023-12-03T11:37:13.825 INFO:teuthology.orchestra.run.smithi131.stderr: 46550K .......... .......... .......... .......... .......... 50% 72.1M 4s 2023-12-03T11:37:13.827 INFO:teuthology.orchestra.run.smithi131.stderr: 46600K .......... .......... .......... .......... .......... 50% 13.6M 4s 2023-12-03T11:37:13.841 INFO:teuthology.orchestra.run.smithi131.stderr: 46650K .......... .......... .......... .......... .......... 50% 3.65M 4s 2023-12-03T11:37:13.842 INFO:teuthology.orchestra.run.smithi131.stderr: 46700K .......... .......... .......... .......... .......... 50% 24.7M 4s 2023-12-03T11:37:13.847 INFO:teuthology.orchestra.run.smithi131.stderr: 46750K .......... .......... .......... .......... .......... 50% 10.3M 4s 2023-12-03T11:37:13.849 INFO:teuthology.orchestra.run.smithi131.stderr: 46800K .......... .......... .......... .......... .......... 50% 21.6M 4s 2023-12-03T11:37:13.853 INFO:teuthology.orchestra.run.smithi131.stderr: 46850K .......... .......... .......... .......... .......... 50% 16.2M 4s 2023-12-03T11:37:13.854 INFO:teuthology.orchestra.run.smithi131.stderr: 46900K .......... .......... .......... .......... .......... 50% 26.6M 4s 2023-12-03T11:37:13.858 INFO:teuthology.orchestra.run.smithi131.stderr: 46950K .......... .......... .......... .......... .......... 50% 23.6M 4s 2023-12-03T11:37:13.861 INFO:teuthology.orchestra.run.smithi131.stderr: 47000K .......... .......... .......... .......... .......... 50% 10.5M 4s 2023-12-03T11:37:13.864 INFO:teuthology.orchestra.run.smithi131.stderr: 47050K .......... .......... .......... .......... .......... 50% 35.6M 4s 2023-12-03T11:37:13.865 INFO:teuthology.orchestra.run.smithi131.stderr: 47100K .......... .......... .......... .......... .......... 50% 16.2M 4s 2023-12-03T11:37:13.874 INFO:teuthology.orchestra.run.smithi131.stderr: 47150K .......... .......... .......... .......... .......... 50% 5.33M 4s 2023-12-03T11:37:13.877 INFO:teuthology.orchestra.run.smithi131.stderr: 47200K .......... .......... .......... .......... .......... 50% 17.7M 4s 2023-12-03T11:37:13.880 INFO:teuthology.orchestra.run.smithi131.stderr: 47250K .......... .......... .......... .......... .......... 50% 20.4M 4s 2023-12-03T11:37:13.882 INFO:teuthology.orchestra.run.smithi131.stderr: 47300K .......... .......... .......... .......... .......... 50% 18.0M 4s 2023-12-03T11:37:13.883 INFO:teuthology.orchestra.run.smithi131.stderr: 47350K .......... .......... .......... .......... .......... 51% 57.5M 4s 2023-12-03T11:37:13.885 INFO:teuthology.orchestra.run.smithi131.stderr: 47400K .......... .......... .......... .......... .......... 51% 42.2M 4s 2023-12-03T11:37:13.887 INFO:teuthology.orchestra.run.smithi131.stderr: 47450K .......... .......... .......... .......... .......... 51% 19.0M 4s 2023-12-03T11:37:13.891 INFO:teuthology.orchestra.run.smithi131.stderr: 47500K .......... .......... .......... .......... .......... 51% 11.8M 4s 2023-12-03T11:37:13.892 INFO:teuthology.orchestra.run.smithi131.stderr: 47550K .......... .......... .......... .......... .......... 51% 54.5M 4s 2023-12-03T11:37:13.894 INFO:teuthology.orchestra.run.smithi131.stderr: 47600K .......... .......... .......... .......... .......... 51% 27.3M 4s 2023-12-03T11:37:13.897 INFO:teuthology.orchestra.run.smithi131.stderr: 47650K .......... .......... .......... .......... .......... 51% 14.7M 4s 2023-12-03T11:37:13.900 INFO:teuthology.orchestra.run.smithi131.stderr: 47700K .......... .......... .......... .......... .......... 51% 14.6M 4s 2023-12-03T11:37:13.903 INFO:teuthology.orchestra.run.smithi131.stderr: 47750K .......... .......... .......... .......... .......... 51% 21.3M 4s 2023-12-03T11:37:13.905 INFO:teuthology.orchestra.run.smithi131.stderr: 47800K .......... .......... .......... .......... .......... 51% 31.3M 4s 2023-12-03T11:37:13.910 INFO:teuthology.orchestra.run.smithi131.stderr: 47850K .......... .......... .......... .......... .......... 51% 8.30M 4s 2023-12-03T11:37:13.913 INFO:teuthology.orchestra.run.smithi131.stderr: 47900K .......... .......... .......... .......... .......... 51% 26.1M 4s 2023-12-03T11:37:13.914 INFO:teuthology.orchestra.run.smithi131.stderr: 47950K .......... .......... .......... .......... .......... 51% 99.4M 4s 2023-12-03T11:37:13.914 INFO:teuthology.orchestra.run.smithi131.stderr: 48000K .......... .......... .......... .......... .......... 51% 24.4M 4s 2023-12-03T11:37:13.917 INFO:teuthology.orchestra.run.smithi131.stderr: 48050K .......... .......... .......... .......... .......... 51% 27.8M 4s 2023-12-03T11:37:13.918 INFO:teuthology.orchestra.run.smithi131.stderr: 48100K .......... .......... .......... .......... .......... 51% 34.4M 4s 2023-12-03T11:37:13.919 INFO:teuthology.orchestra.run.smithi131.stderr: 48150K .......... .......... .......... .......... .......... 51% 27.8M 4s 2023-12-03T11:37:13.922 INFO:teuthology.orchestra.run.smithi131.stderr: 48200K .......... .......... .......... .......... .......... 51% 28.5M 4s 2023-12-03T11:37:13.923 INFO:teuthology.orchestra.run.smithi131.stderr: 48250K .......... .......... .......... .......... .......... 51% 25.7M 4s 2023-12-03T11:37:13.925 INFO:teuthology.orchestra.run.smithi131.stderr: 48300K .......... .......... .......... .......... .......... 52% 24.9M 4s 2023-12-03T11:37:13.926 INFO:teuthology.orchestra.run.smithi131.stderr: 48350K .......... .......... .......... .......... .......... 52% 36.2M 4s 2023-12-03T11:37:13.929 INFO:teuthology.orchestra.run.smithi131.stderr: 48400K .......... .......... .......... .......... .......... 52% 17.8M 4s 2023-12-03T11:37:13.931 INFO:teuthology.orchestra.run.smithi131.stderr: 48450K .......... .......... .......... .......... .......... 52% 54.6M 4s 2023-12-03T11:37:13.932 INFO:teuthology.orchestra.run.smithi131.stderr: 48500K .......... .......... .......... .......... .......... 52% 20.6M 4s 2023-12-03T11:37:13.934 INFO:teuthology.orchestra.run.smithi131.stderr: 48550K .......... .......... .......... .......... .......... 52% 37.6M 4s 2023-12-03T11:37:13.936 INFO:teuthology.orchestra.run.smithi131.stderr: 48600K .......... .......... .......... .......... .......... 52% 21.1M 4s 2023-12-03T11:37:13.938 INFO:teuthology.orchestra.run.smithi131.stderr: 48650K .......... .......... .......... .......... .......... 52% 24.1M 4s 2023-12-03T11:37:13.963 INFO:teuthology.orchestra.run.smithi131.stderr: 48700K .......... .......... .......... .......... .......... 52% 2.20M 4s 2023-12-03T11:37:13.965 INFO:teuthology.orchestra.run.smithi131.stderr: 48750K .......... .......... .......... .......... .......... 52% 11.0M 4s 2023-12-03T11:37:13.966 INFO:teuthology.orchestra.run.smithi131.stderr: 48800K .......... .......... .......... .......... .......... 52% 41.8M 4s 2023-12-03T11:37:13.969 INFO:teuthology.orchestra.run.smithi131.stderr: 48850K .......... .......... .......... .......... .......... 52% 26.3M 4s 2023-12-03T11:37:13.969 INFO:teuthology.orchestra.run.smithi131.stderr: 48900K .......... .......... .......... .......... .......... 52% 101M 3s 2023-12-03T11:37:13.970 INFO:teuthology.orchestra.run.smithi131.stderr: 48950K .......... .......... .......... .......... .......... 52% 33.8M 3s 2023-12-03T11:37:13.972 INFO:teuthology.orchestra.run.smithi131.stderr: 49000K .......... .......... .......... .......... .......... 52% 24.5M 3s 2023-12-03T11:37:13.973 INFO:teuthology.orchestra.run.smithi131.stderr: 49050K .......... .......... .......... .......... .......... 52% 37.5M 3s 2023-12-03T11:37:13.975 INFO:teuthology.orchestra.run.smithi131.stderr: 49100K .......... .......... .......... .......... .......... 52% 22.2M 3s 2023-12-03T11:37:13.976 INFO:teuthology.orchestra.run.smithi131.stderr: 49150K .......... .......... .......... .......... .......... 52% 55.6M 3s 2023-12-03T11:37:13.978 INFO:teuthology.orchestra.run.smithi131.stderr: 49200K .......... .......... .......... .......... .......... 53% 40.6M 3s 2023-12-03T11:37:13.979 INFO:teuthology.orchestra.run.smithi131.stderr: 49250K .......... .......... .......... .......... .......... 53% 23.3M 3s 2023-12-03T11:37:13.982 INFO:teuthology.orchestra.run.smithi131.stderr: 49300K .......... .......... .......... .......... .......... 53% 25.9M 3s 2023-12-03T11:37:13.983 INFO:teuthology.orchestra.run.smithi131.stderr: 49350K .......... .......... .......... .......... .......... 53% 23.3M 3s 2023-12-03T11:37:13.984 INFO:teuthology.orchestra.run.smithi131.stderr: 49400K .......... .......... .......... .......... .......... 53% 53.6M 3s 2023-12-03T11:37:13.987 INFO:teuthology.orchestra.run.smithi131.stderr: 49450K .......... .......... .......... .......... .......... 53% 49.4M 3s 2023-12-03T11:37:13.987 INFO:teuthology.orchestra.run.smithi131.stderr: 49500K .......... .......... .......... .......... .......... 53% 62.0M 3s 2023-12-03T11:37:13.988 INFO:teuthology.orchestra.run.smithi131.stderr: 49550K .......... .......... .......... .......... .......... 53% 35.8M 3s 2023-12-03T11:37:13.990 INFO:teuthology.orchestra.run.smithi131.stderr: 49600K .......... .......... .......... .......... .......... 53% 69.7M 3s 2023-12-03T11:37:13.990 INFO:teuthology.orchestra.run.smithi131.stderr: 49650K .......... .......... .......... .......... .......... 53% 24.9M 3s 2023-12-03T11:37:13.992 INFO:teuthology.orchestra.run.smithi131.stderr: 49700K .......... .......... .......... .......... .......... 53% 28.2M 3s 2023-12-03T11:37:13.994 INFO:teuthology.orchestra.run.smithi131.stderr: 49750K .......... .......... .......... .......... .......... 53% 19.2M 3s 2023-12-03T11:37:13.997 INFO:teuthology.orchestra.run.smithi131.stderr: 49800K .......... .......... .......... .......... .......... 53% 19.0M 3s 2023-12-03T11:37:13.997 INFO:teuthology.orchestra.run.smithi131.stderr: 49850K .......... .......... .......... .......... .......... 53% 90.1M 3s 2023-12-03T11:37:14.000 INFO:teuthology.orchestra.run.smithi131.stderr: 49900K .......... .......... .......... .......... .......... 53% 23.4M 3s 2023-12-03T11:37:14.001 INFO:teuthology.orchestra.run.smithi131.stderr: 49950K .......... .......... .......... .......... .......... 53% 36.3M 3s 2023-12-03T11:37:14.002 INFO:teuthology.orchestra.run.smithi131.stderr: 50000K .......... .......... .......... .......... .......... 53% 42.1M 3s 2023-12-03T11:37:14.007 INFO:teuthology.orchestra.run.smithi131.stderr: 50050K .......... .......... .......... .......... .......... 53% 25.3M 3s 2023-12-03T11:37:14.007 INFO:teuthology.orchestra.run.smithi131.stderr: 50100K .......... .......... .......... .......... .......... 53% 62.5M 3s 2023-12-03T11:37:14.008 INFO:teuthology.orchestra.run.smithi131.stderr: 50150K .......... .......... .......... .......... .......... 54% 21.4M 3s 2023-12-03T11:37:14.010 INFO:teuthology.orchestra.run.smithi131.stderr: 50200K .......... .......... .......... .......... .......... 54% 29.0M 3s 2023-12-03T11:37:14.011 INFO:teuthology.orchestra.run.smithi131.stderr: 50250K .......... .......... .......... .......... .......... 54% 20.8M 3s 2023-12-03T11:37:14.013 INFO:teuthology.orchestra.run.smithi131.stderr: 50300K .......... .......... .......... .......... .......... 54% 18.1M 3s 2023-12-03T11:37:14.017 INFO:teuthology.orchestra.run.smithi131.stderr: 50350K .......... .......... .......... .......... .......... 54% 16.5M 3s 2023-12-03T11:37:14.019 INFO:teuthology.orchestra.run.smithi131.stderr: 50400K .......... .......... .......... .......... .......... 54% 29.8M 3s 2023-12-03T11:37:14.020 INFO:teuthology.orchestra.run.smithi131.stderr: 50450K .......... .......... .......... .......... .......... 54% 24.8M 3s 2023-12-03T11:37:14.024 INFO:teuthology.orchestra.run.smithi131.stderr: 50500K .......... .......... .......... .......... .......... 54% 14.3M 3s 2023-12-03T11:37:14.025 INFO:teuthology.orchestra.run.smithi131.stderr: 50550K .......... .......... .......... .......... .......... 54% 33.4M 3s 2023-12-03T11:37:14.038 INFO:teuthology.orchestra.run.smithi131.stderr: 50600K .......... .......... .......... .......... .......... 54% 3.73M 3s 2023-12-03T11:37:14.044 INFO:teuthology.orchestra.run.smithi131.stderr: 50650K .......... .......... .......... .......... .......... 54% 9.42M 3s 2023-12-03T11:37:14.046 INFO:teuthology.orchestra.run.smithi131.stderr: 50700K .......... .......... .......... .......... .......... 54% 20.2M 3s 2023-12-03T11:37:14.049 INFO:teuthology.orchestra.run.smithi131.stderr: 50750K .......... .......... .......... .......... .......... 54% 20.7M 3s 2023-12-03T11:37:14.049 INFO:teuthology.orchestra.run.smithi131.stderr: 50800K .......... .......... .......... .......... .......... 54% 40.3M 3s 2023-12-03T11:37:14.052 INFO:teuthology.orchestra.run.smithi131.stderr: 50850K .......... .......... .......... .......... .......... 54% 16.3M 3s 2023-12-03T11:37:14.056 INFO:teuthology.orchestra.run.smithi131.stderr: 50900K .......... .......... .......... .......... .......... 54% 13.8M 3s 2023-12-03T11:37:14.060 INFO:teuthology.orchestra.run.smithi131.stderr: 50950K .......... .......... .......... .......... .......... 54% 14.1M 3s 2023-12-03T11:37:14.067 INFO:teuthology.orchestra.run.smithi131.stderr: 51000K .......... .......... .......... .......... .......... 54% 36.5M 3s 2023-12-03T11:37:14.070 INFO:teuthology.orchestra.run.smithi131.stderr: 51050K .......... .......... .......... .......... .......... 55% 5.14M 3s 2023-12-03T11:37:14.074 INFO:teuthology.orchestra.run.smithi131.stderr: 51100K .......... .......... .......... .......... .......... 55% 12.2M 3s 2023-12-03T11:37:14.079 INFO:teuthology.orchestra.run.smithi131.stderr: 51150K .......... .......... .......... .......... .......... 55% 11.7M 3s 2023-12-03T11:37:14.080 INFO:teuthology.orchestra.run.smithi131.stderr: 51200K .......... .......... .......... .......... .......... 55% 38.8M 3s 2023-12-03T11:37:14.080 INFO:teuthology.orchestra.run.smithi131.stderr: 51250K .......... .......... .......... .......... .......... 55% 73.1M 3s 2023-12-03T11:37:14.082 INFO:teuthology.orchestra.run.smithi131.stderr: 51300K .......... .......... .......... .......... .......... 55% 32.2M 3s 2023-12-03T11:37:14.087 INFO:teuthology.orchestra.run.smithi131.stderr: 51350K .......... .......... .......... .......... .......... 55% 11.3M 3s 2023-12-03T11:37:14.092 INFO:teuthology.orchestra.run.smithi131.stderr: 51400K .......... .......... .......... .......... .......... 55% 24.4M 3s 2023-12-03T11:37:14.092 INFO:teuthology.orchestra.run.smithi131.stderr: 51450K .......... .......... .......... .......... .......... 55% 16.3M 3s 2023-12-03T11:37:14.092 INFO:teuthology.orchestra.run.smithi131.stderr: 51500K .......... .......... .......... .......... .......... 55% 60.9M 3s 2023-12-03T11:37:14.097 INFO:teuthology.orchestra.run.smithi131.stderr: 51550K .......... .......... .......... .......... .......... 55% 10.9M 3s 2023-12-03T11:37:14.099 INFO:teuthology.orchestra.run.smithi131.stderr: 51600K .......... .......... .......... .......... .......... 55% 21.9M 3s 2023-12-03T11:37:14.101 INFO:teuthology.orchestra.run.smithi131.stderr: 51650K .......... .......... .......... .......... .......... 55% 25.2M 3s 2023-12-03T11:37:14.104 INFO:teuthology.orchestra.run.smithi131.stderr: 51700K .......... .......... .......... .......... .......... 55% 15.9M 3s 2023-12-03T11:37:14.108 INFO:teuthology.orchestra.run.smithi131.stderr: 51750K .......... .......... .......... .......... .......... 55% 12.4M 3s 2023-12-03T11:37:14.110 INFO:teuthology.orchestra.run.smithi131.stderr: 51800K .......... .......... .......... .......... .......... 55% 25.0M 3s 2023-12-03T11:37:14.112 INFO:teuthology.orchestra.run.smithi131.stderr: 51850K .......... .......... .......... .......... .......... 55% 30.9M 3s 2023-12-03T11:37:14.114 INFO:teuthology.orchestra.run.smithi131.stderr: 51900K .......... .......... .......... .......... .......... 55% 22.7M 3s 2023-12-03T11:37:14.114 INFO:teuthology.orchestra.run.smithi131.stderr: 51950K .......... .......... .......... .......... .......... 55% 58.5M 3s 2023-12-03T11:37:14.116 INFO:teuthology.orchestra.run.smithi131.stderr: 52000K .......... .......... .......... .......... .......... 56% 31.9M 3s 2023-12-03T11:37:14.117 INFO:teuthology.orchestra.run.smithi131.stderr: 52050K .......... .......... .......... .......... .......... 56% 27.2M 3s 2023-12-03T11:37:14.121 INFO:teuthology.orchestra.run.smithi131.stderr: 52100K .......... .......... .......... .......... .......... 56% 15.1M 3s 2023-12-03T11:37:14.123 INFO:teuthology.orchestra.run.smithi131.stderr: 52150K .......... .......... .......... .......... .......... 56% 30.3M 3s 2023-12-03T11:37:14.123 INFO:teuthology.orchestra.run.smithi131.stderr: 52200K .......... .......... .......... .......... .......... 56% 51.3M 3s 2023-12-03T11:37:14.125 INFO:teuthology.orchestra.run.smithi131.stderr: 52250K .......... .......... .......... .......... .......... 56% 34.1M 3s 2023-12-03T11:37:14.128 INFO:teuthology.orchestra.run.smithi131.stderr: 52300K .......... .......... .......... .......... .......... 56% 14.8M 3s 2023-12-03T11:37:14.130 INFO:teuthology.orchestra.run.smithi131.stderr: 52350K .......... .......... .......... .......... .......... 56% 30.9M 3s 2023-12-03T11:37:14.132 INFO:teuthology.orchestra.run.smithi131.stderr: 52400K .......... .......... .......... .......... .......... 56% 24.5M 3s 2023-12-03T11:37:14.132 INFO:teuthology.orchestra.run.smithi131.stderr: 52450K .......... .......... .......... .......... .......... 56% 65.3M 3s 2023-12-03T11:37:14.134 INFO:teuthology.orchestra.run.smithi131.stderr: 52500K .......... .......... .......... .......... .......... 56% 28.5M 3s 2023-12-03T11:37:14.157 INFO:teuthology.orchestra.run.smithi131.stderr: 52550K .......... .......... .......... .......... .......... 56% 2.18M 3s 2023-12-03T11:37:14.159 INFO:teuthology.orchestra.run.smithi131.stderr: 52600K .......... .......... .......... .......... .......... 56% 16.5M 3s 2023-12-03T11:37:14.162 INFO:teuthology.orchestra.run.smithi131.stderr: 52650K .......... .......... .......... .......... .......... 56% 19.5M 3s 2023-12-03T11:37:14.163 INFO:teuthology.orchestra.run.smithi131.stderr: 52700K .......... .......... .......... .......... .......... 56% 41.7M 3s 2023-12-03T11:37:14.164 INFO:teuthology.orchestra.run.smithi131.stderr: 52750K .......... .......... .......... .......... .......... 56% 42.3M 3s 2023-12-03T11:37:14.166 INFO:teuthology.orchestra.run.smithi131.stderr: 52800K .......... .......... .......... .......... .......... 56% 33.4M 3s 2023-12-03T11:37:14.168 INFO:teuthology.orchestra.run.smithi131.stderr: 52850K .......... .......... .......... .......... .......... 56% 25.2M 3s 2023-12-03T11:37:14.168 INFO:teuthology.orchestra.run.smithi131.stderr: 52900K .......... .......... .......... .......... .......... 56% 125M 3s 2023-12-03T11:37:14.170 INFO:teuthology.orchestra.run.smithi131.stderr: 52950K .......... .......... .......... .......... .......... 57% 25.5M 3s 2023-12-03T11:37:14.172 INFO:teuthology.orchestra.run.smithi131.stderr: 53000K .......... .......... .......... .......... .......... 57% 21.5M 3s 2023-12-03T11:37:14.174 INFO:teuthology.orchestra.run.smithi131.stderr: 53050K .......... .......... .......... .......... .......... 57% 34.2M 3s 2023-12-03T11:37:14.174 INFO:teuthology.orchestra.run.smithi131.stderr: 53100K .......... .......... .......... .......... .......... 57% 87.8M 3s 2023-12-03T11:37:14.176 INFO:teuthology.orchestra.run.smithi131.stderr: 53150K .......... .......... .......... .......... .......... 57% 27.2M 3s 2023-12-03T11:37:14.178 INFO:teuthology.orchestra.run.smithi131.stderr: 53200K .......... .......... .......... .......... .......... 57% 25.9M 3s 2023-12-03T11:37:14.182 INFO:teuthology.orchestra.run.smithi131.stderr: 53250K .......... .......... .......... .......... .......... 57% 17.2M 3s 2023-12-03T11:37:14.182 INFO:teuthology.orchestra.run.smithi131.stderr: 53300K .......... .......... .......... .......... .......... 57% 58.0M 3s 2023-12-03T11:37:14.182 INFO:teuthology.orchestra.run.smithi131.stderr: 53350K .......... .......... .......... .......... .......... 57% 72.8M 3s 2023-12-03T11:37:14.186 INFO:teuthology.orchestra.run.smithi131.stderr: 53400K .......... .......... .......... .......... .......... 57% 72.7M 3s 2023-12-03T11:37:14.186 INFO:teuthology.orchestra.run.smithi131.stderr: 53450K .......... .......... .......... .......... .......... 57% 31.4M 3s 2023-12-03T11:37:14.187 INFO:teuthology.orchestra.run.smithi131.stderr: 53500K .......... .......... .......... .......... .......... 57% 25.3M 3s 2023-12-03T11:37:14.189 INFO:teuthology.orchestra.run.smithi131.stderr: 53550K .......... .......... .......... .......... .......... 57% 23.8M 3s 2023-12-03T11:37:14.189 INFO:teuthology.orchestra.run.smithi131.stderr: 53600K .......... .......... .......... .......... .......... 57% 68.1M 3s 2023-12-03T11:37:14.192 INFO:teuthology.orchestra.run.smithi131.stderr: 53650K .......... .......... .......... .......... .......... 57% 17.6M 3s 2023-12-03T11:37:14.194 INFO:teuthology.orchestra.run.smithi131.stderr: 53700K .......... .......... .......... .......... .......... 57% 26.9M 3s 2023-12-03T11:37:14.196 INFO:teuthology.orchestra.run.smithi131.stderr: 53750K .......... .......... .......... .......... .......... 57% 26.1M 3s 2023-12-03T11:37:14.198 INFO:teuthology.orchestra.run.smithi131.stderr: 53800K .......... .......... .......... .......... .......... 57% 25.6M 3s 2023-12-03T11:37:14.198 INFO:teuthology.orchestra.run.smithi131.stderr: 53850K .......... .......... .......... .......... .......... 58% 86.8M 3s 2023-12-03T11:37:14.199 INFO:teuthology.orchestra.run.smithi131.stderr: 53900K .......... .......... .......... .......... .......... 58% 46.0M 3s 2023-12-03T11:37:14.201 INFO:teuthology.orchestra.run.smithi131.stderr: 53950K .......... .......... .......... .......... .......... 58% 25.4M 3s 2023-12-03T11:37:14.203 INFO:teuthology.orchestra.run.smithi131.stderr: 54000K .......... .......... .......... .......... .......... 58% 23.6M 3s 2023-12-03T11:37:14.204 INFO:teuthology.orchestra.run.smithi131.stderr: 54050K .......... .......... .......... .......... .......... 58% 47.6M 3s 2023-12-03T11:37:14.207 INFO:teuthology.orchestra.run.smithi131.stderr: 54100K .......... .......... .......... .......... .......... 58% 24.4M 3s 2023-12-03T11:37:14.210 INFO:teuthology.orchestra.run.smithi131.stderr: 54150K .......... .......... .......... .......... .......... 58% 13.2M 3s 2023-12-03T11:37:14.212 INFO:teuthology.orchestra.run.smithi131.stderr: 54200K .......... .......... .......... .......... .......... 58% 20.5M 3s 2023-12-03T11:37:14.215 INFO:teuthology.orchestra.run.smithi131.stderr: 54250K .......... .......... .......... .......... .......... 58% 17.1M 3s 2023-12-03T11:37:14.216 INFO:teuthology.orchestra.run.smithi131.stderr: 54300K .......... .......... .......... .......... .......... 58% 59.1M 3s 2023-12-03T11:37:14.219 INFO:teuthology.orchestra.run.smithi131.stderr: 54350K .......... .......... .......... .......... .......... 58% 16.9M 3s 2023-12-03T11:37:14.221 INFO:teuthology.orchestra.run.smithi131.stderr: 54400K .......... .......... .......... .......... .......... 58% 24.0M 3s 2023-12-03T11:37:14.234 INFO:teuthology.orchestra.run.smithi131.stderr: 54450K .......... .......... .......... .......... .......... 58% 3.67M 3s 2023-12-03T11:37:14.255 INFO:teuthology.orchestra.run.smithi131.stderr: 54500K .......... .......... .......... .......... .......... 58% 2.38M 3s 2023-12-03T11:37:14.258 INFO:teuthology.orchestra.run.smithi131.stderr: 54550K .......... .......... .......... .......... .......... 58% 18.3M 3s 2023-12-03T11:37:14.260 INFO:teuthology.orchestra.run.smithi131.stderr: 54600K .......... .......... .......... .......... .......... 58% 18.2M 3s 2023-12-03T11:37:14.262 INFO:teuthology.orchestra.run.smithi131.stderr: 54650K .......... .......... .......... .......... .......... 58% 28.5M 3s 2023-12-03T11:37:14.264 INFO:teuthology.orchestra.run.smithi131.stderr: 54700K .......... .......... .......... .......... .......... 58% 19.4M 3s 2023-12-03T11:37:14.269 INFO:teuthology.orchestra.run.smithi131.stderr: 54750K .......... .......... .......... .......... .......... 58% 10.9M 3s 2023-12-03T11:37:14.270 INFO:teuthology.orchestra.run.smithi131.stderr: 54800K .......... .......... .......... .......... .......... 59% 36.8M 3s 2023-12-03T11:37:14.274 INFO:teuthology.orchestra.run.smithi131.stderr: 54850K .......... .......... .......... .......... .......... 59% 14.6M 3s 2023-12-03T11:37:14.283 INFO:teuthology.orchestra.run.smithi131.stderr: 54900K .......... .......... .......... .......... .......... 59% 5.29M 3s 2023-12-03T11:37:14.286 INFO:teuthology.orchestra.run.smithi131.stderr: 54950K .......... .......... .......... .......... .......... 59% 14.3M 3s 2023-12-03T11:37:14.291 INFO:teuthology.orchestra.run.smithi131.stderr: 55000K .......... .......... .......... .......... .......... 59% 10.3M 3s 2023-12-03T11:37:14.295 INFO:teuthology.orchestra.run.smithi131.stderr: 55050K .......... .......... .......... .......... .......... 59% 12.7M 3s 2023-12-03T11:37:14.296 INFO:teuthology.orchestra.run.smithi131.stderr: 55100K .......... .......... .......... .......... .......... 59% 33.9M 3s 2023-12-03T11:37:14.298 INFO:teuthology.orchestra.run.smithi131.stderr: 55150K .......... .......... .......... .......... .......... 59% 31.8M 3s 2023-12-03T11:37:14.298 INFO:teuthology.orchestra.run.smithi131.stderr: 55200K .......... .......... .......... .......... .......... 59% 78.4M 3s 2023-12-03T11:37:14.302 INFO:teuthology.orchestra.run.smithi131.stderr: 55250K .......... .......... .......... .......... .......... 59% 11.7M 3s 2023-12-03T11:37:14.307 INFO:teuthology.orchestra.run.smithi131.stderr: 55300K .......... .......... .......... .......... .......... 59% 10.9M 3s 2023-12-03T11:37:14.308 INFO:teuthology.orchestra.run.smithi131.stderr: 55350K .......... .......... .......... .......... .......... 59% 43.6M 3s 2023-12-03T11:37:14.311 INFO:teuthology.orchestra.run.smithi131.stderr: 55400K .......... .......... .......... .......... .......... 59% 16.2M 3s 2023-12-03T11:37:14.313 INFO:teuthology.orchestra.run.smithi131.stderr: 55450K .......... .......... .......... .......... .......... 59% 24.0M 3s 2023-12-03T11:37:14.316 INFO:teuthology.orchestra.run.smithi131.stderr: 55500K .......... .......... .......... .......... .......... 59% 19.0M 3s 2023-12-03T11:37:14.319 INFO:teuthology.orchestra.run.smithi131.stderr: 55550K .......... .......... .......... .......... .......... 59% 17.0M 3s 2023-12-03T11:37:14.320 INFO:teuthology.orchestra.run.smithi131.stderr: 55600K .......... .......... .......... .......... .......... 59% 22.1M 3s 2023-12-03T11:37:14.327 INFO:teuthology.orchestra.run.smithi131.stderr: 55650K .......... .......... .......... .......... .......... 59% 8.73M 3s 2023-12-03T11:37:14.327 INFO:teuthology.orchestra.run.smithi131.stderr: 55700K .......... .......... .......... .......... .......... 60% 90.1M 3s 2023-12-03T11:37:14.329 INFO:teuthology.orchestra.run.smithi131.stderr: 55750K .......... .......... .......... .......... .......... 60% 27.7M 3s 2023-12-03T11:37:14.331 INFO:teuthology.orchestra.run.smithi131.stderr: 55800K .......... .......... .......... .......... .......... 60% 18.6M 3s 2023-12-03T11:37:14.334 INFO:teuthology.orchestra.run.smithi131.stderr: 55850K .......... .......... .......... .......... .......... 60% 28.7M 3s 2023-12-03T11:37:14.336 INFO:teuthology.orchestra.run.smithi131.stderr: 55900K .......... .......... .......... .......... .......... 60% 25.6M 3s 2023-12-03T11:37:14.336 INFO:teuthology.orchestra.run.smithi131.stderr: 55950K .......... .......... .......... .......... .......... 60% 97.5M 3s 2023-12-03T11:37:14.339 INFO:teuthology.orchestra.run.smithi131.stderr: 56000K .......... .......... .......... .......... .......... 60% 12.2M 3s 2023-12-03T11:37:14.341 INFO:teuthology.orchestra.run.smithi131.stderr: 56050K .......... .......... .......... .......... .......... 60% 43.5M 3s 2023-12-03T11:37:14.343 INFO:teuthology.orchestra.run.smithi131.stderr: 56100K .......... .......... .......... .......... .......... 60% 23.1M 3s 2023-12-03T11:37:14.345 INFO:teuthology.orchestra.run.smithi131.stderr: 56150K .......... .......... .......... .......... .......... 60% 18.2M 3s 2023-12-03T11:37:14.347 INFO:teuthology.orchestra.run.smithi131.stderr: 56200K .......... .......... .......... .......... .......... 60% 37.7M 3s 2023-12-03T11:37:14.348 INFO:teuthology.orchestra.run.smithi131.stderr: 56250K .......... .......... .......... .......... .......... 60% 33.0M 3s 2023-12-03T11:37:14.350 INFO:teuthology.orchestra.run.smithi131.stderr: 56300K .......... .......... .......... .......... .......... 60% 25.5M 3s 2023-12-03T11:37:14.353 INFO:teuthology.orchestra.run.smithi131.stderr: 56350K .......... .......... .......... .......... .......... 60% 21.2M 3s 2023-12-03T11:37:14.354 INFO:teuthology.orchestra.run.smithi131.stderr: 56400K .......... .......... .......... .......... .......... 60% 30.6M 3s 2023-12-03T11:37:14.375 INFO:teuthology.orchestra.run.smithi131.stderr: 56450K .......... .......... .......... .......... .......... 60% 2.26M 3s 2023-12-03T11:37:14.380 INFO:teuthology.orchestra.run.smithi131.stderr: 56500K .......... .......... .......... .......... .......... 60% 11.3M 3s 2023-12-03T11:37:14.382 INFO:teuthology.orchestra.run.smithi131.stderr: 56550K .......... .......... .......... .......... .......... 60% 29.4M 3s 2023-12-03T11:37:14.384 INFO:teuthology.orchestra.run.smithi131.stderr: 56600K .......... .......... .......... .......... .......... 60% 22.1M 3s 2023-12-03T11:37:14.385 INFO:teuthology.orchestra.run.smithi131.stderr: 56650K .......... .......... .......... .......... .......... 61% 68.5M 3s 2023-12-03T11:37:14.386 INFO:teuthology.orchestra.run.smithi131.stderr: 56700K .......... .......... .......... .......... .......... 61% 30.7M 3s 2023-12-03T11:37:14.388 INFO:teuthology.orchestra.run.smithi131.stderr: 56750K .......... .......... .......... .......... .......... 61% 25.4M 3s 2023-12-03T11:37:14.391 INFO:teuthology.orchestra.run.smithi131.stderr: 56800K .......... .......... .......... .......... .......... 61% 24.7M 3s 2023-12-03T11:37:14.393 INFO:teuthology.orchestra.run.smithi131.stderr: 56850K .......... .......... .......... .......... .......... 61% 19.3M 3s 2023-12-03T11:37:14.393 INFO:teuthology.orchestra.run.smithi131.stderr: 56900K .......... .......... .......... .......... .......... 61% 128M 3s 2023-12-03T11:37:14.395 INFO:teuthology.orchestra.run.smithi131.stderr: 56950K .......... .......... .......... .......... .......... 61% 19.2M 3s 2023-12-03T11:37:14.397 INFO:teuthology.orchestra.run.smithi131.stderr: 57000K .......... .......... .......... .......... .......... 61% 30.9M 3s 2023-12-03T11:37:14.400 INFO:teuthology.orchestra.run.smithi131.stderr: 57050K .......... .......... .......... .......... .......... 61% 22.2M 3s 2023-12-03T11:37:14.400 INFO:teuthology.orchestra.run.smithi131.stderr: 57100K .......... .......... .......... .......... .......... 61% 91.7M 3s 2023-12-03T11:37:14.403 INFO:teuthology.orchestra.run.smithi131.stderr: 57150K .......... .......... .......... .......... .......... 61% 17.2M 3s 2023-12-03T11:37:14.408 INFO:teuthology.orchestra.run.smithi131.stderr: 57200K .......... .......... .......... .......... .......... 61% 23.5M 3s 2023-12-03T11:37:14.408 INFO:teuthology.orchestra.run.smithi131.stderr: 57250K .......... .......... .......... .......... .......... 61% 94.4M 3s 2023-12-03T11:37:14.408 INFO:teuthology.orchestra.run.smithi131.stderr: 57300K .......... .......... .......... .......... .......... 61% 79.7M 3s 2023-12-03T11:37:14.408 INFO:teuthology.orchestra.run.smithi131.stderr: 57350K .......... .......... .......... .......... .......... 61% 31.4M 3s 2023-12-03T11:37:14.409 INFO:teuthology.orchestra.run.smithi131.stderr: 57400K .......... .......... .......... .......... .......... 61% 26.7M 3s 2023-12-03T11:37:14.412 INFO:teuthology.orchestra.run.smithi131.stderr: 57450K .......... .......... .......... .......... .......... 61% 20.9M 3s 2023-12-03T11:37:14.414 INFO:teuthology.orchestra.run.smithi131.stderr: 57500K .......... .......... .......... .......... .......... 61% 24.7M 3s 2023-12-03T11:37:14.416 INFO:teuthology.orchestra.run.smithi131.stderr: 57550K .......... .......... .......... .......... .......... 62% 31.0M 3s 2023-12-03T11:37:14.417 INFO:teuthology.orchestra.run.smithi131.stderr: 57600K .......... .......... .......... .......... .......... 62% 25.3M 3s 2023-12-03T11:37:14.419 INFO:teuthology.orchestra.run.smithi131.stderr: 57650K .......... .......... .......... .......... .......... 62% 21.5M 3s 2023-12-03T11:37:14.421 INFO:teuthology.orchestra.run.smithi131.stderr: 57700K .......... .......... .......... .......... .......... 62% 27.6M 3s 2023-12-03T11:37:14.423 INFO:teuthology.orchestra.run.smithi131.stderr: 57750K .......... .......... .......... .......... .......... 62% 33.7M 3s 2023-12-03T11:37:14.423 INFO:teuthology.orchestra.run.smithi131.stderr: 57800K .......... .......... .......... .......... .......... 62% 60.1M 3s 2023-12-03T11:37:14.425 INFO:teuthology.orchestra.run.smithi131.stderr: 57850K .......... .......... .......... .......... .......... 62% 25.4M 3s 2023-12-03T11:37:14.427 INFO:teuthology.orchestra.run.smithi131.stderr: 57900K .......... .......... .......... .......... .......... 62% 27.1M 3s 2023-12-03T11:37:14.431 INFO:teuthology.orchestra.run.smithi131.stderr: 57950K .......... .......... .......... .......... .......... 62% 14.8M 3s 2023-12-03T11:37:14.433 INFO:teuthology.orchestra.run.smithi131.stderr: 58000K .......... .......... .......... .......... .......... 62% 21.4M 3s 2023-12-03T11:37:14.434 INFO:teuthology.orchestra.run.smithi131.stderr: 58050K .......... .......... .......... .......... .......... 62% 25.2M 3s 2023-12-03T11:37:14.439 INFO:teuthology.orchestra.run.smithi131.stderr: 58100K .......... .......... .......... .......... .......... 62% 12.2M 3s 2023-12-03T11:37:14.441 INFO:teuthology.orchestra.run.smithi131.stderr: 58150K .......... .......... .......... .......... .......... 62% 16.2M 3s 2023-12-03T11:37:14.445 INFO:teuthology.orchestra.run.smithi131.stderr: 58200K .......... .......... .......... .......... .......... 62% 15.7M 3s 2023-12-03T11:37:14.447 INFO:teuthology.orchestra.run.smithi131.stderr: 58250K .......... .......... .......... .......... .......... 62% 18.5M 3s 2023-12-03T11:37:14.452 INFO:teuthology.orchestra.run.smithi131.stderr: 58300K .......... .......... .......... .......... .......... 62% 9.65M 3s 2023-12-03T11:37:14.475 INFO:teuthology.orchestra.run.smithi131.stderr: 58350K .......... .......... .......... .......... .......... 62% 2.15M 3s 2023-12-03T11:37:14.485 INFO:teuthology.orchestra.run.smithi131.stderr: 58400K .......... .......... .......... .......... .......... 62% 5.04M 3s 2023-12-03T11:37:14.489 INFO:teuthology.orchestra.run.smithi131.stderr: 58450K .......... .......... .......... .......... .......... 62% 11.8M 3s 2023-12-03T11:37:14.491 INFO:teuthology.orchestra.run.smithi131.stderr: 58500K .......... .......... .......... .......... .......... 63% 23.4M 3s 2023-12-03T11:37:14.494 INFO:teuthology.orchestra.run.smithi131.stderr: 58550K .......... .......... .......... .......... .......... 63% 16.9M 3s 2023-12-03T11:37:14.495 INFO:teuthology.orchestra.run.smithi131.stderr: 58600K .......... .......... .......... .......... .......... 63% 37.7M 3s 2023-12-03T11:37:14.499 INFO:teuthology.orchestra.run.smithi131.stderr: 58650K .......... .......... .......... .......... .......... 63% 11.0M 3s 2023-12-03T11:37:14.503 INFO:teuthology.orchestra.run.smithi131.stderr: 58700K .......... .......... .......... .......... .......... 63% 13.5M 3s 2023-12-03T11:37:14.505 INFO:teuthology.orchestra.run.smithi131.stderr: 58750K .......... .......... .......... .......... .......... 63% 28.2M 3s 2023-12-03T11:37:14.516 INFO:teuthology.orchestra.run.smithi131.stderr: 58800K .......... .......... .......... .......... .......... 63% 4.57M 3s 2023-12-03T11:37:14.517 INFO:teuthology.orchestra.run.smithi131.stderr: 58850K .......... .......... .......... .......... .......... 63% 27.6M 3s 2023-12-03T11:37:14.523 INFO:teuthology.orchestra.run.smithi131.stderr: 58900K .......... .......... .......... .......... .......... 63% 8.24M 3s 2023-12-03T11:37:14.527 INFO:teuthology.orchestra.run.smithi131.stderr: 58950K .......... .......... .......... .......... .......... 63% 12.6M 3s 2023-12-03T11:37:14.528 INFO:teuthology.orchestra.run.smithi131.stderr: 59000K .......... .......... .......... .......... .......... 63% 54.2M 3s 2023-12-03T11:37:14.529 INFO:teuthology.orchestra.run.smithi131.stderr: 59050K .......... .......... .......... .......... .......... 63% 48.2M 3s 2023-12-03T11:37:14.531 INFO:teuthology.orchestra.run.smithi131.stderr: 59100K .......... .......... .......... .......... .......... 63% 20.4M 3s 2023-12-03T11:37:14.535 INFO:teuthology.orchestra.run.smithi131.stderr: 59150K .......... .......... .......... .......... .......... 63% 12.9M 3s 2023-12-03T11:37:14.539 INFO:teuthology.orchestra.run.smithi131.stderr: 59200K .......... .......... .......... .......... .......... 63% 13.9M 3s 2023-12-03T11:37:14.539 INFO:teuthology.orchestra.run.smithi131.stderr: 59250K .......... .......... .......... .......... .......... 63% 84.0M 3s 2023-12-03T11:37:14.544 INFO:teuthology.orchestra.run.smithi131.stderr: 59300K .......... .......... .......... .......... .......... 63% 12.1M 3s 2023-12-03T11:37:14.545 INFO:teuthology.orchestra.run.smithi131.stderr: 59350K .......... .......... .......... .......... .......... 63% 24.6M 3s 2023-12-03T11:37:14.548 INFO:teuthology.orchestra.run.smithi131.stderr: 59400K .......... .......... .......... .......... .......... 63% 18.2M 3s 2023-12-03T11:37:14.549 INFO:teuthology.orchestra.run.smithi131.stderr: 59450K .......... .......... .......... .......... .......... 64% 39.0M 3s 2023-12-03T11:37:14.552 INFO:teuthology.orchestra.run.smithi131.stderr: 59500K .......... .......... .......... .......... .......... 64% 18.7M 3s 2023-12-03T11:37:14.557 INFO:teuthology.orchestra.run.smithi131.stderr: 59550K .......... .......... .......... .......... .......... 64% 10.1M 3s 2023-12-03T11:37:14.559 INFO:teuthology.orchestra.run.smithi131.stderr: 59600K .......... .......... .......... .......... .......... 64% 26.2M 2s 2023-12-03T11:37:14.561 INFO:teuthology.orchestra.run.smithi131.stderr: 59650K .......... .......... .......... .......... .......... 64% 61.3M 2s 2023-12-03T11:37:14.562 INFO:teuthology.orchestra.run.smithi131.stderr: 59700K .......... .......... .......... .......... .......... 64% 20.3M 2s 2023-12-03T11:37:14.563 INFO:teuthology.orchestra.run.smithi131.stderr: 59750K .......... .......... .......... .......... .......... 64% 27.7M 2s 2023-12-03T11:37:14.566 INFO:teuthology.orchestra.run.smithi131.stderr: 59800K .......... .......... .......... .......... .......... 64% 23.3M 2s 2023-12-03T11:37:14.568 INFO:teuthology.orchestra.run.smithi131.stderr: 59850K .......... .......... .......... .......... .......... 64% 22.8M 2s 2023-12-03T11:37:14.569 INFO:teuthology.orchestra.run.smithi131.stderr: 59900K .......... .......... .......... .......... .......... 64% 29.4M 2s 2023-12-03T11:37:14.571 INFO:teuthology.orchestra.run.smithi131.stderr: 59950K .......... .......... .......... .......... .......... 64% 38.0M 2s 2023-12-03T11:37:14.573 INFO:teuthology.orchestra.run.smithi131.stderr: 60000K .......... .......... .......... .......... .......... 64% 22.5M 2s 2023-12-03T11:37:14.575 INFO:teuthology.orchestra.run.smithi131.stderr: 60050K .......... .......... .......... .......... .......... 64% 21.8M 2s 2023-12-03T11:37:14.578 INFO:teuthology.orchestra.run.smithi131.stderr: 60100K .......... .......... .......... .......... .......... 64% 19.7M 2s 2023-12-03T11:37:14.579 INFO:teuthology.orchestra.run.smithi131.stderr: 60150K .......... .......... .......... .......... .......... 64% 80.4M 2s 2023-12-03T11:37:14.580 INFO:teuthology.orchestra.run.smithi131.stderr: 60200K .......... .......... .......... .......... .......... 64% 21.9M 2s 2023-12-03T11:37:14.583 INFO:teuthology.orchestra.run.smithi131.stderr: 60250K .......... .......... .......... .......... .......... 64% 27.5M 2s 2023-12-03T11:37:14.601 INFO:teuthology.orchestra.run.smithi131.stderr: 60300K .......... .......... .......... .......... .......... 64% 2.61M 2s 2023-12-03T11:37:14.605 INFO:teuthology.orchestra.run.smithi131.stderr: 60350K .......... .......... .......... .......... .......... 65% 11.1M 2s 2023-12-03T11:37:14.607 INFO:teuthology.orchestra.run.smithi131.stderr: 60400K .......... .......... .......... .......... .......... 65% 38.7M 2s 2023-12-03T11:37:14.609 INFO:teuthology.orchestra.run.smithi131.stderr: 60450K .......... .......... .......... .......... .......... 65% 29.8M 2s 2023-12-03T11:37:14.610 INFO:teuthology.orchestra.run.smithi131.stderr: 60500K .......... .......... .......... .......... .......... 65% 26.6M 2s 2023-12-03T11:37:14.612 INFO:teuthology.orchestra.run.smithi131.stderr: 60550K .......... .......... .......... .......... .......... 65% 22.0M 2s 2023-12-03T11:37:14.613 INFO:teuthology.orchestra.run.smithi131.stderr: 60600K .......... .......... .......... .......... .......... 65% 72.2M 2s 2023-12-03T11:37:14.615 INFO:teuthology.orchestra.run.smithi131.stderr: 60650K .......... .......... .......... .......... .......... 65% 27.2M 2s 2023-12-03T11:37:14.617 INFO:teuthology.orchestra.run.smithi131.stderr: 60700K .......... .......... .......... .......... .......... 65% 25.1M 2s 2023-12-03T11:37:14.619 INFO:teuthology.orchestra.run.smithi131.stderr: 60750K .......... .......... .......... .......... .......... 65% 28.1M 2s 2023-12-03T11:37:14.621 INFO:teuthology.orchestra.run.smithi131.stderr: 60800K .......... .......... .......... .......... .......... 65% 21.6M 2s 2023-12-03T11:37:14.622 INFO:teuthology.orchestra.run.smithi131.stderr: 60850K .......... .......... .......... .......... .......... 65% 42.9M 2s 2023-12-03T11:37:14.623 INFO:teuthology.orchestra.run.smithi131.stderr: 60900K .......... .......... .......... .......... .......... 65% 52.9M 2s 2023-12-03T11:37:14.625 INFO:teuthology.orchestra.run.smithi131.stderr: 60950K .......... .......... .......... .......... .......... 65% 25.9M 2s 2023-12-03T11:37:14.627 INFO:teuthology.orchestra.run.smithi131.stderr: 61000K .......... .......... .......... .......... .......... 65% 23.2M 2s 2023-12-03T11:37:14.628 INFO:teuthology.orchestra.run.smithi131.stderr: 61050K .......... .......... .......... .......... .......... 65% 37.3M 2s 2023-12-03T11:37:14.632 INFO:teuthology.orchestra.run.smithi131.stderr: 61100K .......... .......... .......... .......... .......... 65% 19.5M 2s 2023-12-03T11:37:14.632 INFO:teuthology.orchestra.run.smithi131.stderr: 61150K .......... .......... .......... .......... .......... 65% 46.5M 2s 2023-12-03T11:37:14.633 INFO:teuthology.orchestra.run.smithi131.stderr: 61200K .......... .......... .......... .......... .......... 65% 33.5M 2s 2023-12-03T11:37:14.635 INFO:teuthology.orchestra.run.smithi131.stderr: 61250K .......... .......... .......... .......... .......... 65% 32.0M 2s 2023-12-03T11:37:14.636 INFO:teuthology.orchestra.run.smithi131.stderr: 61300K .......... .......... .......... .......... .......... 66% 42.3M 2s 2023-12-03T11:37:14.637 INFO:teuthology.orchestra.run.smithi131.stderr: 61350K .......... .......... .......... .......... .......... 66% 40.0M 2s 2023-12-03T11:37:14.638 INFO:teuthology.orchestra.run.smithi131.stderr: 61400K .......... .......... .......... .......... .......... 66% 35.5M 2s 2023-12-03T11:37:14.642 INFO:teuthology.orchestra.run.smithi131.stderr: 61450K .......... .......... .......... .......... .......... 66% 18.2M 2s 2023-12-03T11:37:14.643 INFO:teuthology.orchestra.run.smithi131.stderr: 61500K .......... .......... .......... .......... .......... 66% 25.6M 2s 2023-12-03T11:37:14.644 INFO:teuthology.orchestra.run.smithi131.stderr: 61550K .......... .......... .......... .......... .......... 66% 44.0M 2s 2023-12-03T11:37:14.645 INFO:teuthology.orchestra.run.smithi131.stderr: 61600K .......... .......... .......... .......... .......... 66% 35.6M 2s 2023-12-03T11:37:14.647 INFO:teuthology.orchestra.run.smithi131.stderr: 61650K .......... .......... .......... .......... .......... 66% 33.5M 2s 2023-12-03T11:37:14.648 INFO:teuthology.orchestra.run.smithi131.stderr: 61700K .......... .......... .......... .......... .......... 66% 34.2M 2s 2023-12-03T11:37:14.649 INFO:teuthology.orchestra.run.smithi131.stderr: 61750K .......... .......... .......... .......... .......... 66% 43.6M 2s 2023-12-03T11:37:14.653 INFO:teuthology.orchestra.run.smithi131.stderr: 61800K .......... .......... .......... .......... .......... 66% 12.5M 2s 2023-12-03T11:37:14.654 INFO:teuthology.orchestra.run.smithi131.stderr: 61850K .......... .......... .......... .......... .......... 66% 52.7M 2s 2023-12-03T11:37:14.656 INFO:teuthology.orchestra.run.smithi131.stderr: 61900K .......... .......... .......... .......... .......... 66% 26.7M 2s 2023-12-03T11:37:14.660 INFO:teuthology.orchestra.run.smithi131.stderr: 61950K .......... .......... .......... .......... .......... 66% 12.2M 2s 2023-12-03T11:37:14.662 INFO:teuthology.orchestra.run.smithi131.stderr: 62000K .......... .......... .......... .......... .......... 66% 29.5M 2s 2023-12-03T11:37:14.665 INFO:teuthology.orchestra.run.smithi131.stderr: 62050K .......... .......... .......... .......... .......... 66% 14.4M 2s 2023-12-03T11:37:14.669 INFO:teuthology.orchestra.run.smithi131.stderr: 62100K .......... .......... .......... .......... .......... 66% 11.5M 2s 2023-12-03T11:37:14.673 INFO:teuthology.orchestra.run.smithi131.stderr: 62150K .......... .......... .......... .......... .......... 66% 12.6M 2s 2023-12-03T11:37:14.684 INFO:teuthology.orchestra.run.smithi131.stderr: 62200K .......... .......... .......... .......... .......... 67% 4.45M 2s 2023-12-03T11:37:14.695 INFO:teuthology.orchestra.run.smithi131.stderr: 62250K .......... .......... .......... .......... .......... 67% 4.62M 2s 2023-12-03T11:37:14.706 INFO:teuthology.orchestra.run.smithi131.stderr: 62300K .......... .......... .......... .......... .......... 67% 4.28M 2s 2023-12-03T11:37:14.709 INFO:teuthology.orchestra.run.smithi131.stderr: 62350K .......... .......... .......... .......... .......... 67% 17.2M 2s 2023-12-03T11:37:14.711 INFO:teuthology.orchestra.run.smithi131.stderr: 62400K .......... .......... .......... .......... .......... 67% 28.1M 2s 2023-12-03T11:37:14.713 INFO:teuthology.orchestra.run.smithi131.stderr: 62450K .......... .......... .......... .......... .......... 67% 25.2M 2s 2023-12-03T11:37:14.715 INFO:teuthology.orchestra.run.smithi131.stderr: 62500K .......... .......... .......... .......... .......... 67% 27.6M 2s 2023-12-03T11:37:14.720 INFO:teuthology.orchestra.run.smithi131.stderr: 62550K .......... .......... .......... .......... .......... 67% 9.43M 2s 2023-12-03T11:37:14.722 INFO:teuthology.orchestra.run.smithi131.stderr: 62600K .......... .......... .......... .......... .......... 67% 25.5M 2s 2023-12-03T11:37:14.731 INFO:teuthology.orchestra.run.smithi131.stderr: 62650K .......... .......... .......... .......... .......... 67% 5.05M 2s 2023-12-03T11:37:14.734 INFO:teuthology.orchestra.run.smithi131.stderr: 62700K .......... .......... .......... .......... .......... 67% 19.2M 2s 2023-12-03T11:37:14.738 INFO:teuthology.orchestra.run.smithi131.stderr: 62750K .......... .......... .......... .......... .......... 67% 12.7M 2s 2023-12-03T11:37:14.740 INFO:teuthology.orchestra.run.smithi131.stderr: 62800K .......... .......... .......... .......... .......... 67% 16.8M 2s 2023-12-03T11:37:14.745 INFO:teuthology.orchestra.run.smithi131.stderr: 62850K .......... .......... .......... .......... .......... 67% 14.1M 2s 2023-12-03T11:37:14.746 INFO:teuthology.orchestra.run.smithi131.stderr: 62900K .......... .......... .......... .......... .......... 67% 30.7M 2s 2023-12-03T11:37:14.746 INFO:teuthology.orchestra.run.smithi131.stderr: 62950K .......... .......... .......... .......... .......... 67% 85.5M 2s 2023-12-03T11:37:14.750 INFO:teuthology.orchestra.run.smithi131.stderr: 63000K .......... .......... .......... .......... .......... 67% 12.9M 2s 2023-12-03T11:37:14.754 INFO:teuthology.orchestra.run.smithi131.stderr: 63050K .......... .......... .......... .......... .......... 67% 13.1M 2s 2023-12-03T11:37:14.755 INFO:teuthology.orchestra.run.smithi131.stderr: 63100K .......... .......... .......... .......... .......... 67% 37.4M 2s 2023-12-03T11:37:14.756 INFO:teuthology.orchestra.run.smithi131.stderr: 63150K .......... .......... .......... .......... .......... 68% 83.6M 2s 2023-12-03T11:37:14.759 INFO:teuthology.orchestra.run.smithi131.stderr: 63200K .......... .......... .......... .......... .......... 68% 15.3M 2s 2023-12-03T11:37:14.762 INFO:teuthology.orchestra.run.smithi131.stderr: 63250K .......... .......... .......... .......... .......... 68% 18.8M 2s 2023-12-03T11:37:14.763 INFO:teuthology.orchestra.run.smithi131.stderr: 63300K .......... .......... .......... .......... .......... 68% 26.8M 2s 2023-12-03T11:37:14.765 INFO:teuthology.orchestra.run.smithi131.stderr: 63350K .......... .......... .......... .......... .......... 68% 23.3M 2s 2023-12-03T11:37:14.766 INFO:teuthology.orchestra.run.smithi131.stderr: 63400K .......... .......... .......... .......... .......... 68% 41.3M 2s 2023-12-03T11:37:14.771 INFO:teuthology.orchestra.run.smithi131.stderr: 63450K .......... .......... .......... .......... .......... 68% 11.3M 2s 2023-12-03T11:37:14.773 INFO:teuthology.orchestra.run.smithi131.stderr: 63500K .......... .......... .......... .......... .......... 68% 33.8M 2s 2023-12-03T11:37:14.774 INFO:teuthology.orchestra.run.smithi131.stderr: 63550K .......... .......... .......... .......... .......... 68% 31.4M 2s 2023-12-03T11:37:14.775 INFO:teuthology.orchestra.run.smithi131.stderr: 63600K .......... .......... .......... .......... .......... 68% 45.5M 2s 2023-12-03T11:37:14.776 INFO:teuthology.orchestra.run.smithi131.stderr: 63650K .......... .......... .......... .......... .......... 68% 28.7M 2s 2023-12-03T11:37:14.779 INFO:teuthology.orchestra.run.smithi131.stderr: 63700K .......... .......... .......... .......... .......... 68% 27.1M 2s 2023-12-03T11:37:14.781 INFO:teuthology.orchestra.run.smithi131.stderr: 63750K .......... .......... .......... .......... .......... 68% 20.0M 2s 2023-12-03T11:37:14.782 INFO:teuthology.orchestra.run.smithi131.stderr: 63800K .......... .......... .......... .......... .......... 68% 36.7M 2s 2023-12-03T11:37:14.784 INFO:teuthology.orchestra.run.smithi131.stderr: 63850K .......... .......... .......... .......... .......... 68% 32.6M 2s 2023-12-03T11:37:14.784 INFO:teuthology.orchestra.run.smithi131.stderr: 63900K .......... .......... .......... .......... .......... 68% 80.1M 2s 2023-12-03T11:37:14.787 INFO:teuthology.orchestra.run.smithi131.stderr: 63950K .......... .......... .......... .......... .......... 68% 16.5M 2s 2023-12-03T11:37:14.789 INFO:teuthology.orchestra.run.smithi131.stderr: 64000K .......... .......... .......... .......... .......... 68% 35.8M 2s 2023-12-03T11:37:14.790 INFO:teuthology.orchestra.run.smithi131.stderr: 64050K .......... .......... .......... .......... .......... 68% 26.3M 2s 2023-12-03T11:37:14.792 INFO:teuthology.orchestra.run.smithi131.stderr: 64100K .......... .......... .......... .......... .......... 69% 29.4M 2s 2023-12-03T11:37:14.793 INFO:teuthology.orchestra.run.smithi131.stderr: 64150K .......... .......... .......... .......... .......... 69% 109M 2s 2023-12-03T11:37:14.809 INFO:teuthology.orchestra.run.smithi131.stderr: 64200K .......... .......... .......... .......... .......... 69% 3.05M 2s 2023-12-03T11:37:14.812 INFO:teuthology.orchestra.run.smithi131.stderr: 64250K .......... .......... .......... .......... .......... 69% 12.5M 2s 2023-12-03T11:37:14.815 INFO:teuthology.orchestra.run.smithi131.stderr: 64300K .......... .......... .......... .......... .......... 69% 18.2M 2s 2023-12-03T11:37:14.815 INFO:teuthology.orchestra.run.smithi131.stderr: 64350K .......... .......... .......... .......... .......... 69% 110M 2s 2023-12-03T11:37:14.817 INFO:teuthology.orchestra.run.smithi131.stderr: 64400K .......... .......... .......... .......... .......... 69% 35.1M 2s 2023-12-03T11:37:14.819 INFO:teuthology.orchestra.run.smithi131.stderr: 64450K .......... .......... .......... .......... .......... 69% 25.9M 2s 2023-12-03T11:37:14.821 INFO:teuthology.orchestra.run.smithi131.stderr: 64500K .......... .......... .......... .......... .......... 69% 24.3M 2s 2023-12-03T11:37:14.822 INFO:teuthology.orchestra.run.smithi131.stderr: 64550K .......... .......... .......... .......... .......... 69% 81.2M 2s 2023-12-03T11:37:14.823 INFO:teuthology.orchestra.run.smithi131.stderr: 64600K .......... .......... .......... .......... .......... 69% 33.8M 2s 2023-12-03T11:37:14.825 INFO:teuthology.orchestra.run.smithi131.stderr: 64650K .......... .......... .......... .......... .......... 69% 25.3M 2s 2023-12-03T11:37:14.827 INFO:teuthology.orchestra.run.smithi131.stderr: 64700K .......... .......... .......... .......... .......... 69% 29.4M 2s 2023-12-03T11:37:14.829 INFO:teuthology.orchestra.run.smithi131.stderr: 64750K .......... .......... .......... .......... .......... 69% 29.1M 2s 2023-12-03T11:37:14.829 INFO:teuthology.orchestra.run.smithi131.stderr: 64800K .......... .......... .......... .......... .......... 69% 68.1M 2s 2023-12-03T11:37:14.831 INFO:teuthology.orchestra.run.smithi131.stderr: 64850K .......... .......... .......... .......... .......... 69% 27.1M 2s 2023-12-03T11:37:14.832 INFO:teuthology.orchestra.run.smithi131.stderr: 64900K .......... .......... .......... .......... .......... 69% 28.6M 2s 2023-12-03T11:37:14.835 INFO:teuthology.orchestra.run.smithi131.stderr: 64950K .......... .......... .......... .......... .......... 69% 18.8M 2s 2023-12-03T11:37:14.837 INFO:teuthology.orchestra.run.smithi131.stderr: 65000K .......... .......... .......... .......... .......... 70% 26.6M 2s 2023-12-03T11:37:14.837 INFO:teuthology.orchestra.run.smithi131.stderr: 65050K .......... .......... .......... .......... .......... 70% 56.1M 2s 2023-12-03T11:37:14.839 INFO:teuthology.orchestra.run.smithi131.stderr: 65100K .......... .......... .......... .......... .......... 70% 36.4M 2s 2023-12-03T11:37:14.840 INFO:teuthology.orchestra.run.smithi131.stderr: 65150K .......... .......... .......... .......... .......... 70% 51.9M 2s 2023-12-03T11:37:14.842 INFO:teuthology.orchestra.run.smithi131.stderr: 65200K .......... .......... .......... .......... .......... 70% 34.5M 2s 2023-12-03T11:37:14.843 INFO:teuthology.orchestra.run.smithi131.stderr: 65250K .......... .......... .......... .......... .......... 70% 35.6M 2s 2023-12-03T11:37:14.843 INFO:teuthology.orchestra.run.smithi131.stderr: 65300K .......... .......... .......... .......... .......... 70% 61.7M 2s 2023-12-03T11:37:14.845 INFO:teuthology.orchestra.run.smithi131.stderr: 65350K .......... .......... .......... .......... .......... 70% 23.6M 2s 2023-12-03T11:37:14.848 INFO:teuthology.orchestra.run.smithi131.stderr: 65400K .......... .......... .......... .......... .......... 70% 23.7M 2s 2023-12-03T11:37:14.849 INFO:teuthology.orchestra.run.smithi131.stderr: 65450K .......... .......... .......... .......... .......... 70% 30.1M 2s 2023-12-03T11:37:14.851 INFO:teuthology.orchestra.run.smithi131.stderr: 65500K .......... .......... .......... .......... .......... 70% 29.6M 2s 2023-12-03T11:37:14.851 INFO:teuthology.orchestra.run.smithi131.stderr: 65550K .......... .......... .......... .......... .......... 70% 80.9M 2s 2023-12-03T11:37:14.853 INFO:teuthology.orchestra.run.smithi131.stderr: 65600K .......... .......... .......... .......... .......... 70% 41.1M 2s 2023-12-03T11:37:14.854 INFO:teuthology.orchestra.run.smithi131.stderr: 65650K .......... .......... .......... .......... .......... 70% 27.6M 2s 2023-12-03T11:37:14.859 INFO:teuthology.orchestra.run.smithi131.stderr: 65700K .......... .......... .......... .......... .......... 70% 13.2M 2s 2023-12-03T11:37:14.859 INFO:teuthology.orchestra.run.smithi131.stderr: 65750K .......... .......... .......... .......... .......... 70% 84.4M 2s 2023-12-03T11:37:14.860 INFO:teuthology.orchestra.run.smithi131.stderr: 65800K .......... .......... .......... .......... .......... 70% 34.9M 2s 2023-12-03T11:37:14.865 INFO:teuthology.orchestra.run.smithi131.stderr: 65850K .......... .......... .......... .......... .......... 70% 13.3M 2s 2023-12-03T11:37:14.868 INFO:teuthology.orchestra.run.smithi131.stderr: 65900K .......... .......... .......... .......... .......... 70% 12.8M 2s 2023-12-03T11:37:14.870 INFO:teuthology.orchestra.run.smithi131.stderr: 65950K .......... .......... .......... .......... .......... 71% 17.8M 2s 2023-12-03T11:37:14.875 INFO:teuthology.orchestra.run.smithi131.stderr: 66000K .......... .......... .......... .......... .......... 71% 11.2M 2s 2023-12-03T11:37:14.877 INFO:teuthology.orchestra.run.smithi131.stderr: 66050K .......... .......... .......... .......... .......... 71% 23.5M 2s 2023-12-03T11:37:14.886 INFO:teuthology.orchestra.run.smithi131.stderr: 66100K .......... .......... .......... .......... .......... 71% 5.30M 2s 2023-12-03T11:37:14.903 INFO:teuthology.orchestra.run.smithi131.stderr: 66150K .......... .......... .......... .......... .......... 71% 2.83M 2s 2023-12-03T11:37:14.907 INFO:teuthology.orchestra.run.smithi131.stderr: 66200K .......... .......... .......... .......... .......... 71% 11.9M 2s 2023-12-03T11:37:14.909 INFO:teuthology.orchestra.run.smithi131.stderr: 66250K .......... .......... .......... .......... .......... 71% 38.0M 2s 2023-12-03T11:37:14.912 INFO:teuthology.orchestra.run.smithi131.stderr: 66300K .......... .......... .......... .......... .......... 71% 17.8M 2s 2023-12-03T11:37:14.915 INFO:teuthology.orchestra.run.smithi131.stderr: 66350K .......... .......... .......... .......... .......... 71% 23.2M 2s 2023-12-03T11:37:14.915 INFO:teuthology.orchestra.run.smithi131.stderr: 66400K .......... .......... .......... .......... .......... 71% 108M 2s 2023-12-03T11:37:14.919 INFO:teuthology.orchestra.run.smithi131.stderr: 66450K .......... .......... .......... .......... .......... 71% 9.73M 2s 2023-12-03T11:37:14.923 INFO:teuthology.orchestra.run.smithi131.stderr: 66500K .......... .......... .......... .......... .......... 71% 16.0M 2s 2023-12-03T11:37:14.930 INFO:teuthology.orchestra.run.smithi131.stderr: 66550K .......... .......... .......... .......... .......... 71% 6.22M 2s 2023-12-03T11:37:14.933 INFO:teuthology.orchestra.run.smithi131.stderr: 66600K .......... .......... .......... .......... .......... 71% 16.3M 2s 2023-12-03T11:37:14.936 INFO:teuthology.orchestra.run.smithi131.stderr: 66650K .......... .......... .......... .......... .......... 71% 17.1M 2s 2023-12-03T11:37:14.940 INFO:teuthology.orchestra.run.smithi131.stderr: 66700K .......... .......... .......... .......... .......... 71% 10.7M 2s 2023-12-03T11:37:14.943 INFO:teuthology.orchestra.run.smithi131.stderr: 66750K .......... .......... .......... .......... .......... 71% 28.8M 2s 2023-12-03T11:37:14.944 INFO:teuthology.orchestra.run.smithi131.stderr: 66800K .......... .......... .......... .......... .......... 71% 34.3M 2s 2023-12-03T11:37:14.945 INFO:teuthology.orchestra.run.smithi131.stderr: 66850K .......... .......... .......... .......... .......... 72% 28.0M 2s 2023-12-03T11:37:14.947 INFO:teuthology.orchestra.run.smithi131.stderr: 66900K .......... .......... .......... .......... .......... 72% 21.3M 2s 2023-12-03T11:37:14.951 INFO:teuthology.orchestra.run.smithi131.stderr: 66950K .......... .......... .......... .......... .......... 72% 13.9M 2s 2023-12-03T11:37:14.953 INFO:teuthology.orchestra.run.smithi131.stderr: 67000K .......... .......... .......... .......... .......... 72% 34.4M 2s 2023-12-03T11:37:14.954 INFO:teuthology.orchestra.run.smithi131.stderr: 67050K .......... .......... .......... .......... .......... 72% 26.2M 2s 2023-12-03T11:37:14.957 INFO:teuthology.orchestra.run.smithi131.stderr: 67100K .......... .......... .......... .......... .......... 72% 17.8M 2s 2023-12-03T11:37:14.960 INFO:teuthology.orchestra.run.smithi131.stderr: 67150K .......... .......... .......... .......... .......... 72% 40.7M 2s 2023-12-03T11:37:14.960 INFO:teuthology.orchestra.run.smithi131.stderr: 67200K .......... .......... .......... .......... .......... 72% 26.8M 2s 2023-12-03T11:37:14.962 INFO:teuthology.orchestra.run.smithi131.stderr: 67250K .......... .......... .......... .......... .......... 72% 26.0M 2s 2023-12-03T11:37:14.965 INFO:teuthology.orchestra.run.smithi131.stderr: 67300K .......... .......... .......... .......... .......... 72% 15.9M 2s 2023-12-03T11:37:14.967 INFO:teuthology.orchestra.run.smithi131.stderr: 67350K .......... .......... .......... .......... .......... 72% 24.4M 2s 2023-12-03T11:37:14.969 INFO:teuthology.orchestra.run.smithi131.stderr: 67400K .......... .......... .......... .......... .......... 72% 24.9M 2s 2023-12-03T11:37:14.971 INFO:teuthology.orchestra.run.smithi131.stderr: 67450K .......... .......... .......... .......... .......... 72% 23.2M 2s 2023-12-03T11:37:14.973 INFO:teuthology.orchestra.run.smithi131.stderr: 67500K .......... .......... .......... .......... .......... 72% 29.3M 2s 2023-12-03T11:37:14.976 INFO:teuthology.orchestra.run.smithi131.stderr: 67550K .......... .......... .......... .......... .......... 72% 21.4M 2s 2023-12-03T11:37:14.976 INFO:teuthology.orchestra.run.smithi131.stderr: 67600K .......... .......... .......... .......... .......... 72% 74.4M 2s 2023-12-03T11:37:14.978 INFO:teuthology.orchestra.run.smithi131.stderr: 67650K .......... .......... .......... .......... .......... 72% 30.8M 2s 2023-12-03T11:37:14.979 INFO:teuthology.orchestra.run.smithi131.stderr: 67700K .......... .......... .......... .......... .......... 72% 21.1M 2s 2023-12-03T11:37:14.981 INFO:teuthology.orchestra.run.smithi131.stderr: 67750K .......... .......... .......... .......... .......... 72% 58.0M 2s 2023-12-03T11:37:14.983 INFO:teuthology.orchestra.run.smithi131.stderr: 67800K .......... .......... .......... .......... .......... 73% 23.8M 2s 2023-12-03T11:37:14.984 INFO:teuthology.orchestra.run.smithi131.stderr: 67850K .......... .......... .......... .......... .......... 73% 41.3M 2s 2023-12-03T11:37:14.985 INFO:teuthology.orchestra.run.smithi131.stderr: 67900K .......... .......... .......... .......... .......... 73% 34.5M 2s 2023-12-03T11:37:14.987 INFO:teuthology.orchestra.run.smithi131.stderr: 67950K .......... .......... .......... .......... .......... 73% 26.4M 2s 2023-12-03T11:37:14.989 INFO:teuthology.orchestra.run.smithi131.stderr: 68000K .......... .......... .......... .......... .......... 73% 32.6M 2s 2023-12-03T11:37:15.004 INFO:teuthology.orchestra.run.smithi131.stderr: 68050K .......... .......... .......... .......... .......... 73% 76.6M 2s 2023-12-03T11:37:15.006 INFO:teuthology.orchestra.run.smithi131.stderr: 68100K .......... .......... .......... .......... .......... 73% 2.91M 2s 2023-12-03T11:37:15.010 INFO:teuthology.orchestra.run.smithi131.stderr: 68150K .......... .......... .......... .......... .......... 73% 13.0M 2s 2023-12-03T11:37:15.011 INFO:teuthology.orchestra.run.smithi131.stderr: 68200K .......... .......... .......... .......... .......... 73% 26.5M 2s 2023-12-03T11:37:15.014 INFO:teuthology.orchestra.run.smithi131.stderr: 68250K .......... .......... .......... .......... .......... 73% 24.9M 2s 2023-12-03T11:37:15.014 INFO:teuthology.orchestra.run.smithi131.stderr: 68300K .......... .......... .......... .......... .......... 73% 63.3M 2s 2023-12-03T11:37:15.016 INFO:teuthology.orchestra.run.smithi131.stderr: 68350K .......... .......... .......... .......... .......... 73% 30.2M 2s 2023-12-03T11:37:15.018 INFO:teuthology.orchestra.run.smithi131.stderr: 68400K .......... .......... .......... .......... .......... 73% 24.7M 2s 2023-12-03T11:37:15.019 INFO:teuthology.orchestra.run.smithi131.stderr: 68450K .......... .......... .......... .......... .......... 73% 37.1M 2s 2023-12-03T11:37:15.021 INFO:teuthology.orchestra.run.smithi131.stderr: 68500K .......... .......... .......... .......... .......... 73% 24.0M 2s 2023-12-03T11:37:15.022 INFO:teuthology.orchestra.run.smithi131.stderr: 68550K .......... .......... .......... .......... .......... 73% 60.7M 2s 2023-12-03T11:37:15.025 INFO:teuthology.orchestra.run.smithi131.stderr: 68600K .......... .......... .......... .......... .......... 73% 18.1M 2s 2023-12-03T11:37:15.026 INFO:teuthology.orchestra.run.smithi131.stderr: 68650K .......... .......... .......... .......... .......... 73% 42.3M 2s 2023-12-03T11:37:15.028 INFO:teuthology.orchestra.run.smithi131.stderr: 68700K .......... .......... .......... .......... .......... 74% 27.5M 2s 2023-12-03T11:37:15.030 INFO:teuthology.orchestra.run.smithi131.stderr: 68750K .......... .......... .......... .......... .......... 74% 20.6M 2s 2023-12-03T11:37:15.031 INFO:teuthology.orchestra.run.smithi131.stderr: 68800K .......... .......... .......... .......... .......... 74% 46.8M 2s 2023-12-03T11:37:15.033 INFO:teuthology.orchestra.run.smithi131.stderr: 68850K .......... .......... .......... .......... .......... 74% 21.0M 2s 2023-12-03T11:37:15.035 INFO:teuthology.orchestra.run.smithi131.stderr: 68900K .......... .......... .......... .......... .......... 74% 26.8M 2s 2023-12-03T11:37:15.037 INFO:teuthology.orchestra.run.smithi131.stderr: 68950K .......... .......... .......... .......... .......... 74% 22.5M 2s 2023-12-03T11:37:15.038 INFO:teuthology.orchestra.run.smithi131.stderr: 69000K .......... .......... .......... .......... .......... 74% 57.8M 2s 2023-12-03T11:37:15.040 INFO:teuthology.orchestra.run.smithi131.stderr: 69050K .......... .......... .......... .......... .......... 74% 27.7M 2s 2023-12-03T11:37:15.041 INFO:teuthology.orchestra.run.smithi131.stderr: 69100K .......... .......... .......... .......... .......... 74% 50.4M 2s 2023-12-03T11:37:15.043 INFO:teuthology.orchestra.run.smithi131.stderr: 69150K .......... .......... .......... .......... .......... 74% 22.4M 2s 2023-12-03T11:37:15.046 INFO:teuthology.orchestra.run.smithi131.stderr: 69200K .......... .......... .......... .......... .......... 74% 23.2M 2s 2023-12-03T11:37:15.046 INFO:teuthology.orchestra.run.smithi131.stderr: 69250K .......... .......... .......... .......... .......... 74% 73.7M 2s 2023-12-03T11:37:15.049 INFO:teuthology.orchestra.run.smithi131.stderr: 69300K .......... .......... .......... .......... .......... 74% 16.0M 2s 2023-12-03T11:37:15.050 INFO:teuthology.orchestra.run.smithi131.stderr: 69350K .......... .......... .......... .......... .......... 74% 44.0M 2s 2023-12-03T11:37:15.053 INFO:teuthology.orchestra.run.smithi131.stderr: 69400K .......... .......... .......... .......... .......... 74% 42.8M 2s 2023-12-03T11:37:15.053 INFO:teuthology.orchestra.run.smithi131.stderr: 69450K .......... .......... .......... .......... .......... 74% 67.2M 2s 2023-12-03T11:37:15.053 INFO:teuthology.orchestra.run.smithi131.stderr: 69500K .......... .......... .......... .......... .......... 74% 67.6M 2s 2023-12-03T11:37:15.055 INFO:teuthology.orchestra.run.smithi131.stderr: 69550K .......... .......... .......... .......... .......... 74% 29.5M 2s 2023-12-03T11:37:15.059 INFO:teuthology.orchestra.run.smithi131.stderr: 69600K .......... .......... .......... .......... .......... 74% 12.4M 2s 2023-12-03T11:37:15.061 INFO:teuthology.orchestra.run.smithi131.stderr: 69650K .......... .......... .......... .......... .......... 75% 24.8M 2s 2023-12-03T11:37:15.064 INFO:teuthology.orchestra.run.smithi131.stderr: 69700K .......... .......... .......... .......... .......... 75% 12.3M 2s 2023-12-03T11:37:15.066 INFO:teuthology.orchestra.run.smithi131.stderr: 69750K .......... .......... .......... .......... .......... 75% 28.9M 2s 2023-12-03T11:37:15.070 INFO:teuthology.orchestra.run.smithi131.stderr: 69800K .......... .......... .......... .......... .......... 75% 11.3M 2s 2023-12-03T11:37:15.072 INFO:teuthology.orchestra.run.smithi131.stderr: 69850K .......... .......... .......... .......... .......... 75% 26.3M 2s 2023-12-03T11:37:15.076 INFO:teuthology.orchestra.run.smithi131.stderr: 69900K .......... .......... .......... .......... .......... 75% 11.3M 2s 2023-12-03T11:37:15.079 INFO:teuthology.orchestra.run.smithi131.stderr: 69950K .......... .......... .......... .......... .......... 75% 18.1M 2s 2023-12-03T11:37:15.098 INFO:teuthology.orchestra.run.smithi131.stderr: 70000K .......... .......... .......... .......... .......... 75% 2.61M 2s 2023-12-03T11:37:15.109 INFO:teuthology.orchestra.run.smithi131.stderr: 70050K .......... .......... .......... .......... .......... 75% 4.47M 2s 2023-12-03T11:37:15.110 INFO:teuthology.orchestra.run.smithi131.stderr: 70100K .......... .......... .......... .......... .......... 75% 39.0M 2s 2023-12-03T11:37:15.112 INFO:teuthology.orchestra.run.smithi131.stderr: 70150K .......... .......... .......... .......... .......... 75% 29.0M 2s 2023-12-03T11:37:15.115 INFO:teuthology.orchestra.run.smithi131.stderr: 70200K .......... .......... .......... .......... .......... 75% 16.1M 2s 2023-12-03T11:37:15.117 INFO:teuthology.orchestra.run.smithi131.stderr: 70250K .......... .......... .......... .......... .......... 75% 19.5M 2s 2023-12-03T11:37:15.121 INFO:teuthology.orchestra.run.smithi131.stderr: 70300K .......... .......... .......... .......... .......... 75% 13.5M 2s 2023-12-03T11:37:15.124 INFO:teuthology.orchestra.run.smithi131.stderr: 70350K .......... .......... .......... .......... .......... 75% 15.9M 2s 2023-12-03T11:37:15.126 INFO:teuthology.orchestra.run.smithi131.stderr: 70400K .......... .......... .......... .......... .......... 75% 26.8M 2s 2023-12-03T11:37:15.134 INFO:teuthology.orchestra.run.smithi131.stderr: 70450K .......... .......... .......... .......... .......... 75% 6.53M 2s 2023-12-03T11:37:15.138 INFO:teuthology.orchestra.run.smithi131.stderr: 70500K .......... .......... .......... .......... .......... 75% 9.34M 2s 2023-12-03T11:37:15.141 INFO:teuthology.orchestra.run.smithi131.stderr: 70550K .......... .......... .......... .......... .......... 75% 21.1M 2s 2023-12-03T11:37:15.144 INFO:teuthology.orchestra.run.smithi131.stderr: 70600K .......... .......... .......... .......... .......... 76% 13.8M 2s 2023-12-03T11:37:15.146 INFO:teuthology.orchestra.run.smithi131.stderr: 70650K .......... .......... .......... .......... .......... 76% 37.8M 2s 2023-12-03T11:37:15.147 INFO:teuthology.orchestra.run.smithi131.stderr: 70700K .......... .......... .......... .......... .......... 76% 31.4M 2s 2023-12-03T11:37:15.149 INFO:teuthology.orchestra.run.smithi131.stderr: 70750K .......... .......... .......... .......... .......... 76% 31.1M 2s 2023-12-03T11:37:15.152 INFO:teuthology.orchestra.run.smithi131.stderr: 70800K .......... .......... .......... .......... .......... 76% 16.0M 2s 2023-12-03T11:37:15.154 INFO:teuthology.orchestra.run.smithi131.stderr: 70850K .......... .......... .......... .......... .......... 76% 20.6M 2s 2023-12-03T11:37:15.156 INFO:teuthology.orchestra.run.smithi131.stderr: 70900K .......... .......... .......... .......... .......... 76% 32.8M 2s 2023-12-03T11:37:15.159 INFO:teuthology.orchestra.run.smithi131.stderr: 70950K .......... .......... .......... .......... .......... 76% 16.0M 2s 2023-12-03T11:37:15.161 INFO:teuthology.orchestra.run.smithi131.stderr: 71000K .......... .......... .......... .......... .......... 76% 18.4M 2s 2023-12-03T11:37:15.163 INFO:teuthology.orchestra.run.smithi131.stderr: 71050K .......... .......... .......... .......... .......... 76% 41.2M 2s 2023-12-03T11:37:15.163 INFO:teuthology.orchestra.run.smithi131.stderr: 71100K .......... .......... .......... .......... .......... 76% 79.3M 2s 2023-12-03T11:37:15.166 INFO:teuthology.orchestra.run.smithi131.stderr: 71150K .......... .......... .......... .......... .......... 76% 16.5M 2s 2023-12-03T11:37:15.169 INFO:teuthology.orchestra.run.smithi131.stderr: 71200K .......... .......... .......... .......... .......... 76% 15.9M 2s 2023-12-03T11:37:15.172 INFO:teuthology.orchestra.run.smithi131.stderr: 71250K .......... .......... .......... .......... .......... 76% 21.8M 2s 2023-12-03T11:37:15.174 INFO:teuthology.orchestra.run.smithi131.stderr: 71300K .......... .......... .......... .......... .......... 76% 22.1M 2s 2023-12-03T11:37:15.174 INFO:teuthology.orchestra.run.smithi131.stderr: 71350K .......... .......... .......... .......... .......... 76% 130M 2s 2023-12-03T11:37:15.177 INFO:teuthology.orchestra.run.smithi131.stderr: 71400K .......... .......... .......... .......... .......... 76% 18.1M 2s 2023-12-03T11:37:15.178 INFO:teuthology.orchestra.run.smithi131.stderr: 71450K .......... .......... .......... .......... .......... 76% 26.2M 2s 2023-12-03T11:37:15.181 INFO:teuthology.orchestra.run.smithi131.stderr: 71500K .......... .......... .......... .......... .......... 77% 26.0M 2s 2023-12-03T11:37:15.181 INFO:teuthology.orchestra.run.smithi131.stderr: 71550K .......... .......... .......... .......... .......... 77% 81.9M 2s 2023-12-03T11:37:15.184 INFO:teuthology.orchestra.run.smithi131.stderr: 71600K .......... .......... .......... .......... .......... 77% 20.4M 2s 2023-12-03T11:37:15.185 INFO:teuthology.orchestra.run.smithi131.stderr: 71650K .......... .......... .......... .......... .......... 77% 44.0M 2s 2023-12-03T11:37:15.187 INFO:teuthology.orchestra.run.smithi131.stderr: 71700K .......... .......... .......... .......... .......... 77% 25.9M 2s 2023-12-03T11:37:15.190 INFO:teuthology.orchestra.run.smithi131.stderr: 71750K .......... .......... .......... .......... .......... 77% 18.5M 2s 2023-12-03T11:37:15.192 INFO:teuthology.orchestra.run.smithi131.stderr: 71800K .......... .......... .......... .......... .......... 77% 25.1M 1s 2023-12-03T11:37:15.192 INFO:teuthology.orchestra.run.smithi131.stderr: 71850K .......... .......... .......... .......... .......... 77% 81.6M 1s 2023-12-03T11:37:15.193 INFO:teuthology.orchestra.run.smithi131.stderr: 71900K .......... .......... .......... .......... .......... 77% 40.0M 1s 2023-12-03T11:37:15.208 INFO:teuthology.orchestra.run.smithi131.stderr: 71950K .......... .......... .......... .......... .......... 77% 3.14M 1s 2023-12-03T11:37:15.213 INFO:teuthology.orchestra.run.smithi131.stderr: 72000K .......... .......... .......... .......... .......... 77% 11.3M 1s 2023-12-03T11:37:15.214 INFO:teuthology.orchestra.run.smithi131.stderr: 72050K .......... .......... .......... .......... .......... 77% 32.5M 1s 2023-12-03T11:37:15.217 INFO:teuthology.orchestra.run.smithi131.stderr: 72100K .......... .......... .......... .......... .......... 77% 20.1M 1s 2023-12-03T11:37:15.219 INFO:teuthology.orchestra.run.smithi131.stderr: 72150K .......... .......... .......... .......... .......... 77% 23.3M 1s 2023-12-03T11:37:15.220 INFO:teuthology.orchestra.run.smithi131.stderr: 72200K .......... .......... .......... .......... .......... 77% 34.8M 1s 2023-12-03T11:37:15.223 INFO:teuthology.orchestra.run.smithi131.stderr: 72250K .......... .......... .......... .......... .......... 77% 24.4M 1s 2023-12-03T11:37:15.223 INFO:teuthology.orchestra.run.smithi131.stderr: 72300K .......... .......... .......... .......... .......... 77% 78.5M 1s 2023-12-03T11:37:15.225 INFO:teuthology.orchestra.run.smithi131.stderr: 72350K .......... .......... .......... .......... .......... 77% 30.4M 1s 2023-12-03T11:37:15.227 INFO:teuthology.orchestra.run.smithi131.stderr: 72400K .......... .......... .......... .......... .......... 77% 23.8M 1s 2023-12-03T11:37:15.228 INFO:teuthology.orchestra.run.smithi131.stderr: 72450K .......... .......... .......... .......... .......... 78% 23.9M 1s 2023-12-03T11:37:15.231 INFO:teuthology.orchestra.run.smithi131.stderr: 72500K .......... .......... .......... .......... .......... 78% 21.0M 1s 2023-12-03T11:37:15.231 INFO:teuthology.orchestra.run.smithi131.stderr: 72550K .......... .......... .......... .......... .......... 78% 93.8M 1s 2023-12-03T11:37:15.234 INFO:teuthology.orchestra.run.smithi131.stderr: 72600K .......... .......... .......... .......... .......... 78% 23.8M 1s 2023-12-03T11:37:15.239 INFO:teuthology.orchestra.run.smithi131.stderr: 72650K .......... .......... .......... .......... .......... 78% 24.5M 1s 2023-12-03T11:37:15.239 INFO:teuthology.orchestra.run.smithi131.stderr: 72700K .......... .......... .......... .......... .......... 78% 19.7M 1s 2023-12-03T11:37:15.239 INFO:teuthology.orchestra.run.smithi131.stderr: 72750K .......... .......... .......... .......... .......... 78% 38.8M 1s 2023-12-03T11:37:15.242 INFO:teuthology.orchestra.run.smithi131.stderr: 72800K .......... .......... .......... .......... .......... 78% 20.2M 1s 2023-12-03T11:37:15.244 INFO:teuthology.orchestra.run.smithi131.stderr: 72850K .......... .......... .......... .......... .......... 78% 24.9M 1s 2023-12-03T11:37:15.245 INFO:teuthology.orchestra.run.smithi131.stderr: 72900K .......... .......... .......... .......... .......... 78% 30.2M 1s 2023-12-03T11:37:15.247 INFO:teuthology.orchestra.run.smithi131.stderr: 72950K .......... .......... .......... .......... .......... 78% 31.8M 1s 2023-12-03T11:37:15.247 INFO:teuthology.orchestra.run.smithi131.stderr: 73000K .......... .......... .......... .......... .......... 78% 103M 1s 2023-12-03T11:37:15.249 INFO:teuthology.orchestra.run.smithi131.stderr: 73050K .......... .......... .......... .......... .......... 78% 23.9M 1s 2023-12-03T11:37:15.252 INFO:teuthology.orchestra.run.smithi131.stderr: 73100K .......... .......... .......... .......... .......... 78% 20.7M 1s 2023-12-03T11:37:15.254 INFO:teuthology.orchestra.run.smithi131.stderr: 73150K .......... .......... .......... .......... .......... 78% 22.0M 1s 2023-12-03T11:37:15.255 INFO:teuthology.orchestra.run.smithi131.stderr: 73200K .......... .......... .......... .......... .......... 78% 30.8M 1s 2023-12-03T11:37:15.257 INFO:teuthology.orchestra.run.smithi131.stderr: 73250K .......... .......... .......... .......... .......... 78% 38.7M 1s 2023-12-03T11:37:15.258 INFO:teuthology.orchestra.run.smithi131.stderr: 73300K .......... .......... .......... .......... .......... 78% 34.5M 1s 2023-12-03T11:37:15.259 INFO:teuthology.orchestra.run.smithi131.stderr: 73350K .......... .......... .......... .......... .......... 79% 48.0M 1s 2023-12-03T11:37:15.261 INFO:teuthology.orchestra.run.smithi131.stderr: 73400K .......... .......... .......... .......... .......... 79% 25.8M 1s 2023-12-03T11:37:15.262 INFO:teuthology.orchestra.run.smithi131.stderr: 73450K .......... .......... .......... .......... .......... 79% 83.7M 1s 2023-12-03T11:37:15.266 INFO:teuthology.orchestra.run.smithi131.stderr: 73500K .......... .......... .......... .......... .......... 79% 12.3M 1s 2023-12-03T11:37:15.268 INFO:teuthology.orchestra.run.smithi131.stderr: 73550K .......... .......... .......... .......... .......... 79% 22.1M 1s 2023-12-03T11:37:15.271 INFO:teuthology.orchestra.run.smithi131.stderr: 73600K .......... .......... .......... .......... .......... 79% 12.9M 1s 2023-12-03T11:37:15.276 INFO:teuthology.orchestra.run.smithi131.stderr: 73650K .......... .......... .......... .......... .......... 79% 11.1M 1s 2023-12-03T11:37:15.278 INFO:teuthology.orchestra.run.smithi131.stderr: 73700K .......... .......... .......... .......... .......... 79% 21.6M 1s 2023-12-03T11:37:15.281 INFO:teuthology.orchestra.run.smithi131.stderr: 73750K .......... .......... .......... .......... .......... 79% 14.8M 1s 2023-12-03T11:37:15.284 INFO:teuthology.orchestra.run.smithi131.stderr: 73800K .......... .......... .......... .......... .......... 79% 16.7M 1s 2023-12-03T11:37:15.296 INFO:teuthology.orchestra.run.smithi131.stderr: 73850K .......... .......... .......... .......... .......... 79% 4.02M 1s 2023-12-03T11:37:15.306 INFO:teuthology.orchestra.run.smithi131.stderr: 73900K .......... .......... .......... .......... .......... 79% 4.89M 1s 2023-12-03T11:37:15.318 INFO:teuthology.orchestra.run.smithi131.stderr: 73950K .......... .......... .......... .......... .......... 79% 4.24M 1s 2023-12-03T11:37:15.319 INFO:teuthology.orchestra.run.smithi131.stderr: 74000K .......... .......... .......... .......... .......... 79% 35.4M 1s 2023-12-03T11:37:15.324 INFO:teuthology.orchestra.run.smithi131.stderr: 74050K .......... .......... .......... .......... .......... 79% 11.4M 1s 2023-12-03T11:37:15.326 INFO:teuthology.orchestra.run.smithi131.stderr: 74100K .......... .......... .......... .......... .......... 79% 20.0M 1s 2023-12-03T11:37:15.327 INFO:teuthology.orchestra.run.smithi131.stderr: 74150K .......... .......... .......... .......... .......... 79% 47.3M 1s 2023-12-03T11:37:15.332 INFO:teuthology.orchestra.run.smithi131.stderr: 74200K .......... .......... .......... .......... .......... 79% 9.75M 1s 2023-12-03T11:37:15.336 INFO:teuthology.orchestra.run.smithi131.stderr: 74250K .......... .......... .......... .......... .......... 79% 12.4M 1s 2023-12-03T11:37:15.344 INFO:teuthology.orchestra.run.smithi131.stderr: 74300K .......... .......... .......... .......... .......... 80% 6.50M 1s 2023-12-03T11:37:15.347 INFO:teuthology.orchestra.run.smithi131.stderr: 74350K .......... .......... .......... .......... .......... 80% 15.1M 1s 2023-12-03T11:37:15.349 INFO:teuthology.orchestra.run.smithi131.stderr: 74400K .......... .......... .......... .......... .......... 80% 18.1M 1s 2023-12-03T11:37:15.354 INFO:teuthology.orchestra.run.smithi131.stderr: 74450K .......... .......... .......... .......... .......... 80% 11.2M 1s 2023-12-03T11:37:15.356 INFO:teuthology.orchestra.run.smithi131.stderr: 74500K .......... .......... .......... .......... .......... 80% 25.4M 1s 2023-12-03T11:37:15.360 INFO:teuthology.orchestra.run.smithi131.stderr: 74550K .......... .......... .......... .......... .......... 80% 19.6M 1s 2023-12-03T11:37:15.362 INFO:teuthology.orchestra.run.smithi131.stderr: 74600K .......... .......... .......... .......... .......... 80% 62.7M 1s 2023-12-03T11:37:15.362 INFO:teuthology.orchestra.run.smithi131.stderr: 74650K .......... .......... .......... .......... .......... 80% 23.0M 1s 2023-12-03T11:37:15.366 INFO:teuthology.orchestra.run.smithi131.stderr: 74700K .......... .......... .......... .......... .......... 80% 10.3M 1s 2023-12-03T11:37:15.369 INFO:teuthology.orchestra.run.smithi131.stderr: 74750K .......... .......... .......... .......... .......... 80% 24.2M 1s 2023-12-03T11:37:15.370 INFO:teuthology.orchestra.run.smithi131.stderr: 74800K .......... .......... .......... .......... .......... 80% 22.6M 1s 2023-12-03T11:37:15.372 INFO:teuthology.orchestra.run.smithi131.stderr: 74850K .......... .......... .......... .......... .......... 80% 31.4M 1s 2023-12-03T11:37:15.374 INFO:teuthology.orchestra.run.smithi131.stderr: 74900K .......... .......... .......... .......... .......... 80% 18.9M 1s 2023-12-03T11:37:15.376 INFO:teuthology.orchestra.run.smithi131.stderr: 74950K .......... .......... .......... .......... .......... 80% 29.2M 1s 2023-12-03T11:37:15.379 INFO:teuthology.orchestra.run.smithi131.stderr: 75000K .......... .......... .......... .......... .......... 80% 14.6M 1s 2023-12-03T11:37:15.381 INFO:teuthology.orchestra.run.smithi131.stderr: 75050K .......... .......... .......... .......... .......... 80% 25.6M 1s 2023-12-03T11:37:15.383 INFO:teuthology.orchestra.run.smithi131.stderr: 75100K .......... .......... .......... .......... .......... 80% 28.8M 1s 2023-12-03T11:37:15.386 INFO:teuthology.orchestra.run.smithi131.stderr: 75150K .......... .......... .......... .......... .......... 80% 16.8M 1s 2023-12-03T11:37:15.388 INFO:teuthology.orchestra.run.smithi131.stderr: 75200K .......... .......... .......... .......... .......... 81% 27.5M 1s 2023-12-03T11:37:15.390 INFO:teuthology.orchestra.run.smithi131.stderr: 75250K .......... .......... .......... .......... .......... 81% 21.6M 1s 2023-12-03T11:37:15.393 INFO:teuthology.orchestra.run.smithi131.stderr: 75300K .......... .......... .......... .......... .......... 81% 18.4M 1s 2023-12-03T11:37:15.394 INFO:teuthology.orchestra.run.smithi131.stderr: 75350K .......... .......... .......... .......... .......... 81% 34.0M 1s 2023-12-03T11:37:15.396 INFO:teuthology.orchestra.run.smithi131.stderr: 75400K .......... .......... .......... .......... .......... 81% 32.1M 1s 2023-12-03T11:37:15.398 INFO:teuthology.orchestra.run.smithi131.stderr: 75450K .......... .......... .......... .......... .......... 81% 24.3M 1s 2023-12-03T11:37:15.400 INFO:teuthology.orchestra.run.smithi131.stderr: 75500K .......... .......... .......... .......... .......... 81% 22.4M 1s 2023-12-03T11:37:15.400 INFO:teuthology.orchestra.run.smithi131.stderr: 75550K .......... .......... .......... .......... .......... 81% 80.1M 1s 2023-12-03T11:37:15.403 INFO:teuthology.orchestra.run.smithi131.stderr: 75600K .......... .......... .......... .......... .......... 81% 16.0M 1s 2023-12-03T11:37:15.406 INFO:teuthology.orchestra.run.smithi131.stderr: 75650K .......... .......... .......... .......... .......... 81% 26.7M 1s 2023-12-03T11:37:15.408 INFO:teuthology.orchestra.run.smithi131.stderr: 75700K .......... .......... .......... .......... .......... 81% 22.1M 1s 2023-12-03T11:37:15.410 INFO:teuthology.orchestra.run.smithi131.stderr: 75750K .......... .......... .......... .......... .......... 81% 27.3M 1s 2023-12-03T11:37:15.410 INFO:teuthology.orchestra.run.smithi131.stderr: 75800K .......... .......... .......... .......... .......... 81% 72.1M 1s 2023-12-03T11:37:15.426 INFO:teuthology.orchestra.run.smithi131.stderr: 75850K .......... .......... .......... .......... .......... 81% 2.95M 1s 2023-12-03T11:37:15.429 INFO:teuthology.orchestra.run.smithi131.stderr: 75900K .......... .......... .......... .......... .......... 81% 17.7M 1s 2023-12-03T11:37:15.432 INFO:teuthology.orchestra.run.smithi131.stderr: 75950K .......... .......... .......... .......... .......... 81% 16.7M 1s 2023-12-03T11:37:15.434 INFO:teuthology.orchestra.run.smithi131.stderr: 76000K .......... .......... .......... .......... .......... 81% 39.5M 1s 2023-12-03T11:37:15.435 INFO:teuthology.orchestra.run.smithi131.stderr: 76050K .......... .......... .......... .......... .......... 81% 21.6M 1s 2023-12-03T11:37:15.437 INFO:teuthology.orchestra.run.smithi131.stderr: 76100K .......... .......... .......... .......... .......... 81% 37.9M 1s 2023-12-03T11:37:15.439 INFO:teuthology.orchestra.run.smithi131.stderr: 76150K .......... .......... .......... .......... .......... 82% 23.4M 1s 2023-12-03T11:37:15.441 INFO:teuthology.orchestra.run.smithi131.stderr: 76200K .......... .......... .......... .......... .......... 82% 26.8M 1s 2023-12-03T11:37:15.441 INFO:teuthology.orchestra.run.smithi131.stderr: 76250K .......... .......... .......... .......... .......... 82% 73.1M 1s 2023-12-03T11:37:15.443 INFO:teuthology.orchestra.run.smithi131.stderr: 76300K .......... .......... .......... .......... .......... 82% 22.3M 1s 2023-12-03T11:37:15.447 INFO:teuthology.orchestra.run.smithi131.stderr: 76350K .......... .......... .......... .......... .......... 82% 16.6M 1s 2023-12-03T11:37:15.448 INFO:teuthology.orchestra.run.smithi131.stderr: 76400K .......... .......... .......... .......... .......... 82% 33.5M 1s 2023-12-03T11:37:15.448 INFO:teuthology.orchestra.run.smithi131.stderr: 76450K .......... .......... .......... .......... .......... 82% 84.9M 1s 2023-12-03T11:37:15.451 INFO:teuthology.orchestra.run.smithi131.stderr: 76500K .......... .......... .......... .......... .......... 82% 24.4M 1s 2023-12-03T11:37:15.453 INFO:teuthology.orchestra.run.smithi131.stderr: 76550K .......... .......... .......... .......... .......... 82% 17.0M 1s 2023-12-03T11:37:15.455 INFO:teuthology.orchestra.run.smithi131.stderr: 76600K .......... .......... .......... .......... .......... 82% 36.4M 1s 2023-12-03T11:37:15.458 INFO:teuthology.orchestra.run.smithi131.stderr: 76650K .......... .......... .......... .......... .......... 82% 15.6M 1s 2023-12-03T11:37:15.459 INFO:teuthology.orchestra.run.smithi131.stderr: 76700K .......... .......... .......... .......... .......... 82% 44.9M 1s 2023-12-03T11:37:15.461 INFO:teuthology.orchestra.run.smithi131.stderr: 76750K .......... .......... .......... .......... .......... 82% 22.8M 1s 2023-12-03T11:37:15.463 INFO:teuthology.orchestra.run.smithi131.stderr: 76800K .......... .......... .......... .......... .......... 82% 29.5M 1s 2023-12-03T11:37:15.464 INFO:teuthology.orchestra.run.smithi131.stderr: 76850K .......... .......... .......... .......... .......... 82% 39.3M 1s 2023-12-03T11:37:15.466 INFO:teuthology.orchestra.run.smithi131.stderr: 76900K .......... .......... .......... .......... .......... 82% 23.9M 1s 2023-12-03T11:37:15.467 INFO:teuthology.orchestra.run.smithi131.stderr: 76950K .......... .......... .......... .......... .......... 82% 65.4M 1s 2023-12-03T11:37:15.469 INFO:teuthology.orchestra.run.smithi131.stderr: 77000K .......... .......... .......... .......... .......... 82% 21.2M 1s 2023-12-03T11:37:15.472 INFO:teuthology.orchestra.run.smithi131.stderr: 77050K .......... .......... .......... .......... .......... 82% 15.9M 1s 2023-12-03T11:37:15.475 INFO:teuthology.orchestra.run.smithi131.stderr: 77100K .......... .......... .......... .......... .......... 83% 24.2M 1s 2023-12-03T11:37:15.475 INFO:teuthology.orchestra.run.smithi131.stderr: 77150K .......... .......... .......... .......... .......... 83% 85.6M 1s 2023-12-03T11:37:15.476 INFO:teuthology.orchestra.run.smithi131.stderr: 77200K .......... .......... .......... .......... .......... 83% 30.8M 1s 2023-12-03T11:37:15.477 INFO:teuthology.orchestra.run.smithi131.stderr: 77250K .......... .......... .......... .......... .......... 83% 66.4M 1s 2023-12-03T11:37:15.479 INFO:teuthology.orchestra.run.smithi131.stderr: 77300K .......... .......... .......... .......... .......... 83% 23.5M 1s 2023-12-03T11:37:15.481 INFO:teuthology.orchestra.run.smithi131.stderr: 77350K .......... .......... .......... .......... .......... 83% 22.6M 1s 2023-12-03T11:37:15.483 INFO:teuthology.orchestra.run.smithi131.stderr: 77400K .......... .......... .......... .......... .......... 83% 21.3M 1s 2023-12-03T11:37:15.486 INFO:teuthology.orchestra.run.smithi131.stderr: 77450K .......... .......... .......... .......... .......... 83% 18.4M 1s 2023-12-03T11:37:15.491 INFO:teuthology.orchestra.run.smithi131.stderr: 77500K .......... .......... .......... .......... .......... 83% 9.65M 1s 2023-12-03T11:37:15.497 INFO:teuthology.orchestra.run.smithi131.stderr: 77550K .......... .......... .......... .......... .......... 83% 9.96M 1s 2023-12-03T11:37:15.498 INFO:teuthology.orchestra.run.smithi131.stderr: 77600K .......... .......... .......... .......... .......... 83% 24.4M 1s 2023-12-03T11:37:15.500 INFO:teuthology.orchestra.run.smithi131.stderr: 77650K .......... .......... .......... .......... .......... 83% 29.8M 1s 2023-12-03T11:37:15.504 INFO:teuthology.orchestra.run.smithi131.stderr: 77700K .......... .......... .......... .......... .......... 83% 11.3M 1s 2023-12-03T11:37:15.525 INFO:teuthology.orchestra.run.smithi131.stderr: 77750K .......... .......... .......... .......... .......... 83% 4.39M 1s 2023-12-03T11:37:15.533 INFO:teuthology.orchestra.run.smithi131.stderr: 77800K .......... .......... .......... .......... .......... 83% 2.69M 1s 2023-12-03T11:37:15.539 INFO:teuthology.orchestra.run.smithi131.stderr: 77850K .......... .......... .......... .......... .......... 83% 11.1M 1s 2023-12-03T11:37:15.539 INFO:teuthology.orchestra.run.smithi131.stderr: 77900K .......... .......... .......... .......... .......... 83% 77.5M 1s 2023-12-03T11:37:15.543 INFO:teuthology.orchestra.run.smithi131.stderr: 77950K .......... .......... .......... .......... .......... 83% 9.75M 1s 2023-12-03T11:37:15.546 INFO:teuthology.orchestra.run.smithi131.stderr: 78000K .......... .......... .......... .......... .......... 84% 18.0M 1s 2023-12-03T11:37:15.550 INFO:teuthology.orchestra.run.smithi131.stderr: 78050K .......... .......... .......... .......... .......... 84% 12.6M 1s 2023-12-03T11:37:15.552 INFO:teuthology.orchestra.run.smithi131.stderr: 78100K .......... .......... .......... .......... .......... 84% 29.8M 1s 2023-12-03T11:37:15.556 INFO:teuthology.orchestra.run.smithi131.stderr: 78150K .......... .......... .......... .......... .......... 84% 12.0M 1s 2023-12-03T11:37:15.565 INFO:teuthology.orchestra.run.smithi131.stderr: 78200K .......... .......... .......... .......... .......... 84% 5.39M 1s 2023-12-03T11:37:15.568 INFO:teuthology.orchestra.run.smithi131.stderr: 78250K .......... .......... .......... .......... .......... 84% 15.6M 1s 2023-12-03T11:37:15.574 INFO:teuthology.orchestra.run.smithi131.stderr: 78300K .......... .......... .......... .......... .......... 84% 8.33M 1s 2023-12-03T11:37:15.576 INFO:teuthology.orchestra.run.smithi131.stderr: 78350K .......... .......... .......... .......... .......... 84% 19.6M 1s 2023-12-03T11:37:15.580 INFO:teuthology.orchestra.run.smithi131.stderr: 78400K .......... .......... .......... .......... .......... 84% 14.0M 1s 2023-12-03T11:37:15.582 INFO:teuthology.orchestra.run.smithi131.stderr: 78450K .......... .......... .......... .......... .......... 84% 27.2M 1s 2023-12-03T11:37:15.583 INFO:teuthology.orchestra.run.smithi131.stderr: 78500K .......... .......... .......... .......... .......... 84% 26.5M 1s 2023-12-03T11:37:15.587 INFO:teuthology.orchestra.run.smithi131.stderr: 78550K .......... .......... .......... .......... .......... 84% 14.0M 1s 2023-12-03T11:37:15.589 INFO:teuthology.orchestra.run.smithi131.stderr: 78600K .......... .......... .......... .......... .......... 84% 22.6M 1s 2023-12-03T11:37:15.592 INFO:teuthology.orchestra.run.smithi131.stderr: 78650K .......... .......... .......... .......... .......... 84% 18.8M 1s 2023-12-03T11:37:15.594 INFO:teuthology.orchestra.run.smithi131.stderr: 78700K .......... .......... .......... .......... .......... 84% 24.6M 1s 2023-12-03T11:37:15.597 INFO:teuthology.orchestra.run.smithi131.stderr: 78750K .......... .......... .......... .......... .......... 84% 15.1M 1s 2023-12-03T11:37:15.598 INFO:teuthology.orchestra.run.smithi131.stderr: 78800K .......... .......... .......... .......... .......... 84% 28.4M 1s 2023-12-03T11:37:15.601 INFO:teuthology.orchestra.run.smithi131.stderr: 78850K .......... .......... .......... .......... .......... 84% 23.5M 1s 2023-12-03T11:37:15.604 INFO:teuthology.orchestra.run.smithi131.stderr: 78900K .......... .......... .......... .......... .......... 84% 14.6M 1s 2023-12-03T11:37:15.606 INFO:teuthology.orchestra.run.smithi131.stderr: 78950K .......... .......... .......... .......... .......... 85% 26.3M 1s 2023-12-03T11:37:15.610 INFO:teuthology.orchestra.run.smithi131.stderr: 79000K .......... .......... .......... .......... .......... 85% 11.9M 1s 2023-12-03T11:37:15.611 INFO:teuthology.orchestra.run.smithi131.stderr: 79050K .......... .......... .......... .......... .......... 85% 53.2M 1s 2023-12-03T11:37:15.613 INFO:teuthology.orchestra.run.smithi131.stderr: 79100K .......... .......... .......... .......... .......... 85% 22.1M 1s 2023-12-03T11:37:15.617 INFO:teuthology.orchestra.run.smithi131.stderr: 79150K .......... .......... .......... .......... .......... 85% 23.5M 1s 2023-12-03T11:37:15.619 INFO:teuthology.orchestra.run.smithi131.stderr: 79200K .......... .......... .......... .......... .......... 85% 13.9M 1s 2023-12-03T11:37:15.621 INFO:teuthology.orchestra.run.smithi131.stderr: 79250K .......... .......... .......... .......... .......... 85% 23.4M 1s 2023-12-03T11:37:15.621 INFO:teuthology.orchestra.run.smithi131.stderr: 79300K .......... .......... .......... .......... .......... 85% 76.2M 1s 2023-12-03T11:37:15.624 INFO:teuthology.orchestra.run.smithi131.stderr: 79350K .......... .......... .......... .......... .......... 85% 21.0M 1s 2023-12-03T11:37:15.626 INFO:teuthology.orchestra.run.smithi131.stderr: 79400K .......... .......... .......... .......... .......... 85% 25.0M 1s 2023-12-03T11:37:15.628 INFO:teuthology.orchestra.run.smithi131.stderr: 79450K .......... .......... .......... .......... .......... 85% 19.0M 1s 2023-12-03T11:37:15.631 INFO:teuthology.orchestra.run.smithi131.stderr: 79500K .......... .......... .......... .......... .......... 85% 14.6M 1s 2023-12-03T11:37:15.632 INFO:teuthology.orchestra.run.smithi131.stderr: 79550K .......... .......... .......... .......... .......... 85% 85.0M 1s 2023-12-03T11:37:15.635 INFO:teuthology.orchestra.run.smithi131.stderr: 79600K .......... .......... .......... .......... .......... 85% 17.8M 1s 2023-12-03T11:37:15.637 INFO:teuthology.orchestra.run.smithi131.stderr: 79650K .......... .......... .......... .......... .......... 85% 26.7M 1s 2023-12-03T11:37:15.653 INFO:teuthology.orchestra.run.smithi131.stderr: 79700K .......... .......... .......... .......... .......... 85% 3.03M 1s 2023-12-03T11:37:15.657 INFO:teuthology.orchestra.run.smithi131.stderr: 79750K .......... .......... .......... .......... .......... 85% 12.2M 1s 2023-12-03T11:37:15.659 INFO:teuthology.orchestra.run.smithi131.stderr: 79800K .......... .......... .......... .......... .......... 85% 26.4M 1s 2023-12-03T11:37:15.661 INFO:teuthology.orchestra.run.smithi131.stderr: 79850K .......... .......... .......... .......... .......... 86% 17.9M 1s 2023-12-03T11:37:15.663 INFO:teuthology.orchestra.run.smithi131.stderr: 79900K .......... .......... .......... .......... .......... 86% 25.6M 1s 2023-12-03T11:37:15.666 INFO:teuthology.orchestra.run.smithi131.stderr: 79950K .......... .......... .......... .......... .......... 86% 24.4M 1s 2023-12-03T11:37:15.666 INFO:teuthology.orchestra.run.smithi131.stderr: 80000K .......... .......... .......... .......... .......... 86% 87.8M 1s 2023-12-03T11:37:15.669 INFO:teuthology.orchestra.run.smithi131.stderr: 80050K .......... .......... .......... .......... .......... 86% 21.9M 1s 2023-12-03T11:37:15.675 INFO:teuthology.orchestra.run.smithi131.stderr: 80100K .......... .......... .......... .......... .......... 86% 9.46M 1s 2023-12-03T11:37:15.675 INFO:teuthology.orchestra.run.smithi131.stderr: 80150K .......... .......... .......... .......... .......... 86% 334M 1s 2023-12-03T11:37:15.675 INFO:teuthology.orchestra.run.smithi131.stderr: 80200K .......... .......... .......... .......... .......... 86% 43.0M 1s 2023-12-03T11:37:15.676 INFO:teuthology.orchestra.run.smithi131.stderr: 80250K .......... .......... .......... .......... .......... 86% 32.5M 1s 2023-12-03T11:37:15.678 INFO:teuthology.orchestra.run.smithi131.stderr: 80300K .......... .......... .......... .......... .......... 86% 28.4M 1s 2023-12-03T11:37:15.680 INFO:teuthology.orchestra.run.smithi131.stderr: 80350K .......... .......... .......... .......... .......... 86% 22.7M 1s 2023-12-03T11:37:15.683 INFO:teuthology.orchestra.run.smithi131.stderr: 80400K .......... .......... .......... .......... .......... 86% 20.2M 1s 2023-12-03T11:37:15.683 INFO:teuthology.orchestra.run.smithi131.stderr: 80450K .......... .......... .......... .......... .......... 86% 83.7M 1s 2023-12-03T11:37:15.686 INFO:teuthology.orchestra.run.smithi131.stderr: 80500K .......... .......... .......... .......... .......... 86% 15.2M 1s 2023-12-03T11:37:15.690 INFO:teuthology.orchestra.run.smithi131.stderr: 80550K .......... .......... .......... .......... .......... 86% 16.4M 1s 2023-12-03T11:37:15.691 INFO:teuthology.orchestra.run.smithi131.stderr: 80600K .......... .......... .......... .......... .......... 86% 29.1M 1s 2023-12-03T11:37:15.694 INFO:teuthology.orchestra.run.smithi131.stderr: 80650K .......... .......... .......... .......... .......... 86% 19.8M 1s 2023-12-03T11:37:15.694 INFO:teuthology.orchestra.run.smithi131.stderr: 80700K .......... .......... .......... .......... .......... 86% 89.2M 1s 2023-12-03T11:37:15.695 INFO:teuthology.orchestra.run.smithi131.stderr: 80750K .......... .......... .......... .......... .......... 86% 31.0M 1s 2023-12-03T11:37:15.698 INFO:teuthology.orchestra.run.smithi131.stderr: 80800K .......... .......... .......... .......... .......... 87% 25.1M 1s 2023-12-03T11:37:15.700 INFO:teuthology.orchestra.run.smithi131.stderr: 80850K .......... .......... .......... .......... .......... 87% 20.6M 1s 2023-12-03T11:37:15.702 INFO:teuthology.orchestra.run.smithi131.stderr: 80900K .......... .......... .......... .......... .......... 87% 22.9M 1s 2023-12-03T11:37:15.704 INFO:teuthology.orchestra.run.smithi131.stderr: 80950K .......... .......... .......... .......... .......... 87% 30.3M 1s 2023-12-03T11:37:15.706 INFO:teuthology.orchestra.run.smithi131.stderr: 81000K .......... .......... .......... .......... .......... 87% 21.7M 1s 2023-12-03T11:37:15.707 INFO:teuthology.orchestra.run.smithi131.stderr: 81050K .......... .......... .......... .......... .......... 87% 32.9M 1s 2023-12-03T11:37:15.709 INFO:teuthology.orchestra.run.smithi131.stderr: 81100K .......... .......... .......... .......... .......... 87% 41.4M 1s 2023-12-03T11:37:15.709 INFO:teuthology.orchestra.run.smithi131.stderr: 81150K .......... .......... .......... .......... .......... 87% 57.5M 1s 2023-12-03T11:37:15.711 INFO:teuthology.orchestra.run.smithi131.stderr: 81200K .......... .......... .......... .......... .......... 87% 30.8M 1s 2023-12-03T11:37:15.714 INFO:teuthology.orchestra.run.smithi131.stderr: 81250K .......... .......... .......... .......... .......... 87% 15.5M 1s 2023-12-03T11:37:15.718 INFO:teuthology.orchestra.run.smithi131.stderr: 81300K .......... .......... .......... .......... .......... 87% 14.3M 1s 2023-12-03T11:37:15.721 INFO:teuthology.orchestra.run.smithi131.stderr: 81350K .......... .......... .......... .......... .......... 87% 14.1M 1s 2023-12-03T11:37:15.723 INFO:teuthology.orchestra.run.smithi131.stderr: 81400K .......... .......... .......... .......... .......... 87% 23.4M 1s 2023-12-03T11:37:15.728 INFO:teuthology.orchestra.run.smithi131.stderr: 81450K .......... .......... .......... .......... .......... 87% 10.2M 1s 2023-12-03T11:37:15.730 INFO:teuthology.orchestra.run.smithi131.stderr: 81500K .......... .......... .......... .......... .......... 87% 22.7M 1s 2023-12-03T11:37:15.734 INFO:teuthology.orchestra.run.smithi131.stderr: 81550K .......... .......... .......... .......... .......... 87% 11.9M 1s 2023-12-03T11:37:15.737 INFO:teuthology.orchestra.run.smithi131.stderr: 81600K .......... .......... .......... .......... .......... 87% 17.5M 1s 2023-12-03T11:37:15.756 INFO:teuthology.orchestra.run.smithi131.stderr: 81650K .......... .......... .......... .......... .......... 87% 2.56M 1s 2023-12-03T11:37:15.767 INFO:teuthology.orchestra.run.smithi131.stderr: 81700K .......... .......... .......... .......... .......... 87% 4.58M 1s 2023-12-03T11:37:15.768 INFO:teuthology.orchestra.run.smithi131.stderr: 81750K .......... .......... .......... .......... .......... 88% 25.9M 1s 2023-12-03T11:37:15.773 INFO:teuthology.orchestra.run.smithi131.stderr: 81800K .......... .......... .......... .......... .......... 88% 11.0M 1s 2023-12-03T11:37:15.774 INFO:teuthology.orchestra.run.smithi131.stderr: 81850K .......... .......... .......... .......... .......... 88% 40.0M 1s 2023-12-03T11:37:15.776 INFO:teuthology.orchestra.run.smithi131.stderr: 81900K .......... .......... .......... .......... .......... 88% 19.5M 1s 2023-12-03T11:37:15.781 INFO:teuthology.orchestra.run.smithi131.stderr: 81950K .......... .......... .......... .......... .......... 88% 32.8M 1s 2023-12-03T11:37:15.785 INFO:teuthology.orchestra.run.smithi131.stderr: 82000K .......... .......... .......... .......... .......... 88% 7.79M 1s 2023-12-03T11:37:15.795 INFO:teuthology.orchestra.run.smithi131.stderr: 82050K .......... .......... .......... .......... .......... 88% 4.69M 1s 2023-12-03T11:37:15.796 INFO:teuthology.orchestra.run.smithi131.stderr: 82100K .......... .......... .......... .......... .......... 88% 31.7M 1s 2023-12-03T11:37:15.802 INFO:teuthology.orchestra.run.smithi131.stderr: 82150K .......... .......... .......... .......... .......... 88% 8.31M 1s 2023-12-03T11:37:15.805 INFO:teuthology.orchestra.run.smithi131.stderr: 82200K .......... .......... .......... .......... .......... 88% 15.5M 1s 2023-12-03T11:37:15.810 INFO:teuthology.orchestra.run.smithi131.stderr: 82250K .......... .......... .......... .......... .......... 88% 11.2M 1s 2023-12-03T11:37:15.813 INFO:teuthology.orchestra.run.smithi131.stderr: 82300K .......... .......... .......... .......... .......... 88% 14.3M 1s 2023-12-03T11:37:15.814 INFO:teuthology.orchestra.run.smithi131.stderr: 82350K .......... .......... .......... .......... .......... 88% 60.3M 1s 2023-12-03T11:37:15.816 INFO:teuthology.orchestra.run.smithi131.stderr: 82400K .......... .......... .......... .......... .......... 88% 22.7M 1s 2023-12-03T11:37:15.819 INFO:teuthology.orchestra.run.smithi131.stderr: 82450K .......... .......... .......... .......... .......... 88% 16.2M 1s 2023-12-03T11:37:15.824 INFO:teuthology.orchestra.run.smithi131.stderr: 82500K .......... .......... .......... .......... .......... 88% 11.0M 1s 2023-12-03T11:37:15.826 INFO:teuthology.orchestra.run.smithi131.stderr: 82550K .......... .......... .......... .......... .......... 88% 22.2M 1s 2023-12-03T11:37:15.827 INFO:teuthology.orchestra.run.smithi131.stderr: 82600K .......... .......... .......... .......... .......... 88% 29.3M 1s 2023-12-03T11:37:15.831 INFO:teuthology.orchestra.run.smithi131.stderr: 82650K .......... .......... .......... .......... .......... 89% 15.3M 1s 2023-12-03T11:37:15.832 INFO:teuthology.orchestra.run.smithi131.stderr: 82700K .......... .......... .......... .......... .......... 89% 24.9M 1s 2023-12-03T11:37:15.837 INFO:teuthology.orchestra.run.smithi131.stderr: 82750K .......... .......... .......... .......... .......... 89% 15.0M 1s 2023-12-03T11:37:15.837 INFO:teuthology.orchestra.run.smithi131.stderr: 82800K .......... .......... .......... .......... .......... 89% 59.2M 1s 2023-12-03T11:37:15.839 INFO:teuthology.orchestra.run.smithi131.stderr: 82850K .......... .......... .......... .......... .......... 89% 20.8M 1s 2023-12-03T11:37:15.847 INFO:teuthology.orchestra.run.smithi131.stderr: 82900K .......... .......... .......... .......... .......... 89% 11.1M 1s 2023-12-03T11:37:15.847 INFO:teuthology.orchestra.run.smithi131.stderr: 82950K .......... .......... .......... .......... .......... 89% 32.2M 1s 2023-12-03T11:37:15.847 INFO:teuthology.orchestra.run.smithi131.stderr: 83000K .......... .......... .......... .......... .......... 89% 62.4M 1s 2023-12-03T11:37:15.850 INFO:teuthology.orchestra.run.smithi131.stderr: 83050K .......... .......... .......... .......... .......... 89% 11.2M 1s 2023-12-03T11:37:15.852 INFO:teuthology.orchestra.run.smithi131.stderr: 83100K .......... .......... .......... .......... .......... 89% 26.3M 1s 2023-12-03T11:37:15.854 INFO:teuthology.orchestra.run.smithi131.stderr: 83150K .......... .......... .......... .......... .......... 89% 29.8M 1s 2023-12-03T11:37:15.856 INFO:teuthology.orchestra.run.smithi131.stderr: 83200K .......... .......... .......... .......... .......... 89% 23.3M 1s 2023-12-03T11:37:15.857 INFO:teuthology.orchestra.run.smithi131.stderr: 83250K .......... .......... .......... .......... .......... 89% 40.9M 1s 2023-12-03T11:37:15.859 INFO:teuthology.orchestra.run.smithi131.stderr: 83300K .......... .......... .......... .......... .......... 89% 24.4M 1s 2023-12-03T11:37:15.863 INFO:teuthology.orchestra.run.smithi131.stderr: 83350K .......... .......... .......... .......... .......... 89% 13.4M 1s 2023-12-03T11:37:15.864 INFO:teuthology.orchestra.run.smithi131.stderr: 83400K .......... .......... .......... .......... .......... 89% 29.4M 1s 2023-12-03T11:37:15.867 INFO:teuthology.orchestra.run.smithi131.stderr: 83450K .......... .......... .......... .......... .......... 89% 54.3M 1s 2023-12-03T11:37:15.868 INFO:teuthology.orchestra.run.smithi131.stderr: 83500K .......... .......... .......... .......... .......... 89% 16.6M 1s 2023-12-03T11:37:15.870 INFO:teuthology.orchestra.run.smithi131.stderr: 83550K .......... .......... .......... .......... .......... 89% 25.1M 1s 2023-12-03T11:37:15.886 INFO:teuthology.orchestra.run.smithi131.stderr: 83600K .......... .......... .......... .......... .......... 90% 3.04M 1s 2023-12-03T11:37:15.888 INFO:teuthology.orchestra.run.smithi131.stderr: 83650K .......... .......... .......... .......... .......... 90% 21.5M 1s 2023-12-03T11:37:15.890 INFO:teuthology.orchestra.run.smithi131.stderr: 83700K .......... .......... .......... .......... .......... 90% 23.6M 1s 2023-12-03T11:37:15.893 INFO:teuthology.orchestra.run.smithi131.stderr: 83750K .......... .......... .......... .......... .......... 90% 18.0M 1s 2023-12-03T11:37:15.896 INFO:teuthology.orchestra.run.smithi131.stderr: 83800K .......... .......... .......... .......... .......... 90% 19.8M 1s 2023-12-03T11:37:15.897 INFO:teuthology.orchestra.run.smithi131.stderr: 83850K .......... .......... .......... .......... .......... 90% 34.6M 1s 2023-12-03T11:37:15.899 INFO:teuthology.orchestra.run.smithi131.stderr: 83900K .......... .......... .......... .......... .......... 90% 23.4M 1s 2023-12-03T11:37:15.904 INFO:teuthology.orchestra.run.smithi131.stderr: 83950K .......... .......... .......... .......... .......... 90% 9.59M 1s 2023-12-03T11:37:15.906 INFO:teuthology.orchestra.run.smithi131.stderr: 84000K .......... .......... .......... .......... .......... 90% 52.6M 1s 2023-12-03T11:37:15.906 INFO:teuthology.orchestra.run.smithi131.stderr: 84050K .......... .......... .......... .......... .......... 90% 93.7M 1s 2023-12-03T11:37:15.907 INFO:teuthology.orchestra.run.smithi131.stderr: 84100K .......... .......... .......... .......... .......... 90% 36.7M 1s 2023-12-03T11:37:15.908 INFO:teuthology.orchestra.run.smithi131.stderr: 84150K .......... .......... .......... .......... .......... 90% 31.9M 1s 2023-12-03T11:37:15.909 INFO:teuthology.orchestra.run.smithi131.stderr: 84200K .......... .......... .......... .......... .......... 90% 50.2M 1s 2023-12-03T11:37:15.911 INFO:teuthology.orchestra.run.smithi131.stderr: 84250K .......... .......... .......... .......... .......... 90% 31.2M 1s 2023-12-03T11:37:15.913 INFO:teuthology.orchestra.run.smithi131.stderr: 84300K .......... .......... .......... .......... .......... 90% 20.6M 1s 2023-12-03T11:37:15.915 INFO:teuthology.orchestra.run.smithi131.stderr: 84350K .......... .......... .......... .......... .......... 90% 24.9M 1s 2023-12-03T11:37:15.918 INFO:teuthology.orchestra.run.smithi131.stderr: 84400K .......... .......... .......... .......... .......... 90% 17.8M 1s 2023-12-03T11:37:15.919 INFO:teuthology.orchestra.run.smithi131.stderr: 84450K .......... .......... .......... .......... .......... 90% 34.3M 1s 2023-12-03T11:37:15.921 INFO:teuthology.orchestra.run.smithi131.stderr: 84500K .......... .......... .......... .......... .......... 91% 28.4M 1s 2023-12-03T11:37:15.923 INFO:teuthology.orchestra.run.smithi131.stderr: 84550K .......... .......... .......... .......... .......... 91% 23.5M 1s 2023-12-03T11:37:15.925 INFO:teuthology.orchestra.run.smithi131.stderr: 84600K .......... .......... .......... .......... .......... 91% 39.0M 1s 2023-12-03T11:37:15.925 INFO:teuthology.orchestra.run.smithi131.stderr: 84650K .......... .......... .......... .......... .......... 91% 89.6M 1s 2023-12-03T11:37:15.927 INFO:teuthology.orchestra.run.smithi131.stderr: 84700K .......... .......... .......... .......... .......... 91% 25.2M 1s 2023-12-03T11:37:15.929 INFO:teuthology.orchestra.run.smithi131.stderr: 84750K .......... .......... .......... .......... .......... 91% 26.9M 1s 2023-12-03T11:37:15.930 INFO:teuthology.orchestra.run.smithi131.stderr: 84800K .......... .......... .......... .......... .......... 91% 25.6M 1s 2023-12-03T11:37:15.934 INFO:teuthology.orchestra.run.smithi131.stderr: 84850K .......... .......... .......... .......... .......... 91% 16.4M 1s 2023-12-03T11:37:15.934 INFO:teuthology.orchestra.run.smithi131.stderr: 84900K .......... .......... .......... .......... .......... 91% 74.1M 1s 2023-12-03T11:37:15.936 INFO:teuthology.orchestra.run.smithi131.stderr: 84950K .......... .......... .......... .......... .......... 91% 35.2M 1s 2023-12-03T11:37:15.938 INFO:teuthology.orchestra.run.smithi131.stderr: 85000K .......... .......... .......... .......... .......... 91% 32.5M 1s 2023-12-03T11:37:15.939 INFO:teuthology.orchestra.run.smithi131.stderr: 85050K .......... .......... .......... .......... .......... 91% 30.9M 1s 2023-12-03T11:37:15.940 INFO:teuthology.orchestra.run.smithi131.stderr: 85100K .......... .......... .......... .......... .......... 91% 27.7M 1s 2023-12-03T11:37:15.942 INFO:teuthology.orchestra.run.smithi131.stderr: 85150K .......... .......... .......... .......... .......... 91% 35.3M 1s 2023-12-03T11:37:15.945 INFO:teuthology.orchestra.run.smithi131.stderr: 85200K .......... .......... .......... .......... .......... 91% 15.3M 1s 2023-12-03T11:37:15.948 INFO:teuthology.orchestra.run.smithi131.stderr: 85250K .......... .......... .......... .......... .......... 91% 16.9M 1s 2023-12-03T11:37:15.952 INFO:teuthology.orchestra.run.smithi131.stderr: 85300K .......... .......... .......... .......... .......... 91% 11.9M 1s 2023-12-03T11:37:15.954 INFO:teuthology.orchestra.run.smithi131.stderr: 85350K .......... .......... .......... .......... .......... 91% 23.5M 1s 2023-12-03T11:37:15.957 INFO:teuthology.orchestra.run.smithi131.stderr: 85400K .......... .......... .......... .......... .......... 91% 16.6M 1s 2023-12-03T11:37:15.961 INFO:teuthology.orchestra.run.smithi131.stderr: 85450K .......... .......... .......... .......... .......... 92% 14.0M 1s 2023-12-03T11:37:15.979 INFO:teuthology.orchestra.run.smithi131.stderr: 85500K .......... .......... .......... .......... .......... 92% 2.80M 1s 2023-12-03T11:37:15.985 INFO:teuthology.orchestra.run.smithi131.stderr: 85550K .......... .......... .......... .......... .......... 92% 6.33M 1s 2023-12-03T11:37:15.988 INFO:teuthology.orchestra.run.smithi131.stderr: 85600K .......... .......... .......... .......... .......... 92% 19.9M 1s 2023-12-03T11:37:15.991 INFO:teuthology.orchestra.run.smithi131.stderr: 85650K .......... .......... .......... .......... .......... 92% 20.7M 0s 2023-12-03T11:37:15.994 INFO:teuthology.orchestra.run.smithi131.stderr: 85700K .......... .......... .......... .......... .......... 92% 12.9M 0s 2023-12-03T11:37:15.996 INFO:teuthology.orchestra.run.smithi131.stderr: 85750K .......... .......... .......... .......... .......... 92% 22.0M 0s 2023-12-03T11:37:15.998 INFO:teuthology.orchestra.run.smithi131.stderr: 85800K .......... .......... .......... .......... .......... 92% 25.7M 0s 2023-12-03T11:37:16.002 INFO:teuthology.orchestra.run.smithi131.stderr: 85850K .......... .......... .......... .......... .......... 92% 12.7M 0s 2023-12-03T11:37:16.007 INFO:teuthology.orchestra.run.smithi131.stderr: 85900K .......... .......... .......... .......... .......... 92% 10.8M 0s 2023-12-03T11:37:16.016 INFO:teuthology.orchestra.run.smithi131.stderr: 85950K .......... .......... .......... .......... .......... 92% 5.51M 0s 2023-12-03T11:37:16.018 INFO:teuthology.orchestra.run.smithi131.stderr: 86000K .......... .......... .......... .......... .......... 92% 16.7M 0s 2023-12-03T11:37:16.022 INFO:teuthology.orchestra.run.smithi131.stderr: 86050K .......... .......... .......... .......... .......... 92% 13.3M 0s 2023-12-03T11:37:16.028 INFO:teuthology.orchestra.run.smithi131.stderr: 86100K .......... .......... .......... .......... .......... 92% 9.01M 0s 2023-12-03T11:37:16.032 INFO:teuthology.orchestra.run.smithi131.stderr: 86150K .......... .......... .......... .......... .......... 92% 11.9M 0s 2023-12-03T11:37:16.035 INFO:teuthology.orchestra.run.smithi131.stderr: 86200K .......... .......... .......... .......... .......... 92% 26.0M 0s 2023-12-03T11:37:16.038 INFO:teuthology.orchestra.run.smithi131.stderr: 86250K .......... .......... .......... .......... .......... 92% 17.9M 0s 2023-12-03T11:37:16.038 INFO:teuthology.orchestra.run.smithi131.stderr: 86300K .......... .......... .......... .......... .......... 92% 54.1M 0s 2023-12-03T11:37:16.042 INFO:teuthology.orchestra.run.smithi131.stderr: 86350K .......... .......... .......... .......... .......... 93% 10.2M 0s 2023-12-03T11:37:16.045 INFO:teuthology.orchestra.run.smithi131.stderr: 86400K .......... .......... .......... .......... .......... 93% 16.9M 0s 2023-12-03T11:37:16.047 INFO:teuthology.orchestra.run.smithi131.stderr: 86450K .......... .......... .......... .......... .......... 93% 19.5M 0s 2023-12-03T11:37:16.051 INFO:teuthology.orchestra.run.smithi131.stderr: 86500K .......... .......... .......... .......... .......... 93% 15.8M 0s 2023-12-03T11:37:16.052 INFO:teuthology.orchestra.run.smithi131.stderr: 86550K .......... .......... .......... .......... .......... 93% 26.4M 0s 2023-12-03T11:37:16.055 INFO:teuthology.orchestra.run.smithi131.stderr: 86600K .......... .......... .......... .......... .......... 93% 17.3M 0s 2023-12-03T11:37:16.058 INFO:teuthology.orchestra.run.smithi131.stderr: 86650K .......... .......... .......... .......... .......... 93% 20.2M 0s 2023-12-03T11:37:16.061 INFO:teuthology.orchestra.run.smithi131.stderr: 86700K .......... .......... .......... .......... .......... 93% 17.1M 0s 2023-12-03T11:37:16.061 INFO:teuthology.orchestra.run.smithi131.stderr: 86750K .......... .......... .......... .......... .......... 93% 66.2M 0s 2023-12-03T11:37:16.066 INFO:teuthology.orchestra.run.smithi131.stderr: 86800K .......... .......... .......... .......... .......... 93% 10.2M 0s 2023-12-03T11:37:16.067 INFO:teuthology.orchestra.run.smithi131.stderr: 86850K .......... .......... .......... .......... .......... 93% 32.6M 0s 2023-12-03T11:37:16.070 INFO:teuthology.orchestra.run.smithi131.stderr: 86900K .......... .......... .......... .......... .......... 93% 20.2M 0s 2023-12-03T11:37:16.074 INFO:teuthology.orchestra.run.smithi131.stderr: 86950K .......... .......... .......... .......... .......... 93% 17.3M 0s 2023-12-03T11:37:16.075 INFO:teuthology.orchestra.run.smithi131.stderr: 87000K .......... .......... .......... .......... .......... 93% 18.4M 0s 2023-12-03T11:37:16.077 INFO:teuthology.orchestra.run.smithi131.stderr: 87050K .......... .......... .......... .......... .......... 93% 29.6M 0s 2023-12-03T11:37:16.079 INFO:teuthology.orchestra.run.smithi131.stderr: 87100K .......... .......... .......... .......... .......... 93% 30.3M 0s 2023-12-03T11:37:16.081 INFO:teuthology.orchestra.run.smithi131.stderr: 87150K .......... .......... .......... .......... .......... 93% 19.0M 0s 2023-12-03T11:37:16.084 INFO:teuthology.orchestra.run.smithi131.stderr: 87200K .......... .......... .......... .......... .......... 93% 19.8M 0s 2023-12-03T11:37:16.085 INFO:teuthology.orchestra.run.smithi131.stderr: 87250K .......... .......... .......... .......... .......... 93% 29.4M 0s 2023-12-03T11:37:16.087 INFO:teuthology.orchestra.run.smithi131.stderr: 87300K .......... .......... .......... .......... .......... 94% 28.6M 0s 2023-12-03T11:37:16.089 INFO:teuthology.orchestra.run.smithi131.stderr: 87350K .......... .......... .......... .......... .......... 94% 19.7M 0s 2023-12-03T11:37:16.092 INFO:teuthology.orchestra.run.smithi131.stderr: 87400K .......... .......... .......... .......... .......... 94% 18.9M 0s 2023-12-03T11:37:16.106 INFO:teuthology.orchestra.run.smithi131.stderr: 87450K .......... .......... .......... .......... .......... 94% 3.47M 0s 2023-12-03T11:37:16.108 INFO:teuthology.orchestra.run.smithi131.stderr: 87500K .......... .......... .......... .......... .......... 94% 32.9M 0s 2023-12-03T11:37:16.111 INFO:teuthology.orchestra.run.smithi131.stderr: 87550K .......... .......... .......... .......... .......... 94% 14.6M 0s 2023-12-03T11:37:16.113 INFO:teuthology.orchestra.run.smithi131.stderr: 87600K .......... .......... .......... .......... .......... 94% 25.6M 0s 2023-12-03T11:37:16.116 INFO:teuthology.orchestra.run.smithi131.stderr: 87650K .......... .......... .......... .......... .......... 94% 15.8M 0s 2023-12-03T11:37:16.117 INFO:teuthology.orchestra.run.smithi131.stderr: 87700K .......... .......... .......... .......... .......... 94% 50.0M 0s 2023-12-03T11:37:16.119 INFO:teuthology.orchestra.run.smithi131.stderr: 87750K .......... .......... .......... .......... .......... 94% 35.0M 0s 2023-12-03T11:37:16.120 INFO:teuthology.orchestra.run.smithi131.stderr: 87800K .......... .......... .......... .......... .......... 94% 28.7M 0s 2023-12-03T11:37:16.125 INFO:teuthology.orchestra.run.smithi131.stderr: 87850K .......... .......... .......... .......... .......... 94% 9.54M 0s 2023-12-03T11:37:16.127 INFO:teuthology.orchestra.run.smithi131.stderr: 87900K .......... .......... .......... .......... .......... 94% 35.9M 0s 2023-12-03T11:37:16.128 INFO:teuthology.orchestra.run.smithi131.stderr: 87950K .......... .......... .......... .......... .......... 94% 45.3M 0s 2023-12-03T11:37:16.130 INFO:teuthology.orchestra.run.smithi131.stderr: 88000K .......... .......... .......... .......... .......... 94% 31.5M 0s 2023-12-03T11:37:16.130 INFO:teuthology.orchestra.run.smithi131.stderr: 88050K .......... .......... .......... .......... .......... 94% 67.2M 0s 2023-12-03T11:37:16.133 INFO:teuthology.orchestra.run.smithi131.stderr: 88100K .......... .......... .......... .......... .......... 94% 23.3M 0s 2023-12-03T11:37:16.133 INFO:teuthology.orchestra.run.smithi131.stderr: 88150K .......... .......... .......... .......... .......... 94% 72.3M 0s 2023-12-03T11:37:16.135 INFO:teuthology.orchestra.run.smithi131.stderr: 88200K .......... .......... .......... .......... .......... 94% 24.9M 0s 2023-12-03T11:37:16.138 INFO:teuthology.orchestra.run.smithi131.stderr: 88250K .......... .......... .......... .......... .......... 95% 16.3M 0s 2023-12-03T11:37:16.139 INFO:teuthology.orchestra.run.smithi131.stderr: 88300K .......... .......... .......... .......... .......... 95% 26.9M 0s 2023-12-03T11:37:16.142 INFO:teuthology.orchestra.run.smithi131.stderr: 88350K .......... .......... .......... .......... .......... 95% 32.9M 0s 2023-12-03T11:37:16.143 INFO:teuthology.orchestra.run.smithi131.stderr: 88400K .......... .......... .......... .......... .......... 95% 26.2M 0s 2023-12-03T11:37:16.145 INFO:teuthology.orchestra.run.smithi131.stderr: 88450K .......... .......... .......... .......... .......... 95% 22.2M 0s 2023-12-03T11:37:16.146 INFO:teuthology.orchestra.run.smithi131.stderr: 88500K .......... .......... .......... .......... .......... 95% 44.7M 0s 2023-12-03T11:37:16.148 INFO:teuthology.orchestra.run.smithi131.stderr: 88550K .......... .......... .......... .......... .......... 95% 33.6M 0s 2023-12-03T11:37:16.150 INFO:teuthology.orchestra.run.smithi131.stderr: 88600K .......... .......... .......... .......... .......... 95% 20.7M 0s 2023-12-03T11:37:16.151 INFO:teuthology.orchestra.run.smithi131.stderr: 88650K .......... .......... .......... .......... .......... 95% 62.3M 0s 2023-12-03T11:37:16.152 INFO:teuthology.orchestra.run.smithi131.stderr: 88700K .......... .......... .......... .......... .......... 95% 31.0M 0s 2023-12-03T11:37:16.155 INFO:teuthology.orchestra.run.smithi131.stderr: 88750K .......... .......... .......... .......... .......... 95% 17.7M 0s 2023-12-03T11:37:16.157 INFO:teuthology.orchestra.run.smithi131.stderr: 88800K .......... .......... .......... .......... .......... 95% 25.2M 0s 2023-12-03T11:37:16.158 INFO:teuthology.orchestra.run.smithi131.stderr: 88850K .......... .......... .......... .......... .......... 95% 73.1M 0s 2023-12-03T11:37:16.159 INFO:teuthology.orchestra.run.smithi131.stderr: 88900K .......... .......... .......... .......... .......... 95% 29.2M 0s 2023-12-03T11:37:16.161 INFO:teuthology.orchestra.run.smithi131.stderr: 88950K .......... .......... .......... .......... .......... 95% 34.0M 0s 2023-12-03T11:37:16.162 INFO:teuthology.orchestra.run.smithi131.stderr: 89000K .......... .......... .......... .......... .......... 95% 33.8M 0s 2023-12-03T11:37:16.166 INFO:teuthology.orchestra.run.smithi131.stderr: 89050K .......... .......... .......... .......... .......... 95% 14.7M 0s 2023-12-03T11:37:16.167 INFO:teuthology.orchestra.run.smithi131.stderr: 89100K .......... .......... .......... .......... .......... 95% 33.2M 0s 2023-12-03T11:37:16.170 INFO:teuthology.orchestra.run.smithi131.stderr: 89150K .......... .......... .......... .......... .......... 96% 15.0M 0s 2023-12-03T11:37:16.175 INFO:teuthology.orchestra.run.smithi131.stderr: 89200K .......... .......... .......... .......... .......... 96% 12.0M 0s 2023-12-03T11:37:16.176 INFO:teuthology.orchestra.run.smithi131.stderr: 89250K .......... .......... .......... .......... .......... 96% 31.5M 0s 2023-12-03T11:37:16.177 INFO:teuthology.orchestra.run.smithi131.stderr: 89300K .......... .......... .......... .......... .......... 96% 32.9M 0s 2023-12-03T11:37:16.181 INFO:teuthology.orchestra.run.smithi131.stderr: 89350K .......... .......... .......... .......... .......... 96% 15.3M 0s 2023-12-03T11:37:16.188 INFO:teuthology.orchestra.run.smithi131.stderr: 89400K .......... .......... .......... .......... .......... 96% 6.61M 0s 2023-12-03T11:37:16.205 INFO:teuthology.orchestra.run.smithi131.stderr: 89450K .......... .......... .......... .......... .......... 96% 2.99M 0s 2023-12-03T11:37:16.207 INFO:teuthology.orchestra.run.smithi131.stderr: 89500K .......... .......... .......... .......... .......... 96% 24.2M 0s 2023-12-03T11:37:16.207 INFO:teuthology.orchestra.run.smithi131.stderr: 89550K .......... .......... .......... .......... .......... 96% 96.5M 0s 2023-12-03T11:37:16.213 INFO:teuthology.orchestra.run.smithi131.stderr: 89600K .......... .......... .......... .......... .......... 96% 9.11M 0s 2023-12-03T11:37:16.213 INFO:teuthology.orchestra.run.smithi131.stderr: 89650K .......... .......... .......... .......... .......... 96% 79.4M 0s 2023-12-03T11:37:16.215 INFO:teuthology.orchestra.run.smithi131.stderr: 89700K .......... .......... .......... .......... .......... 96% 24.6M 0s 2023-12-03T11:37:16.217 INFO:teuthology.orchestra.run.smithi131.stderr: 89750K .......... .......... .......... .......... .......... 96% 17.6M 0s 2023-12-03T11:37:16.222 INFO:teuthology.orchestra.run.smithi131.stderr: 89800K .......... .......... .......... .......... .......... 96% 11.5M 0s 2023-12-03T11:37:16.231 INFO:teuthology.orchestra.run.smithi131.stderr: 89850K .......... .......... .......... .......... .......... 96% 5.47M 0s 2023-12-03T11:37:16.237 INFO:teuthology.orchestra.run.smithi131.stderr: 89900K .......... .......... .......... .......... .......... 96% 8.34M 0s 2023-12-03T11:37:16.239 INFO:teuthology.orchestra.run.smithi131.stderr: 89950K .......... .......... .......... .......... .......... 96% 19.3M 0s 2023-12-03T11:37:16.244 INFO:teuthology.orchestra.run.smithi131.stderr: 90000K .......... .......... .......... .......... .......... 96% 10.6M 0s 2023-12-03T11:37:16.246 INFO:teuthology.orchestra.run.smithi131.stderr: 90050K .......... .......... .......... .......... .......... 96% 23.3M 0s 2023-12-03T11:37:16.248 INFO:teuthology.orchestra.run.smithi131.stderr: 90100K .......... .......... .......... .......... .......... 97% 18.2M 0s 2023-12-03T11:37:16.251 INFO:teuthology.orchestra.run.smithi131.stderr: 90150K .......... .......... .......... .......... .......... 97% 27.9M 0s 2023-12-03T11:37:16.254 INFO:teuthology.orchestra.run.smithi131.stderr: 90200K .......... .......... .......... .......... .......... 97% 14.1M 0s 2023-12-03T11:37:16.258 INFO:teuthology.orchestra.run.smithi131.stderr: 90250K .......... .......... .......... .......... .......... 97% 10.6M 0s 2023-12-03T11:37:16.260 INFO:teuthology.orchestra.run.smithi131.stderr: 90300K .......... .......... .......... .......... .......... 97% 34.0M 0s 2023-12-03T11:37:16.262 INFO:teuthology.orchestra.run.smithi131.stderr: 90350K .......... .......... .......... .......... .......... 97% 19.8M 0s 2023-12-03T11:37:16.264 INFO:teuthology.orchestra.run.smithi131.stderr: 90400K .......... .......... .......... .......... .......... 97% 28.6M 0s 2023-12-03T11:37:16.267 INFO:teuthology.orchestra.run.smithi131.stderr: 90450K .......... .......... .......... .......... .......... 97% 15.2M 0s 2023-12-03T11:37:16.269 INFO:teuthology.orchestra.run.smithi131.stderr: 90500K .......... .......... .......... .......... .......... 97% 29.0M 0s 2023-12-03T11:37:16.272 INFO:teuthology.orchestra.run.smithi131.stderr: 90550K .......... .......... .......... .......... .......... 97% 17.4M 0s 2023-12-03T11:37:16.273 INFO:teuthology.orchestra.run.smithi131.stderr: 90600K .......... .......... .......... .......... .......... 97% 24.3M 0s 2023-12-03T11:37:16.277 INFO:teuthology.orchestra.run.smithi131.stderr: 90650K .......... .......... .......... .......... .......... 97% 12.6M 0s 2023-12-03T11:37:16.281 INFO:teuthology.orchestra.run.smithi131.stderr: 90700K .......... .......... .......... .......... .......... 97% 16.8M 0s 2023-12-03T11:37:16.281 INFO:teuthology.orchestra.run.smithi131.stderr: 90750K .......... .......... .......... .......... .......... 97% 102M 0s 2023-12-03T11:37:16.285 INFO:teuthology.orchestra.run.smithi131.stderr: 90800K .......... .......... .......... .......... .......... 97% 11.7M 0s 2023-12-03T11:37:16.287 INFO:teuthology.orchestra.run.smithi131.stderr: 90850K .......... .......... .......... .......... .......... 97% 26.8M 0s 2023-12-03T11:37:16.289 INFO:teuthology.orchestra.run.smithi131.stderr: 90900K .......... .......... .......... .......... .......... 97% 21.0M 0s 2023-12-03T11:37:16.292 INFO:teuthology.orchestra.run.smithi131.stderr: 90950K .......... .......... .......... .......... .......... 97% 25.1M 0s 2023-12-03T11:37:16.292 INFO:teuthology.orchestra.run.smithi131.stderr: 91000K .......... .......... .......... .......... .......... 98% 91.5M 0s 2023-12-03T11:37:16.295 INFO:teuthology.orchestra.run.smithi131.stderr: 91050K .......... .......... .......... .......... .......... 98% 17.2M 0s 2023-12-03T11:37:16.296 INFO:teuthology.orchestra.run.smithi131.stderr: 91100K .......... .......... .......... .......... .......... 98% 31.3M 0s 2023-12-03T11:37:16.299 INFO:teuthology.orchestra.run.smithi131.stderr: 91150K .......... .......... .......... .......... .......... 98% 14.8M 0s 2023-12-03T11:37:16.302 INFO:teuthology.orchestra.run.smithi131.stderr: 91200K .......... .......... .......... .......... .......... 98% 22.3M 0s 2023-12-03T11:37:16.303 INFO:teuthology.orchestra.run.smithi131.stderr: 91250K .......... .......... .......... .......... .......... 98% 27.1M 0s 2023-12-03T11:37:16.305 INFO:teuthology.orchestra.run.smithi131.stderr: 91300K .......... .......... .......... .......... .......... 98% 33.8M 0s 2023-12-03T11:37:16.318 INFO:teuthology.orchestra.run.smithi131.stderr: 91350K .......... .......... .......... .......... .......... 98% 3.67M 0s 2023-12-03T11:37:16.321 INFO:teuthology.orchestra.run.smithi131.stderr: 91400K .......... .......... .......... .......... .......... 98% 15.2M 0s 2023-12-03T11:37:16.323 INFO:teuthology.orchestra.run.smithi131.stderr: 91450K .......... .......... .......... .......... .......... 98% 27.6M 0s 2023-12-03T11:37:16.326 INFO:teuthology.orchestra.run.smithi131.stderr: 91500K .......... .......... .......... .......... .......... 98% 16.2M 0s 2023-12-03T11:37:16.329 INFO:teuthology.orchestra.run.smithi131.stderr: 91550K .......... .......... .......... .......... .......... 98% 17.4M 0s 2023-12-03T11:37:16.330 INFO:teuthology.orchestra.run.smithi131.stderr: 91600K .......... .......... .......... .......... .......... 98% 36.3M 0s 2023-12-03T11:37:16.331 INFO:teuthology.orchestra.run.smithi131.stderr: 91650K .......... .......... .......... .......... .......... 98% 70.1M 0s 2023-12-03T11:37:16.333 INFO:teuthology.orchestra.run.smithi131.stderr: 91700K .......... .......... .......... .......... .......... 98% 26.3M 0s 2023-12-03T11:37:16.338 INFO:teuthology.orchestra.run.smithi131.stderr: 91750K .......... .......... .......... .......... .......... 98% 8.48M 0s 2023-12-03T11:37:16.339 INFO:teuthology.orchestra.run.smithi131.stderr: 91800K .......... .......... .......... .......... .......... 98% 71.4M 0s 2023-12-03T11:37:16.341 INFO:teuthology.orchestra.run.smithi131.stderr: 91850K .......... .......... .......... .......... .......... 98% 33.9M 0s 2023-12-03T11:37:16.341 INFO:teuthology.orchestra.run.smithi131.stderr: 91900K .......... .......... .......... .......... .......... 98% 48.5M 0s 2023-12-03T11:37:16.343 INFO:teuthology.orchestra.run.smithi131.stderr: 91950K .......... .......... .......... .......... .......... 99% 33.2M 0s 2023-12-03T11:37:16.345 INFO:teuthology.orchestra.run.smithi131.stderr: 92000K .......... .......... .......... .......... .......... 99% 30.8M 0s 2023-12-03T11:37:16.347 INFO:teuthology.orchestra.run.smithi131.stderr: 92050K .......... .......... .......... .......... .......... 99% 22.6M 0s 2023-12-03T11:37:16.349 INFO:teuthology.orchestra.run.smithi131.stderr: 92100K .......... .......... .......... .......... .......... 99% 24.5M 0s 2023-12-03T11:37:16.350 INFO:teuthology.orchestra.run.smithi131.stderr: 92150K .......... .......... .......... .......... .......... 99% 29.8M 0s 2023-12-03T11:37:16.355 INFO:teuthology.orchestra.run.smithi131.stderr: 92200K .......... .......... .......... .......... .......... 99% 13.1M 0s 2023-12-03T11:37:16.355 INFO:teuthology.orchestra.run.smithi131.stderr: 92250K .......... .......... .......... .......... .......... 99% 94.6M 0s 2023-12-03T11:37:16.357 INFO:teuthology.orchestra.run.smithi131.stderr: 92300K .......... .......... .......... .......... .......... 99% 23.3M 0s 2023-12-03T11:37:16.357 INFO:teuthology.orchestra.run.smithi131.stderr: 92350K .......... .......... .......... .......... .......... 99% 78.8M 0s 2023-12-03T11:37:16.359 INFO:teuthology.orchestra.run.smithi131.stderr: 92400K .......... .......... .......... .......... .......... 99% 32.5M 0s 2023-12-03T11:37:16.361 INFO:teuthology.orchestra.run.smithi131.stderr: 92450K .......... .......... .......... .......... .......... 99% 33.8M 0s 2023-12-03T11:37:16.362 INFO:teuthology.orchestra.run.smithi131.stderr: 92500K .......... .......... .......... .......... .......... 99% 25.4M 0s 2023-12-03T11:37:16.365 INFO:teuthology.orchestra.run.smithi131.stderr: 92550K .......... .......... .......... .......... .......... 99% 21.4M 0s 2023-12-03T11:37:16.365 INFO:teuthology.orchestra.run.smithi131.stderr: 92600K .......... .......... .......... .......... .......... 99% 81.6M 0s 2023-12-03T11:37:16.368 INFO:teuthology.orchestra.run.smithi131.stderr: 92650K .......... .......... .......... .......... .......... 99% 16.9M 0s 2023-12-03T11:37:16.370 INFO:teuthology.orchestra.run.smithi131.stderr: 92700K .......... .......... .......... .......... .......... 99% 28.6M 0s 2023-12-03T11:37:16.372 INFO:teuthology.orchestra.run.smithi131.stderr: 92750K .......... .......... .......... .......... .......... 99% 28.8M 0s 2023-12-03T11:37:16.374 INFO:teuthology.orchestra.run.smithi131.stderr: 92800K .......... .......... .......... .......... .......... 99% 24.9M 0s 2023-12-03T11:37:16.374 INFO:teuthology.orchestra.run.smithi131.stderr: 92850K .......... .......... .......... .......... .......... 99% 91.9M 0s 2023-12-03T11:37:16.374 INFO:teuthology.orchestra.run.smithi131.stderr: 92900K 100% 134G=6.3s 2023-12-03T11:37:16.375 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-12-03T11:37:16.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03 11:37:16 (14.4 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2023-12-03T11:37:16.375 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-12-03T11:37:16.393 INFO:teuthology.orchestra.run.smithi131.stdout:Archive: gradle-6.0.1-bin.zip 2023-12-03T11:37:16.393 INFO:teuthology.orchestra.run.smithi131.stdout: creating: /opt/gradle/gradle-6.0.1/ 2023-12-03T11:37:16.395 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2023-12-03T11:37:16.395 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2023-12-03T11:37:16.395 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2023-12-03T11:37:16.395 INFO:teuthology.orchestra.run.smithi131.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2023-12-03T11:37:16.395 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2023-12-03T11:37:16.395 INFO:teuthology.orchestra.run.smithi131.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2023-12-03T11:37:16.395 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2023-12-03T11:37:16.395 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2023-12-03T11:37:16.395 INFO:teuthology.orchestra.run.smithi131.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2023-12-03T11:37:16.395 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2023-12-03T11:37:16.397 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2023-12-03T11:37:16.397 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2023-12-03T11:37:16.408 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2023-12-03T11:37:16.411 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2023-12-03T11:37:16.411 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2023-12-03T11:37:16.411 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2023-12-03T11:37:16.411 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2023-12-03T11:37:16.425 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2023-12-03T11:37:16.427 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2023-12-03T11:37:16.427 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2023-12-03T11:37:16.428 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2023-12-03T11:37:16.434 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2023-12-03T11:37:16.435 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2023-12-03T11:37:16.435 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2023-12-03T11:37:16.437 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2023-12-03T11:37:16.439 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2023-12-03T11:37:16.439 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2023-12-03T11:37:16.441 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2023-12-03T11:37:16.441 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2023-12-03T11:37:16.441 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2023-12-03T11:37:16.441 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2023-12-03T11:37:16.443 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2023-12-03T11:37:16.444 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2023-12-03T11:37:16.444 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2023-12-03T11:37:16.447 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2023-12-03T11:37:16.447 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2023-12-03T11:37:16.447 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2023-12-03T11:37:16.448 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2023-12-03T11:37:16.448 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2023-12-03T11:37:16.448 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2023-12-03T11:37:16.677 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2023-12-03T11:37:16.677 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2023-12-03T11:37:16.677 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2023-12-03T11:37:16.677 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2023-12-03T11:37:16.728 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2023-12-03T11:37:16.729 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2023-12-03T11:37:16.729 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2023-12-03T11:37:16.729 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2023-12-03T11:37:16.729 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2023-12-03T11:37:16.745 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2023-12-03T11:37:16.746 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2023-12-03T11:37:16.748 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2023-12-03T11:37:16.749 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2023-12-03T11:37:16.749 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2023-12-03T11:37:16.749 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2023-12-03T11:37:16.750 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2023-12-03T11:37:16.765 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2023-12-03T11:37:16.765 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2023-12-03T11:37:16.765 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2023-12-03T11:37:16.766 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2023-12-03T11:37:16.767 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2023-12-03T11:37:16.768 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2023-12-03T11:37:16.770 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2023-12-03T11:37:16.772 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2023-12-03T11:37:16.772 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2023-12-03T11:37:16.786 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2023-12-03T11:37:16.790 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2023-12-03T11:37:16.793 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2023-12-03T11:37:16.795 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2023-12-03T11:37:16.796 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2023-12-03T11:37:16.798 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2023-12-03T11:37:16.798 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2023-12-03T11:37:16.799 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2023-12-03T11:37:16.803 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2023-12-03T11:37:16.804 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2023-12-03T11:37:16.821 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2023-12-03T11:37:16.821 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2023-12-03T11:37:16.830 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2023-12-03T11:37:16.830 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2023-12-03T11:37:16.830 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2023-12-03T11:37:16.830 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2023-12-03T11:37:16.831 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2023-12-03T11:37:16.838 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2023-12-03T11:37:16.838 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2023-12-03T11:37:16.841 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2023-12-03T11:37:16.841 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2023-12-03T11:37:16.841 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2023-12-03T11:37:16.841 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2023-12-03T11:37:16.841 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2023-12-03T11:37:16.841 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2023-12-03T11:37:16.841 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2023-12-03T11:37:16.841 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2023-12-03T11:37:16.841 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2023-12-03T11:37:16.841 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2023-12-03T11:37:16.843 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2023-12-03T11:37:16.843 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2023-12-03T11:37:16.843 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2023-12-03T11:37:16.844 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2023-12-03T11:37:16.844 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2023-12-03T11:37:16.844 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2023-12-03T11:37:16.844 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2023-12-03T11:37:16.844 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2023-12-03T11:37:16.844 INFO:teuthology.orchestra.run.smithi131.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2023-12-03T11:37:16.844 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2023-12-03T11:37:16.845 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2023-12-03T11:37:16.845 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2023-12-03T11:37:16.845 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2023-12-03T11:37:16.846 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2023-12-03T11:37:16.847 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2023-12-03T11:37:16.849 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2023-12-03T11:37:16.850 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2023-12-03T11:37:16.851 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2023-12-03T11:37:16.852 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2023-12-03T11:37:16.853 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2023-12-03T11:37:16.855 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2023-12-03T11:37:16.856 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2023-12-03T11:37:16.856 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2023-12-03T11:37:16.857 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2023-12-03T11:37:16.858 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2023-12-03T11:37:16.858 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2023-12-03T11:37:16.859 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2023-12-03T11:37:16.861 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2023-12-03T11:37:16.862 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2023-12-03T11:37:16.864 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2023-12-03T11:37:16.864 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2023-12-03T11:37:16.865 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2023-12-03T11:37:16.865 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2023-12-03T11:37:16.865 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2023-12-03T11:37:16.866 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2023-12-03T11:37:16.867 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2023-12-03T11:37:16.869 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2023-12-03T11:37:16.869 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2023-12-03T11:37:16.870 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2023-12-03T11:37:16.873 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2023-12-03T11:37:16.875 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2023-12-03T11:37:16.876 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2023-12-03T11:37:16.877 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2023-12-03T11:37:16.878 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2023-12-03T11:37:16.879 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2023-12-03T11:37:16.885 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2023-12-03T11:37:16.885 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2023-12-03T11:37:16.899 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2023-12-03T11:37:16.900 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2023-12-03T11:37:16.901 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2023-12-03T11:37:16.901 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2023-12-03T11:37:16.901 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2023-12-03T11:37:16.901 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2023-12-03T11:37:16.901 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2023-12-03T11:37:16.902 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2023-12-03T11:37:16.902 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2023-12-03T11:37:16.902 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2023-12-03T11:37:16.920 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2023-12-03T11:37:16.920 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2023-12-03T11:37:16.920 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2023-12-03T11:37:16.921 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2023-12-03T11:37:16.922 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2023-12-03T11:37:16.923 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2023-12-03T11:37:16.930 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2023-12-03T11:37:16.932 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2023-12-03T11:37:16.936 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2023-12-03T11:37:16.936 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2023-12-03T11:37:16.937 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2023-12-03T11:37:16.937 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2023-12-03T11:37:16.938 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2023-12-03T11:37:16.938 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2023-12-03T11:37:16.940 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2023-12-03T11:37:16.948 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2023-12-03T11:37:16.950 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2023-12-03T11:37:16.951 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2023-12-03T11:37:16.952 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2023-12-03T11:37:16.952 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2023-12-03T11:37:16.952 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2023-12-03T11:37:16.953 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2023-12-03T11:37:16.955 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2023-12-03T11:37:16.959 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2023-12-03T11:37:16.960 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2023-12-03T11:37:16.961 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2023-12-03T11:37:16.963 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2023-12-03T11:37:16.966 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2023-12-03T11:37:16.966 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2023-12-03T11:37:16.973 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2023-12-03T11:37:16.976 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2023-12-03T11:37:16.982 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2023-12-03T11:37:16.987 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2023-12-03T11:37:16.990 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2023-12-03T11:37:16.991 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2023-12-03T11:37:16.999 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2023-12-03T11:37:17.001 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2023-12-03T11:37:17.008 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2023-12-03T11:37:17.008 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2023-12-03T11:37:17.017 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2023-12-03T11:37:17.019 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2023-12-03T11:37:17.019 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2023-12-03T11:37:17.023 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2023-12-03T11:37:17.029 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2023-12-03T11:37:17.057 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2023-12-03T11:37:17.060 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2023-12-03T11:37:17.060 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2023-12-03T11:37:17.061 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2023-12-03T11:37:17.062 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2023-12-03T11:37:17.062 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2023-12-03T11:37:17.063 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2023-12-03T11:37:17.063 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2023-12-03T11:37:17.065 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2023-12-03T11:37:17.066 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2023-12-03T11:37:17.066 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2023-12-03T11:37:17.066 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2023-12-03T11:37:17.067 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2023-12-03T11:37:17.069 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2023-12-03T11:37:17.069 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2023-12-03T11:37:17.069 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2023-12-03T11:37:17.071 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2023-12-03T11:37:17.071 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2023-12-03T11:37:17.071 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2023-12-03T11:37:17.071 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2023-12-03T11:37:17.071 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2023-12-03T11:37:17.071 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2023-12-03T11:37:17.073 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2023-12-03T11:37:17.073 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2023-12-03T11:37:17.074 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2023-12-03T11:37:17.077 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2023-12-03T11:37:17.078 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2023-12-03T11:37:17.079 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2023-12-03T11:37:17.079 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2023-12-03T11:37:17.079 INFO:teuthology.orchestra.run.smithi131.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2023-12-03T11:37:17.118 INFO:teuthology.orchestra.run.smithi131.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2023-12-03T11:37:17.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:17.447 INFO:teuthology.orchestra.run.smithi131.stdout:Welcome to Gradle 6.0.1! 2023-12-03T11:37:17.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:17.447 INFO:teuthology.orchestra.run.smithi131.stdout:Here are the highlights of this release: 2023-12-03T11:37:17.447 INFO:teuthology.orchestra.run.smithi131.stdout: - Substantial improvements in dependency management, including 2023-12-03T11:37:17.447 INFO:teuthology.orchestra.run.smithi131.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2023-12-03T11:37:17.447 INFO:teuthology.orchestra.run.smithi131.stdout: - Advanced control of transitive versions 2023-12-03T11:37:17.447 INFO:teuthology.orchestra.run.smithi131.stdout: - Support for optional features and dependencies 2023-12-03T11:37:17.447 INFO:teuthology.orchestra.run.smithi131.stdout: - Rules to tweak published metadata 2023-12-03T11:37:17.447 INFO:teuthology.orchestra.run.smithi131.stdout: - Support for Java 13 2023-12-03T11:37:17.447 INFO:teuthology.orchestra.run.smithi131.stdout: - Faster incremental Java and Groovy compilation 2023-12-03T11:37:17.448 INFO:teuthology.orchestra.run.smithi131.stdout: - New Zinc compiler for Scala 2023-12-03T11:37:17.448 INFO:teuthology.orchestra.run.smithi131.stdout: - VS2019 support 2023-12-03T11:37:17.448 INFO:teuthology.orchestra.run.smithi131.stdout: - Support for Gradle Enterprise plugin 3.0 2023-12-03T11:37:17.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:17.448 INFO:teuthology.orchestra.run.smithi131.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2023-12-03T11:37:17.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout:------------------------------------------------------------ 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout:Gradle 6.0.1 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout:------------------------------------------------------------ 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout:Build time: 2019-11-18 20:25:01 UTC 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout:Kotlin: 1.3.50 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout:Groovy: 2.5.8 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout:JVM: 1.8.0_362 (Red Hat, Inc. 25.362-b08) 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout:OS: Linux 5.14.0-388.el9.x86_64 amd64 2023-12-03T11:37:17.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:17.452 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2023-12-03T11:37:17.452 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-12-03T11:37:17.452 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T11:37:17.452 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-12-03T11:37:17.452 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T11:37:17.452 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2023-12-03T11:37:17.720 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2023-12-03T11:37:17.720 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2023-12-03T11:37:17.720 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'MIINBRBAWQTDIBICVZLP', 'access_secret': 'c0xSgDSqjc84xqeKhiiDEHOYiIhcnZ0LG/VcGIGMh7wWADlbl+oHGQ==', 'region': 'mexico', 'endpoint': 'smithi131.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi131.front.sepia.ceph.com'} 2023-12-03T11:37:17.720 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2023-12-03T11:37:17.720 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'MIINBRBAWQTDIBICVZLP', '--secret', 'c0xSgDSqjc84xqeKhiiDEHOYiIhcnZ0LG/VcGIGMh7wWADlbl+oHGQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2023-12-03T11:37:17.720 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key MIINBRBAWQTDIBICVZLP --secret c0xSgDSqjc84xqeKhiiDEHOYiIhcnZ0LG/VcGIGMh7wWADlbl+oHGQ== --email tester.client.0_test@test.test --cluster ceph 2023-12-03T11:37:17.780 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:17.780 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:17.791 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.789+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.791+0000 7fb4e3e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:17.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.791+0000 7fb4e3e16800 20 realm 2023-12-03T11:37:17.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.791+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.791+0000 7fb4e3e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:17.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.791+0000 7fb4e3e16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:17.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.791+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.791+0000 7fb4e3e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:17.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.791+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.795 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.792+0000 7fb4e3e16800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:17.795 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.792+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.795 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.792+0000 7fb4e3e16800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:17.795 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.792+0000 7fb4e3e16800 20 searching for the correct realm 2023-12-03T11:37:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.804+0000 7fb4e3e16800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:37:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.804+0000 7fb4e3e16800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:37:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.804+0000 7fb4e3e16800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.804+0000 7fb4e3e16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.804+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.804+0000 7fb4dfc94640 0 -- 172.21.15.131:0/1880836347 >> [v2:172.21.15.131:6808/2158589240,v1:172.21.15.131:6809/2158589240] conn(0x564956f08510 msgr2=0x564956f0a900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:37:17.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.804+0000 7fb4e3e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:17.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.804+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 20 zone default found 2023-12-03T11:37:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 4 Realm: () 2023-12-03T11:37:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:37:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:37:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 20 zonegroup default 2023-12-03T11:37:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.805+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.809 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.806+0000 7fb4e3e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:17.809 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.806+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.809 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.806+0000 7fb4e3e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:17.809 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.806+0000 7fb4e3e16800 20 started sync module instance, tier type = 2023-12-03T11:37:17.809 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.806+0000 7fb4e3e16800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:37:17.817 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.815+0000 7fb4df493640 0 -- 172.21.15.131:0/1880836347 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7fb4d409a5b0 msgr2=0x7fb4d40b7740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:17.817 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.815+0000 7fb4e3e16800 20 add_watcher() i=0 2023-12-03T11:37:17.817 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.815+0000 7fb4e3e16800 20 add_watcher() i=1 2023-12-03T11:37:17.817 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.815+0000 7fb4e3e16800 20 add_watcher() i=2 2023-12-03T11:37:17.817 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.815+0000 7fb4e3e16800 20 add_watcher() i=3 2023-12-03T11:37:17.818 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.815+0000 7fb4e3e16800 20 add_watcher() i=4 2023-12-03T11:37:17.818 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.815+0000 7fb4e3e16800 20 add_watcher() i=5 2023-12-03T11:37:17.818 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.815+0000 7fb4e3e16800 20 add_watcher() i=6 2023-12-03T11:37:17.818 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.816+0000 7fb4e3e16800 20 add_watcher() i=7 2023-12-03T11:37:17.818 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.816+0000 7fb4e3e16800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:17.820 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.818+0000 7fb4a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:17.820 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.818+0000 7fb4e3e16800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:17.820 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.818+0000 7fb4e3e16800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:17.825 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.822+0000 7fb4e3e16800 5 note: GC not initialized 2023-12-03T11:37:17.825 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.822+0000 7fb413fff640 20 reqs_thread_entry: start 2023-12-03T11:37:17.825 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:17.825 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 20 Filter name: none 2023-12-03T11:37:17.825 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb411ffb640 20 reqs_thread_entry: start 2023-12-03T11:37:17.825 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2023-12-03T11:37:17.825 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.826 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 10 cache get: name=default.rgw.meta+users.keys+MIINBRBAWQTDIBICVZLP : miss 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.823+0000 7fb4e3e16800 20 rados->read ofs=0 len=0 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.824+0000 7fb4e3e16800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.824+0000 7fb4e3e16800 10 cache put: name=default.rgw.meta+users.keys+MIINBRBAWQTDIBICVZLP info.flags=0x0 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.824+0000 7fb4e3e16800 10 adding default.rgw.meta+users.keys+MIINBRBAWQTDIBICVZLP to cache LRU end 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.824+0000 7fb4e3e16800 10 cache get: name=default.rgw.meta+users.keys+MIINBRBAWQTDIBICVZLP : hit (negative entry) 2023-12-03T11:37:17.827 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.824+0000 7fb4e3e16800 10 cache get: name=default.rgw.meta+users.keys+MIINBRBAWQTDIBICVZLP : hit (negative entry) 2023-12-03T11:37:17.828 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.825+0000 7fb4e3e16800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2023-12-03T11:37:17.828 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.825+0000 7fb4e3e16800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-12-03T11:37:17.828 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.825+0000 7fb4e3e16800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2023-12-03T11:37:17.828 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.825+0000 7fb4c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791403 cookie 94872991271664 notifier 7716 bl.length()=636 2023-12-03T11:37:17.828 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.825+0000 7fb4c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2023-12-03T11:37:17.829 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.825+0000 7fb4c5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2023-12-03T11:37:17.829 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.827+0000 7fb4e3e16800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2023-12-03T11:37:17.829 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.827+0000 7fb4e3e16800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-12-03T11:37:17.829 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.827+0000 7fb4e3e16800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2023-12-03T11:37:17.830 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.827+0000 7fb4c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791337 cookie 94872991212000 notifier 7716 bl.length()=200 2023-12-03T11:37:17.830 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.827+0000 7fb4c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2023-12-03T11:37:17.830 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.827+0000 7fb4c5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2023-12-03T11:37:17.832 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.829+0000 7fb4e3e16800 10 cache put: name=default.rgw.meta+users.keys+MIINBRBAWQTDIBICVZLP info.flags=0x7 2023-12-03T11:37:17.832 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.829+0000 7fb4e3e16800 10 moving default.rgw.meta+users.keys+MIINBRBAWQTDIBICVZLP to cache LRU end 2023-12-03T11:37:17.832 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.829+0000 7fb4e3e16800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:MIINBRBAWQTDIBICVZLP, ofs0, ns] 2023-12-03T11:37:17.832 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.830+0000 7fb4c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791376 cookie 94872991263920 notifier 7716 bl.length()=189 2023-12-03T11:37:17.832 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.830+0000 7fb4c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MIINBRBAWQTDIBICVZLP info.flags=0x7 2023-12-03T11:37:17.832 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.830+0000 7fb4c57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MIINBRBAWQTDIBICVZLP to cache LRU end 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: "user_id": "tester.client.0", 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: "display_name": "Ms. tester.client.0", 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: "email": "tester.client.0_test@test.test", 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: "suspended": 0, 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: "max_buckets": 1000, 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: "subusers": [], 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: "keys": [ 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: "user": "tester.client.0", 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: "access_key": "MIINBRBAWQTDIBICVZLP", 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: "secret_key": "c0xSgDSqjc84xqeKhiiDEHOYiIhcnZ0LG/VcGIGMh7wWADlbl+oHGQ==" 2023-12-03T11:37:17.833 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "swift_keys": [], 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": [], 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "op_mask": "read, write, delete", 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "default_placement": "", 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "default_storage_class": "", 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "placement_tags": [], 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "bucket_quota": { 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:37:17.834 INFO:teuthology.orchestra.run.smithi131.stdout: "user_quota": { 2023-12-03T11:37:17.835 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:37:17.835 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:37:17.835 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:37:17.835 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:37:17.835 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:37:17.835 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:37:17.835 INFO:teuthology.orchestra.run.smithi131.stdout: "temp_url_keys": [], 2023-12-03T11:37:17.835 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "rgw", 2023-12-03T11:37:17.835 INFO:teuthology.orchestra.run.smithi131.stdout: "mfa_ids": [] 2023-12-03T11:37:17.835 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-12-03T11:37:17.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:17.836 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.831+0000 7fb4a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:17.836 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.833+0000 7fb4e3e16800 20 remove_watcher() i=0 2023-12-03T11:37:17.836 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.833+0000 7fb4e3e16800 2 removed watcher, disabling cache 2023-12-03T11:37:17.836 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.834+0000 7fb4e3e16800 20 remove_watcher() i=1 2023-12-03T11:37:17.837 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.835+0000 7fb4e3e16800 20 remove_watcher() i=2 2023-12-03T11:37:17.838 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.836+0000 7fb4e3e16800 20 remove_watcher() i=3 2023-12-03T11:37:17.839 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.837+0000 7fb4e3e16800 20 remove_watcher() i=4 2023-12-03T11:37:17.840 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.838+0000 7fb4e3e16800 20 remove_watcher() i=5 2023-12-03T11:37:17.841 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.839+0000 7fb4e3e16800 20 remove_watcher() i=6 2023-12-03T11:37:17.842 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:17.840+0000 7fb4e3e16800 20 remove_watcher() i=7 2023-12-03T11:37:17.848 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:37:17.848 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2023-12-03T11:37:17.877 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2023-12-03T11:37:17.877 DEBUG:teuthology.orchestra.run.smithi131:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2023-12-03T11:37:17.943 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:37:18.032 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:18.032 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:18.045 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.043+0000 7f4caef3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.045+0000 7f4caef3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.045+0000 7f4caef3d800 20 realm 2023-12-03T11:37:18.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.045+0000 7f4caef3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.045+0000 7f4caef3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.045+0000 7f4caef3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:18.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.045+0000 7f4caef3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.045+0000 7f4caef3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.045+0000 7f4caef3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.046+0000 7f4caef3d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:18.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.046+0000 7f4caef3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.046+0000 7f4caef3d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:18.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.046+0000 7f4caef3d800 20 searching for the correct realm 2023-12-03T11:37:18.058 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.056+0000 7f4caaca3640 0 -- 172.21.15.131:0/2328804412 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f4ca405f040 msgr2=0x7f4ca407e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:18.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.058+0000 7f4caef3d800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:37:18.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.058+0000 7f4caef3d800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:37:18.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.058+0000 7f4caef3d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:18.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.058+0000 7f4caef3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:18.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.058+0000 7f4caef3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.058+0000 7f4caef3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.058+0000 7f4caef3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.058+0000 7f4caef3d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.058+0000 7f4caef3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 20 zone default found 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 4 Realm: () 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 20 zonegroup default 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 20 started sync module instance, tier type = 2023-12-03T11:37:18.063 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.059+0000 7f4caef3d800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:37:18.068 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.066+0000 7f4cab4a4640 0 -- 172.21.15.131:0/2328804412 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f4c940413f0 msgr2=0x7f4c94041850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:18.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.069+0000 7f4caef3d800 20 add_watcher() i=0 2023-12-03T11:37:18.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.069+0000 7f4caef3d800 20 add_watcher() i=1 2023-12-03T11:37:18.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.069+0000 7f4caef3d800 20 add_watcher() i=2 2023-12-03T11:37:18.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.069+0000 7f4caef3d800 20 add_watcher() i=3 2023-12-03T11:37:18.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.069+0000 7f4caef3d800 20 add_watcher() i=4 2023-12-03T11:37:18.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.069+0000 7f4caef3d800 20 add_watcher() i=5 2023-12-03T11:37:18.072 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.069+0000 7f4caef3d800 20 add_watcher() i=6 2023-12-03T11:37:18.072 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.070+0000 7f4caef3d800 20 add_watcher() i=7 2023-12-03T11:37:18.072 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.070+0000 7f4caef3d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:18.073 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.071+0000 7f4bebfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:18.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.071+0000 7f4caef3d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:18.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.071+0000 7f4caef3d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:18.118 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.115+0000 7f4bdaffd640 20 reqs_thread_entry: start 2023-12-03T11:37:18.118 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.116+0000 7f4caef3d800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:18.119 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.116+0000 7f4caef3d800 20 Filter name: none 2023-12-03T11:37:18.119 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.116+0000 7f4bd8ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:18.119 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.116+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:37:18.120 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.118+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.120 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.118+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.121 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.118+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:37:18.121 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.118+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_QW5Hyxy-YE4TogqiI4atEacuuy4V6us', time=2023-12-03T13:32:36.188623+0000, chain.objs.size()=2 2023-12-03T11:37:18.121 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.118+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.iRQs5npP1swDaw1MQ-fc447VlXiiBUv_0 2023-12-03T11:37:18.121 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.118+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.iRQs5npP1swDaw1MQ-fc447VlXiiBUv_1 2023-12-03T11:37:18.121 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.118+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1_1_71792e87a1037cb3cf2314f637fcca07', time=2023-12-03T13:32:36.259887+0000, chain.objs.size()=5 2023-12-03T11:37:18.121 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.118+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1 2023-12-03T11:37:18.121 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.118+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1_1 2023-12-03T11:37:18.122 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.118+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.2 2023-12-03T11:37:18.122 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.119+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.2_1 2023-12-03T11:37:18.122 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.119+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.3 2023-12-03T11:37:18.123 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.121+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.123+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:37:18.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.124+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.127 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.125+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.127 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.125+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.128 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.126+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:37:18.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.127+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.128+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.128+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.129+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:37:18.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.130+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.131+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.131+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:37:18.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.131+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_kG2CoJ9py5fh7X5M8pDYaKu1A9lqPVq', time=2023-12-03T13:32:36.208227+0000, chain.objs.size()=1 2023-12-03T11:37:18.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.131+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XFMqKa2m_eTXdW7IAikO_TlT4Ib2KOM_1 2023-12-03T11:37:18.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.131+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.2_2d3fffd1c7b44ef64df74495a8668b76', time=2023-12-03T13:32:36.279368+0000, chain.objs.size()=3 2023-12-03T11:37:18.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.131+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.1 2023-12-03T11:37:18.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.131+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.2 2023-12-03T11:37:18.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.131+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.3 2023-12-03T11:37:18.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.133+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.135+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:37:18.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.136+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.139 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.137+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.139 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.137+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.138+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:37:18.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.139+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.140+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.140+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.143 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.141+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:37:18.145 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.142+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.145 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.143+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.145 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.143+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.146 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.144+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:37:18.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.145+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2023-12-03T11:37:18.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_mfIKbIlIj_nYGogsBlqbeYLe0DJWmyn', time=2023-12-03T13:32:36.214231+0000, chain.objs.size()=1 2023-12-03T11:37:18.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.4fIM7XgaN-wD0Qnmpnz9moXL8DccPUg_0 2023-12-03T11:37:18.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_mvmdcI3ia4u_sPbLxfbqeoyMw6vpFFL', time=2023-12-03T13:32:36.255846+0000, chain.objs.size()=3 2023-12-03T11:37:18.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.aeGs4R3I5SvIi90ARLoGVY-FLPqNI-5_0 2023-12-03T11:37:18.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.aeGs4R3I5SvIi90ARLoGVY-FLPqNI-5_1 2023-12-03T11:37:18.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.aeGs4R3I5SvIi90ARLoGVY-FLPqNI-5_2 2023-12-03T11:37:18.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16295689000518239563', time=2023-12-03T13:32:36.268577+0000, chain.objs.size()=3 2023-12-03T11:37:18.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.1 2023-12-03T11:37:18.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.2 2023-12-03T11:37:18.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-STANDARD.2~OpGp3GWzAQnYXSrExWQQzkhwau50V2y.3 2023-12-03T11:37:18.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.13888465163181493438', time=2023-12-03T13:32:36.294253+0000, chain.objs.size()=5 2023-12-03T11:37:18.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-FROZEN.2~XFXtAZImSVaPrP0k0BKqSXaHaRIE1HU.1 2023-12-03T11:37:18.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__shadow_foo-FROZEN.2~XFXtAZImSVaPrP0k0BKqSXaHaRIE1HU.1_1 2023-12-03T11:37:18.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-FROZEN.2~XFXtAZImSVaPrP0k0BKqSXaHaRIE1HU.2 2023-12-03T11:37:18.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__shadow_foo-FROZEN.2~XFXtAZImSVaPrP0k0BKqSXaHaRIE1HU.2_1 2023-12-03T11:37:18.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.146+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-FROZEN.2~XFXtAZImSVaPrP0k0BKqSXaHaRIE1HU.3 2023-12-03T11:37:18.153 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.151+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.153+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:37:18.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.154+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.154+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.155+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.156+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:37:18.159 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.157+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.159 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.157+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.157+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.158+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:37:18.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.160+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.160+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.160+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:37:18.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.160+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.12047795217514962846', time=2023-12-03T13:32:36.166995+0000, chain.objs.size()=4 2023-12-03T11:37:18.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.160+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8__multipart_foo.2~SiZvIErWT9OEj2-3Foob821-UsW-xEZ.1 2023-12-03T11:37:18.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.161+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8__multipart_foo.2~SiZvIErWT9OEj2-3Foob821-UsW-xEZ.2 2023-12-03T11:37:18.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.161+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8__multipart_foo.2~SiZvIErWT9OEj2-3Foob821-UsW-xEZ.3 2023-12-03T11:37:18.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.161+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.8__multipart_foo.2~SiZvIErWT9OEj2-3Foob821-UsW-xEZ.4 2023-12-03T11:37:18.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.162+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.166 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.164+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:37:18.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.166+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.168+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.168+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.168+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:37:18.172 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.170+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.172 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.170+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.173 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.170+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:37:18.173 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.170+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_R10iUirduu5aglEXeujFi_ADQJXLkgb', time=2023-12-03T13:32:36.217737+0000, chain.objs.size()=1 2023-12-03T11:37:18.173 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.170+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.vd4yWGRT-x9rcgbyw28EKVo_NbCs0pw_0 2023-12-03T11:37:18.173 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.170+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_B-0h3ZfAT1Z4JifgnsqVXlSGKD1OOUl', time=2023-12-03T13:32:36.243145+0000, chain.objs.size()=3 2023-12-03T11:37:18.173 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.170+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.yokuwA3Z4Ch5zvDr7aU_Q5FY3b2nV43_0 2023-12-03T11:37:18.173 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.170+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.yokuwA3Z4Ch5zvDr7aU_Q5FY3b2nV43_1 2023-12-03T11:37:18.173 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.170+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.yokuwA3Z4Ch5zvDr7aU_Q5FY3b2nV43_2 2023-12-03T11:37:18.175 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.173+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.177 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.175+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:37:18.178 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.176+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.177+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.177+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.178+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:37:18.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.179+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.180+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.180+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.183 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.181+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:37:18.184 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.182+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.183+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.183+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.184+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:37:18.187 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.185+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.185+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.186+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:37:18.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.186+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5271524334018589573', time=2023-12-03T13:32:36.181102+0000, chain.objs.size()=2 2023-12-03T11:37:18.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.186+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_0 2023-12-03T11:37:18.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.186+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_1 2023-12-03T11:37:18.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.186+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.6215357874216398019', time=2023-12-03T13:32:36.297977+0000, chain.objs.size()=5 2023-12-03T11:37:18.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.186+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-LUKEWARM.2~GMdKrhRmrUDHrxxvAfhZxzy3sKMIV7o.1 2023-12-03T11:37:18.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.186+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__shadow_foo-LUKEWARM.2~GMdKrhRmrUDHrxxvAfhZxzy3sKMIV7o.1_1 2023-12-03T11:37:18.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.186+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-LUKEWARM.2~GMdKrhRmrUDHrxxvAfhZxzy3sKMIV7o.2 2023-12-03T11:37:18.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.186+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__shadow_foo-LUKEWARM.2~GMdKrhRmrUDHrxxvAfhZxzy3sKMIV7o.2_1 2023-12-03T11:37:18.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.186+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-LUKEWARM.2~GMdKrhRmrUDHrxxvAfhZxzy3sKMIV7o.3 2023-12-03T11:37:18.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.188+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.190+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:37:18.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:37:18.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.8298350690821543643', time=2023-12-03T13:32:36.236370+0000, chain.objs.size()=5 2023-12-03T11:37:18.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1 2023-12-03T11:37:18.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1_1 2023-12-03T11:37:18.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.2 2023-12-03T11:37:18.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.2_1 2023-12-03T11:37:18.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.3 2023-12-03T11:37:18.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16800743192974281694', time=2023-12-03T13:32:36.252312+0000, chain.objs.size()=5 2023-12-03T11:37:18.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1 2023-12-03T11:37:18.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.1_1 2023-12-03T11:37:18.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.2 2023-12-03T11:37:18.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.2_1 2023-12-03T11:37:18.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.192+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-LUKEWARM.2~MxdCKJsNh3NypTXNtP1Uwu4fItZB5Yy.3 2023-12-03T11:37:18.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.194+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.199 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.196+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:37:18.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.17627949303598201122', time=2023-12-03T13:32:36.113931+0000, chain.objs.size()=4 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10__multipart_foo.2~FMikCYi7PJGeo1V2HYaSLfv0mn14cv9.1 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10__multipart_foo.2~FMikCYi7PJGeo1V2HYaSLfv0mn14cv9.2 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10__multipart_foo.2~FMikCYi7PJGeo1V2HYaSLfv0mn14cv9.3 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.10__multipart_foo.2~FMikCYi7PJGeo1V2HYaSLfv0mn14cv9.4 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.11961548536981559784', time=2023-12-03T13:32:36.147152+0000, chain.objs.size()=4 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9__multipart_foo.2~6byy5mJJVuyLzvcu8WGDvQ9zWvN0GlB.1 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9__multipart_foo.2~6byy5mJJVuyLzvcu8WGDvQ9zWvN0GlB.2 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9__multipart_foo.2~6byy5mJJVuyLzvcu8WGDvQ9zWvN0GlB.3 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.9__multipart_foo.2~6byy5mJJVuyLzvcu8WGDvQ9zWvN0GlB.4 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_1_c05f3760774cc0a38df3ccd30f22ae13', time=2023-12-03T13:32:36.204027+0000, chain.objs.size()=2 2023-12-03T11:37:18.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_0 2023-12-03T11:37:18.203 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.198+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_1 2023-12-03T11:37:18.203 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.199+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_b_YgbPZ-0m4i-sMyD-vE4HYlYUoH8Mn', time=2023-12-03T13:32:36.272055+0000, chain.objs.size()=1 2023-12-03T11:37:18.203 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.199+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.P9CPXSErY_RrQhYJ28acLqBplEtZ-wJ_0 2023-12-03T11:37:18.203 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.201+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.205 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.203+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:37:18.206 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.204+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.207 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.205+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.207 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.205+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:37:18.207 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.205+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.13084760535153956898', time=2023-12-03T13:32:36.196508+0000, chain.objs.size()=2 2023-12-03T11:37:18.207 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.205+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_0 2023-12-03T11:37:18.207 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.205+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.XIqPHVbrO_seb8jhhDwl7RR9avNySfj_1 2023-12-03T11:37:18.207 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.205+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_YKZVoPFnUIHvXLHc1yMo8zUL1MrvnZq', time=2023-12-03T13:32:36.276111+0000, chain.objs.size()=1 2023-12-03T11:37:18.207 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.205+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.8rrkmXXUjBBkO0P92Sskt9CriqRroh4_0 2023-12-03T11:37:18.208 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.206+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.208+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:37:18.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.209+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.210+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.210+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:37:18.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.210+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_qK2HaIozd7yOcUaU-QTyhGshxi25wGm', time=2023-12-03T13:32:36.200080+0000, chain.objs.size()=2 2023-12-03T11:37:18.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.210+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.EMVBJovahn52kXvrvMxsqy05taFGSdE_0 2023-12-03T11:37:18.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.210+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.EMVBJovahn52kXvrvMxsqy05taFGSdE_1 2023-12-03T11:37:18.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.213+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.217 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.215+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:37:18.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.216+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.216+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.217+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.218+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:37:18.221 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.219+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.220+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.220+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:37:18.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.220+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_jXvf-9LIczF_aHjv1OlHJDg77XyedSQ', time=2023-12-03T13:32:36.248314+0000, chain.objs.size()=2 2023-12-03T11:37:18.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.220+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.SqT69W-GTPozkPxAOQW8ZAtUOLCYTpa_1 2023-12-03T11:37:18.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.220+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.SqT69W-GTPozkPxAOQW8ZAtUOLCYTpa_2 2023-12-03T11:37:18.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.222+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.224+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:37:18.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.226+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.226+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.226+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:37:18.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.226+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_LNvUxy-yFKSiQlmIXL8s0it1EeVQhnu', time=2023-12-03T13:32:36.192808+0000, chain.objs.size()=1 2023-12-03T11:37:18.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.226+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.HHR66Du9Rag-ddmjOtIbnk59McZumOh_1 2023-12-03T11:37:18.230 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.228+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.230+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:37:18.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.231+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.231+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.234 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.232+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.232+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:37:18.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.234+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.234+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.234+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:37:18.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.234+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1_1_f171fd454953567d435081b2da6e1aaa', time=2023-12-03T13:32:36.239601+0000, chain.objs.size()=5 2023-12-03T11:37:18.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.234+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1 2023-12-03T11:37:18.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.234+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.1_1 2023-12-03T11:37:18.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.234+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.2 2023-12-03T11:37:18.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.234+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.2_1 2023-12-03T11:37:18.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.234+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__multipart_foo-FROZEN.2~ruLXKP21_NWhYblsMik2KdhZgmkiaqT.3 2023-12-03T11:37:18.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.235+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.237+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:37:18.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.239+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.239+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.239+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:37:18.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.239+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='_7TVMZLLsLvPYootC8rimez94JbmRr5U', time=2023-12-03T13:32:36.265251+0000, chain.objs.size()=2 2023-12-03T11:37:18.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.239+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.iwfMTx2D-FIPkfHZU9CrY0W61shaLPP_1 2023-12-03T11:37:18.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.239+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.15__shadow_.iwfMTx2D-FIPkfHZU9CrY0W61shaLPP_2 2023-12-03T11:37:18.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.242+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.244+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:37:18.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.246+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.246+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.246+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:37:18.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.246+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.9094749125019936615', time=2023-12-03T13:32:36.128735+0000, chain.objs.size()=4 2023-12-03T11:37:18.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.246+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11__multipart_foo.2~ZWkKaTHaD9J2VGmReBja2liialKrjgW.1 2023-12-03T11:37:18.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.246+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11__multipart_foo.2~ZWkKaTHaD9J2VGmReBja2liialKrjgW.2 2023-12-03T11:37:18.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.246+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11__multipart_foo.2~ZWkKaTHaD9J2VGmReBja2liialKrjgW.3 2023-12-03T11:37:18.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.246+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.11__multipart_foo.2~ZWkKaTHaD9J2VGmReBja2liialKrjgW.4 2023-12-03T11:37:18.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.248+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.252 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.249+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:37:18.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.251+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.251+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.251+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.252+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:37:18.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.253+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.256 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.254+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.254+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:37:18.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.254+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_1_e94b7b386bae7e286c521e5a0f5fa0a5', time=2023-12-03T13:32:36.184812+0000, chain.objs.size()=2 2023-12-03T11:37:18.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.254+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_0 2023-12-03T11:37:18.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.254+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.14__shadow_.nKbxeiVNMmWfPlxR13QZdXuIhe2EONY_1 2023-12-03T11:37:18.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.254+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.4267961975020246425', time=2023-12-03T13:32:36.327801+0000, chain.objs.size()=3 2023-12-03T11:37:18.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.254+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XrklsKNTvgo-C5t6Fs-IpIm713fY-kj_0 2023-12-03T11:37:18.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.254+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XrklsKNTvgo-C5t6Fs-IpIm713fY-kj_1 2023-12-03T11:37:18.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.254+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XrklsKNTvgo-C5t6Fs-IpIm713fY-kj_2 2023-12-03T11:37:18.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.257+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.261 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.259+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:37:18.262 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.260+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.263 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.261+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.263 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.261+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:37:18.263 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.261+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.15583795031275657595', time=2023-12-03T13:32:36.301911+0000, chain.objs.size()=3 2023-12-03T11:37:18.263 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.261+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-STANDARD.2~wx7JWcQHwtOVvBu9iqVEhjdcfyiiMU0.1 2023-12-03T11:37:18.263 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.261+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-STANDARD.2~wx7JWcQHwtOVvBu9iqVEhjdcfyiiMU0.2 2023-12-03T11:37:18.263 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.261+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.13__multipart_foo-STANDARD.2~wx7JWcQHwtOVvBu9iqVEhjdcfyiiMU0.3 2023-12-03T11:37:18.263 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.261+0000 7f4caef3d800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5481443708059950296', time=2023-12-03T13:32:36.317201+0000, chain.objs.size()=3 2023-12-03T11:37:18.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.261+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XeE5WFBAQkADrRWsF8erLonb7W2u1r7_0 2023-12-03T11:37:18.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.261+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XeE5WFBAQkADrRWsF8erLonb7W2u1r7_1 2023-12-03T11:37:18.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.261+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.12__shadow_.XeE5WFBAQkADrRWsF8erLonb7W2u1r7_2 2023-12-03T11:37:18.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.264+0000 7f4caef3d800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:37:18.268 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.266+0000 7f4caef3d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:37:18.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.267+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.267+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.267+0000 7f4caef3d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.269+0000 7f4bebfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:18.273 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.271+0000 7f4caef3d800 20 remove_watcher() i=0 2023-12-03T11:37:18.273 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.271+0000 7f4caef3d800 2 removed watcher, disabling cache 2023-12-03T11:37:18.274 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.272+0000 7f4caef3d800 20 remove_watcher() i=1 2023-12-03T11:37:18.275 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.273+0000 7f4caef3d800 20 remove_watcher() i=2 2023-12-03T11:37:18.276 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.274+0000 7f4caef3d800 20 remove_watcher() i=3 2023-12-03T11:37:18.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.275+0000 7f4caef3d800 20 remove_watcher() i=4 2023-12-03T11:37:18.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.276+0000 7f4caef3d800 20 remove_watcher() i=5 2023-12-03T11:37:18.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.277+0000 7f4caef3d800 20 remove_watcher() i=6 2023-12-03T11:37:18.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.279+0000 7f4caef3d800 20 remove_watcher() i=7 2023-12-03T11:37:18.287 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:37:18.336 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:37:18.336 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:37:18.350 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.348+0000 7f4bcbf28800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.349+0000 7f4bcbf28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.349+0000 7f4bcbf28800 20 realm 2023-12-03T11:37:18.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.349+0000 7f4bcbf28800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.350+0000 7f4bcbf28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.350+0000 7f4bcbf28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:37:18.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.350+0000 7f4bcbf28800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.350+0000 7f4bcbf28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.350+0000 7f4bcbf28800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.351+0000 7f4bcbf28800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:18.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.351+0000 7f4bcbf28800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.351+0000 7f4bcbf28800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:37:18.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.351+0000 7f4bcbf28800 20 searching for the correct realm 2023-12-03T11:37:18.362 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.360+0000 7f4bc7bd0640 0 -- 172.21.15.131:0/176232515 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55fa92966740 msgr2=0x55fa92968b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:18.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:37:18.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:37:18.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:37:18.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:37:18.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:37:18.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:37:18.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 zone default found 2023-12-03T11:37:18.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 4 Realm: () 2023-12-03T11:37:18.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:37:18.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:37:18.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:37:18.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 zonegroup default 2023-12-03T11:37:18.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.362+0000 7f4bcbf28800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.367 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.363+0000 7f4bcbf28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.367 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.363+0000 7f4bcbf28800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.367 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.363+0000 7f4bcbf28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.367 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.363+0000 7f4bcbf28800 20 rados->read ofs=0 len=0 2023-12-03T11:37:18.367 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.363+0000 7f4bcbf28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:37:18.367 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.363+0000 7f4bcbf28800 20 started sync module instance, tier type = 2023-12-03T11:37:18.367 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.363+0000 7f4bcbf28800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:37:18.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.370+0000 7f4bc83d1640 0 -- 172.21.15.131:0/176232515 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f4bb005cd00 msgr2=0x7f4bb008e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:37:18.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.372+0000 7f4bcbf28800 20 add_watcher() i=0 2023-12-03T11:37:18.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.372+0000 7f4bcbf28800 20 add_watcher() i=1 2023-12-03T11:37:18.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.372+0000 7f4bcbf28800 20 add_watcher() i=2 2023-12-03T11:37:18.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.372+0000 7f4bcbf28800 20 add_watcher() i=3 2023-12-03T11:37:18.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.372+0000 7f4bcbf28800 20 add_watcher() i=4 2023-12-03T11:37:18.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.372+0000 7f4bcbf28800 20 add_watcher() i=5 2023-12-03T11:37:18.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.372+0000 7f4bcbf28800 20 add_watcher() i=6 2023-12-03T11:37:18.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.373+0000 7f4bcbf28800 20 add_watcher() i=7 2023-12-03T11:37:18.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.373+0000 7f4bcbf28800 2 all 8 watchers are set, enabling cache 2023-12-03T11:37:18.376 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.374+0000 7f4b8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:18.377 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.374+0000 7f4bcbf28800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:37:18.377 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.374+0000 7f4bcbf28800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:37:18.419 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.417+0000 7f4b04ff9640 20 reqs_thread_entry: start 2023-12-03T11:37:18.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.417+0000 7f4bcbf28800 20 init_complete bucket index max shards: 1 2023-12-03T11:37:18.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.417+0000 7f4bcbf28800 20 Filter name: none 2023-12-03T11:37:18.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.417+0000 7f4afa7fc640 20 reqs_thread_entry: start 2023-12-03T11:37:18.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.417+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:37:18.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.418+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.419+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.419+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.422 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.420+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:37:18.423 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.421+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.423 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.421+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.422+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.423+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:37:18.427 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.424+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.427 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.425+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.427 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.425+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.429 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.426+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:37:18.430 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.428+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.430 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.428+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.431 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.429+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.432 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.430+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:37:18.433 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.431+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.434 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.431+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.434 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.432+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.435 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.433+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:37:18.436 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.434+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.437 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.434+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.437 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.435+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.438 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.436+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:37:18.439 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.437+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.439 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.437+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.440 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.438+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.440 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.438+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:37:18.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.440+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.440+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.440+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.441+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:37:18.445 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.442+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.445 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.443+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.445 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.443+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.446 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.444+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:37:18.447 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.445+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.448 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.446+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.448 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.446+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.449 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.447+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:37:18.450 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.448+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.451 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.448+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.451 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.449+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.452 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.450+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:37:18.453 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.451+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.451+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.452+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.455 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.453+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:37:18.456 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.454+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.455+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.455+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.458 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.456+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:37:18.460 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.457+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.460 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.458+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.460 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.458+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.461 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.459+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:37:18.462 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.460+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.463 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.461+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.463 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.461+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.464 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.462+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:37:18.465 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.463+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.466 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.463+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.466 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.464+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.467 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.465+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:37:18.468 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.466+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.469 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.466+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.469 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.467+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.469 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.467+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:37:18.471 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.468+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.471 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.469+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.471 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.469+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.472 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.470+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:37:18.474 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.472+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.474 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.472+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.474 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.472+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.475 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.473+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:37:18.476 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.474+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.477 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.475+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.477 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.475+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.478 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.476+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:37:18.479 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.477+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.480 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.478+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.480 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.478+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.481 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.479+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:37:18.482 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.480+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.482 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.480+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.483 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.481+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.483 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.481+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:37:18.485 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.483+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.485 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.483+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.486 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.483+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.487 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.485+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:37:18.488 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.487+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.487+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.489 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.487+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.490 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.489+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:37:18.491 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.490+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.490+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.492 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.490+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.493 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.491+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:37:18.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.492+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.493+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.495 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.493+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.496 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.494+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:37:18.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.495+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.496+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.496+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.497+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:37:18.501 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.499+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.501 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.499+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.501 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.499+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.502 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.500+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:37:18.505 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.502+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.505 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.502+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.502+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.503+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:37:18.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.504+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.505+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.505+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.508 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.506+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:37:18.509 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.508+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.510 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.508+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.510 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.508+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.511 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.509+0000 7f4bcbf28800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:37:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.510+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.511+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:37:18.513 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.511+0000 7f4bcbf28800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:37:18.515 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.513+0000 7f4b8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:37:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.515+0000 7f4bcbf28800 20 remove_watcher() i=0 2023-12-03T11:37:18.517 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.515+0000 7f4bcbf28800 2 removed watcher, disabling cache 2023-12-03T11:37:18.518 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.516+0000 7f4bcbf28800 20 remove_watcher() i=1 2023-12-03T11:37:18.519 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.517+0000 7f4bcbf28800 20 remove_watcher() i=2 2023-12-03T11:37:18.520 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.518+0000 7f4bcbf28800 20 remove_watcher() i=3 2023-12-03T11:37:18.521 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.519+0000 7f4bcbf28800 20 remove_watcher() i=4 2023-12-03T11:37:18.522 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.520+0000 7f4bcbf28800 20 remove_watcher() i=5 2023-12-03T11:37:18.523 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.521+0000 7f4bcbf28800 20 remove_watcher() i=6 2023-12-03T11:37:18.524 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:37:18.522+0000 7f4bcbf28800 20 remove_watcher() i=7 2023-12-03T11:37:18.529 DEBUG:teuthology.orchestra.run.smithi131:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2023-12-03T11:37:19.002 INFO:teuthology.orchestra.run.smithi131.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2023-12-03T11:37:22.602 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :clean UP-TO-DATE 2023-12-03T11:37:40.002 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :compileJava 2023-12-03T11:37:40.002 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :processResources 2023-12-03T11:37:40.002 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :classes 2023-12-03T11:37:40.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:40.603 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :compileTestJava 2023-12-03T11:37:40.603 INFO:teuthology.orchestra.run.smithi131.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-12-03T11:37:40.604 INFO:teuthology.orchestra.run.smithi131.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-12-03T11:37:40.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:40.604 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :processTestResources NO-SOURCE 2023-12-03T11:37:40.605 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :testClasses 2023-12-03T11:37:46.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:46.502 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :test 2023-12-03T11:37:46.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:46.502 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2023-12-03T11:37:47.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:47.001 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2023-12-03T11:37:47.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:47.201 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2023-12-03T11:37:47.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:47.301 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2023-12-03T11:37:47.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:47.501 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2023-12-03T11:37:48.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:48.101 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2023-12-03T11:37:48.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:48.201 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2023-12-03T11:37:48.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:48.302 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2023-12-03T11:37:48.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:48.302 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2023-12-03T11:37:48.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:48.302 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2023-12-03T11:37:48.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:48.501 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2023-12-03T11:37:48.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:48.901 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2023-12-03T11:37:49.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:49.201 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2023-12-03T11:37:54.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:54.102 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2023-12-03T11:37:54.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:54.401 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2023-12-03T11:37:54.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:54.501 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2023-12-03T11:37:54.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:54.702 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2023-12-03T11:37:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:54.702 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2023-12-03T11:37:55.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:55.001 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2023-12-03T11:37:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:55.301 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2023-12-03T11:37:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:55.501 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2023-12-03T11:37:55.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:55.502 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2023-12-03T11:37:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:55.601 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2023-12-03T11:37:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:58.101 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2023-12-03T11:37:58.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:58.301 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2023-12-03T11:37:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:58.701 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2023-12-03T11:37:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:58.901 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2023-12-03T11:37:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:59.201 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2023-12-03T11:37:59.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:37:59.401 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2023-12-03T11:38:05.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:05.801 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2023-12-03T11:38:06.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:06.001 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2023-12-03T11:38:07.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:07.101 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2023-12-03T11:38:07.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:07.301 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2023-12-03T11:38:07.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:07.802 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2023-12-03T11:38:08.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:08.001 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2023-12-03T11:38:08.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:08.302 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2023-12-03T11:38:08.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:08.502 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2023-12-03T11:38:08.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:08.502 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2023-12-03T11:38:08.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:08.701 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2023-12-03T11:38:08.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:08.702 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2023-12-03T11:38:08.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:08.902 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2023-12-03T11:38:08.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:08.902 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2023-12-03T11:38:09.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:09.102 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2023-12-03T11:38:09.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:09.102 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2023-12-03T11:38:09.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:09.302 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2023-12-03T11:38:09.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:09.302 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2023-12-03T11:38:09.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:09.502 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2023-12-03T11:38:09.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:09.502 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2023-12-03T11:38:09.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:09.702 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2023-12-03T11:38:09.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:09.702 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2023-12-03T11:38:09.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:09.901 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2023-12-03T11:38:10.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:10.501 INFO:teuthology.orchestra.run.smithi131.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2023-12-03T11:38:10.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:10.785 INFO:teuthology.orchestra.run.smithi131.stdout:---------------------------------------------------------------------- 2023-12-03T11:38:10.785 INFO:teuthology.orchestra.run.smithi131.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2023-12-03T11:38:10.785 INFO:teuthology.orchestra.run.smithi131.stdout:---------------------------------------------------------------------- 2023-12-03T11:38:10.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:10.785 INFO:teuthology.orchestra.run.smithi131.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-12-03T11:38:10.785 INFO:teuthology.orchestra.run.smithi131.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-12-03T11:38:10.785 INFO:teuthology.orchestra.run.smithi131.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-12-03T11:38:10.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:10.785 INFO:teuthology.orchestra.run.smithi131.stdout:BUILD SUCCESSFUL in 52s 2023-12-03T11:38:10.786 INFO:teuthology.orchestra.run.smithi131.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2023-12-03T11:38:11.101 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:38:11.151 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:11.151 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:11.165 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.164+0000 7f2687b25800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.165+0000 7f2687b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.165+0000 7f2687b25800 20 realm 2023-12-03T11:38:11.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.165+0000 7f2687b25800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.165+0000 7f2687b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.165+0000 7f2687b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:11.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.165+0000 7f2687b25800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.166+0000 7f2687b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.166+0000 7f2687b25800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.166+0000 7f2687b25800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:11.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.166+0000 7f2687b25800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.167+0000 7f2687b25800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:11.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.167+0000 7f2687b25800 20 searching for the correct realm 2023-12-03T11:38:11.177 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.176+0000 7f26838b8640 0 -- 172.21.15.131:0/2626546055 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5643d8d6fb70 msgr2=0x5643d8d71fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:11.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.178+0000 7f2687b25800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:11.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.178+0000 7f2687b25800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:11.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.178+0000 7f2687b25800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:11.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.178+0000 7f2687b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:11.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.178+0000 7f2687b25800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.178+0000 7f2687b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.178+0000 7f2687b25800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.178+0000 7f2687b25800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:11.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.178+0000 7f2687b25800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:11.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 20 zone default found 2023-12-03T11:38:11.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 4 Realm: () 2023-12-03T11:38:11.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:11.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:11.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:11.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 20 zonegroup default 2023-12-03T11:38:11.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.179+0000 7f2687b25800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.180+0000 7f2687b25800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.180+0000 7f2687b25800 20 started sync module instance, tier type = 2023-12-03T11:38:11.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.180+0000 7f2687b25800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:11.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.187+0000 7f26840b9640 0 -- 172.21.15.131:0/2626546055 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f266c05c600 msgr2=0x7f266c0634c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:11.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.190+0000 7f2687b25800 20 add_watcher() i=0 2023-12-03T11:38:11.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.190+0000 7f2687b25800 20 add_watcher() i=1 2023-12-03T11:38:11.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.190+0000 7f2687b25800 20 add_watcher() i=2 2023-12-03T11:38:11.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.190+0000 7f2687b25800 20 add_watcher() i=3 2023-12-03T11:38:11.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.190+0000 7f2687b25800 20 add_watcher() i=4 2023-12-03T11:38:11.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.190+0000 7f2687b25800 20 add_watcher() i=5 2023-12-03T11:38:11.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.190+0000 7f2687b25800 20 add_watcher() i=6 2023-12-03T11:38:11.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.191+0000 7f2687b25800 20 add_watcher() i=7 2023-12-03T11:38:11.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.191+0000 7f2687b25800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:11.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.193+0000 7f2649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:11.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.193+0000 7f2687b25800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:11.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.193+0000 7f2687b25800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:11.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.235+0000 7f25c0ff9640 20 reqs_thread_entry: start 2023-12-03T11:38:11.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.235+0000 7f2687b25800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:11.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.235+0000 7f2687b25800 20 Filter name: none 2023-12-03T11:38:11.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.235+0000 7f25b67fc640 20 reqs_thread_entry: start 2023-12-03T11:38:11.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.235+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:38:11.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.236+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.237+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.237+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.237+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5391061564428948514', time=2023-12-03T13:37:54.182097+0000, chain.objs.size()=5 2023-12-03T11:38:11.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.237+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.34__shadow_.vc25rVxEHqQwLHHRFpzxn72gMnkKv___1 2023-12-03T11:38:11.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.237+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.34__shadow_.vc25rVxEHqQwLHHRFpzxn72gMnkKv___2 2023-12-03T11:38:11.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.237+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.34__shadow_.vc25rVxEHqQwLHHRFpzxn72gMnkKv___3 2023-12-03T11:38:11.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.237+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.34__shadow_.vc25rVxEHqQwLHHRFpzxn72gMnkKv___4 2023-12-03T11:38:11.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.237+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.34__shadow_.vc25rVxEHqQwLHHRFpzxn72gMnkKv___5 2023-12-03T11:38:11.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.240+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.242+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:38:11.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.243+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.13706308473133154732', time=2023-12-03T13:38:05.857292+0000, chain.objs.size()=16 2023-12-03T11:38:11.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.1 2023-12-03T11:38:11.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.1_1 2023-12-03T11:38:11.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.1_2 2023-12-03T11:38:11.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.2 2023-12-03T11:38:11.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.2_1 2023-12-03T11:38:11.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.2_2 2023-12-03T11:38:11.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.3 2023-12-03T11:38:11.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.3_1 2023-12-03T11:38:11.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.3_2 2023-12-03T11:38:11.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.4 2023-12-03T11:38:11.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.4_1 2023-12-03T11:38:11.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.244+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.4_2 2023-12-03T11:38:11.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.247+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.5 2023-12-03T11:38:11.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.250+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.5_1 2023-12-03T11:38:11.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.250+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.5_2 2023-12-03T11:38:11.251 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.250+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~X8Nnt-ErCkEEK9RHnn3rzvpytV0zbZw.6 2023-12-03T11:38:11.253 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.252+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.254+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:38:11.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.256+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.256+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-12-03T11:38:11.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.6606625951998091238', time=2023-12-03T13:37:52.255774+0000, chain.objs.size()=9 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~qolgksjGNypgIr4KTZakIOLjn34jgQe.1 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~qolgksjGNypgIr4KTZakIOLjn34jgQe.1_1 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~qolgksjGNypgIr4KTZakIOLjn34jgQe.2 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~qolgksjGNypgIr4KTZakIOLjn34jgQe.2_1 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~qolgksjGNypgIr4KTZakIOLjn34jgQe.3 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~qolgksjGNypgIr4KTZakIOLjn34jgQe.3_1 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~qolgksjGNypgIr4KTZakIOLjn34jgQe.4 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~qolgksjGNypgIr4KTZakIOLjn34jgQe.4_1 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~qolgksjGNypgIr4KTZakIOLjn34jgQe.5 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.10146603076185506716', time=2023-12-03T13:38:02.567465+0000, chain.objs.size()=21 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.1 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.1_1 2023-12-03T11:38:11.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.257+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.2 2023-12-03T11:38:11.262 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.260+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.2_1 2023-12-03T11:38:11.262 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.260+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.3 2023-12-03T11:38:11.262 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.260+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.3_1 2023-12-03T11:38:11.262 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.260+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.4 2023-12-03T11:38:11.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.263+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.4_1 2023-12-03T11:38:11.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.263+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.5 2023-12-03T11:38:11.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.263+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.5_1 2023-12-03T11:38:11.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.263+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.6 2023-12-03T11:38:11.264 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.263+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.6_1 2023-12-03T11:38:11.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.263+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.7 2023-12-03T11:38:11.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.263+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.7_1 2023-12-03T11:38:11.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.263+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.8 2023-12-03T11:38:11.265 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.263+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.8_1 2023-12-03T11:38:11.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.265+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.9 2023-12-03T11:38:11.266 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.265+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.9_1 2023-12-03T11:38:11.267 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.266+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.10 2023-12-03T11:38:11.267 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.266+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.10_1 2023-12-03T11:38:11.267 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.266+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~PBx1p2RzF1iVHwcUHSwreeGDAJePj7H.11 2023-12-03T11:38:11.267 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.266+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.17765915895414729234', time=2023-12-03T13:38:10.559503+0000, chain.objs.size()=21 2023-12-03T11:38:11.267 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.266+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__multipart_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.1 2023-12-03T11:38:11.268 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.266+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__shadow_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.1_1 2023-12-03T11:38:11.268 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.266+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__multipart_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.2 2023-12-03T11:38:11.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.267+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__shadow_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.2_1 2023-12-03T11:38:11.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.267+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__multipart_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.3 2023-12-03T11:38:11.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.268+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__shadow_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.3_1 2023-12-03T11:38:11.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.268+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__multipart_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.4 2023-12-03T11:38:11.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.268+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__shadow_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.4_1 2023-12-03T11:38:11.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.269+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__multipart_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.5 2023-12-03T11:38:11.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.269+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__shadow_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.5_1 2023-12-03T11:38:11.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.269+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__multipart_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.6 2023-12-03T11:38:11.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.269+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__shadow_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.6_1 2023-12-03T11:38:11.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.269+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__multipart_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.7 2023-12-03T11:38:11.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.269+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__shadow_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.7_1 2023-12-03T11:38:11.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.271+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__multipart_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.8 2023-12-03T11:38:11.272 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.271+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__shadow_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.8_1 2023-12-03T11:38:11.273 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.272+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__multipart_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.9 2023-12-03T11:38:11.274 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.272+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__shadow_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.9_1 2023-12-03T11:38:11.274 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.272+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__multipart_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.10 2023-12-03T11:38:11.274 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.272+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__shadow_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.10_1 2023-12-03T11:38:11.274 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.272+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.54__multipart_key1.2~vfb3DfhVLpH64YedFE4OlriLxPjKFcz.11 2023-12-03T11:38:11.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.276+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.278+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:38:11.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.279+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.279+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.280+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.280+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.3822417820461071908', time=2023-12-03T13:37:54.041593+0000, chain.objs.size()=7 2023-12-03T11:38:11.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.280+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~rt6LCsbrYXW2X0O2ZtLPiHFwOA6Nl9v.1 2023-12-03T11:38:11.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.280+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~rt6LCsbrYXW2X0O2ZtLPiHFwOA6Nl9v.1_1 2023-12-03T11:38:11.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.280+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~rt6LCsbrYXW2X0O2ZtLPiHFwOA6Nl9v.1_2 2023-12-03T11:38:11.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.280+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~rt6LCsbrYXW2X0O2ZtLPiHFwOA6Nl9v.2 2023-12-03T11:38:11.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.280+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~rt6LCsbrYXW2X0O2ZtLPiHFwOA6Nl9v.2_1 2023-12-03T11:38:11.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.280+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~rt6LCsbrYXW2X0O2ZtLPiHFwOA6Nl9v.2_2 2023-12-03T11:38:11.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.280+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~rt6LCsbrYXW2X0O2ZtLPiHFwOA6Nl9v.3 2023-12-03T11:38:11.284 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.283+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.285+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:38:11.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.286+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.288 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.287+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.288 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.287+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.289 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.288+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:38:11.290 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.289+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.291 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__shadow_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.1_1_e17d06f147339e87aa756de6c450b0f2', time=2023-12-03T13:37:49.058998+0000, chain.objs.size()=9 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__multipart_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.1 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__shadow_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.1_1 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__multipart_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.2 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__shadow_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.2_1 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__multipart_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.3 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__shadow_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.3_1 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__multipart_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.4 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__shadow_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.4_1 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__multipart_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.5 2023-12-03T11:38:11.292 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.8360478368560751889', time=2023-12-03T13:37:51.160876+0000, chain.objs.size()=9 2023-12-03T11:38:11.293 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~P2MZCE6TpMUHfb0MKVLYrJdBNmxlf2B.1 2023-12-03T11:38:11.293 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~P2MZCE6TpMUHfb0MKVLYrJdBNmxlf2B.1_1 2023-12-03T11:38:11.293 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.290+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~P2MZCE6TpMUHfb0MKVLYrJdBNmxlf2B.2 2023-12-03T11:38:11.293 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.291+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~P2MZCE6TpMUHfb0MKVLYrJdBNmxlf2B.2_1 2023-12-03T11:38:11.293 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.292+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~P2MZCE6TpMUHfb0MKVLYrJdBNmxlf2B.3 2023-12-03T11:38:11.293 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.292+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~P2MZCE6TpMUHfb0MKVLYrJdBNmxlf2B.3_1 2023-12-03T11:38:11.294 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.292+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~P2MZCE6TpMUHfb0MKVLYrJdBNmxlf2B.4 2023-12-03T11:38:11.294 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.292+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~P2MZCE6TpMUHfb0MKVLYrJdBNmxlf2B.4_1 2023-12-03T11:38:11.294 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.293+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~P2MZCE6TpMUHfb0MKVLYrJdBNmxlf2B.5 2023-12-03T11:38:11.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.295+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.298 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.297+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:38:11.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.298+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.18125873405852264304', time=2023-12-03T13:37:58.107183+0000, chain.objs.size()=9 2023-12-03T11:38:11.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.40__multipart_key1.2~zukhvNewSes03E5NjxM0fFYgBRbp59x.1 2023-12-03T11:38:11.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.40__shadow_key1.2~zukhvNewSes03E5NjxM0fFYgBRbp59x.1_1 2023-12-03T11:38:11.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.40__multipart_key1.2~zukhvNewSes03E5NjxM0fFYgBRbp59x.2 2023-12-03T11:38:11.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.40__shadow_key1.2~zukhvNewSes03E5NjxM0fFYgBRbp59x.2_1 2023-12-03T11:38:11.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.40__multipart_key1.2~zukhvNewSes03E5NjxM0fFYgBRbp59x.3 2023-12-03T11:38:11.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.40__shadow_key1.2~zukhvNewSes03E5NjxM0fFYgBRbp59x.3_1 2023-12-03T11:38:11.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.40__multipart_key1.2~zukhvNewSes03E5NjxM0fFYgBRbp59x.4 2023-12-03T11:38:11.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.40__shadow_key1.2~zukhvNewSes03E5NjxM0fFYgBRbp59x.4_1 2023-12-03T11:38:11.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.299+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.40__multipart_key1.2~zukhvNewSes03E5NjxM0fFYgBRbp59x.5 2023-12-03T11:38:11.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.303+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.306 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.305+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:38:11.308 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.306+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.17531328941735904880', time=2023-12-03T13:38:07.821129+0000, chain.objs.size()=9 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.45__multipart_key1.2~MA5SmP2h4_YIR9lM4QWTDLeL0E3CUUp.1 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.45__shadow_key1.2~MA5SmP2h4_YIR9lM4QWTDLeL0E3CUUp.1_1 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.45__multipart_key1.2~MA5SmP2h4_YIR9lM4QWTDLeL0E3CUUp.2 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.45__shadow_key1.2~MA5SmP2h4_YIR9lM4QWTDLeL0E3CUUp.2_1 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.45__multipart_key1.2~MA5SmP2h4_YIR9lM4QWTDLeL0E3CUUp.3 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.45__shadow_key1.2~MA5SmP2h4_YIR9lM4QWTDLeL0E3CUUp.3_1 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.45__multipart_key1.2~MA5SmP2h4_YIR9lM4QWTDLeL0E3CUUp.4 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.45__shadow_key1.2~MA5SmP2h4_YIR9lM4QWTDLeL0E3CUUp.4_1 2023-12-03T11:38:11.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.307+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.45__multipart_key1.2~MA5SmP2h4_YIR9lM4QWTDLeL0E3CUUp.5 2023-12-03T11:38:11.311 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.310+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.312+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:38:11.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.313+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.15731794287791610234', time=2023-12-03T13:38:04.975437+0000, chain.objs.size()=16 2023-12-03T11:38:11.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.1 2023-12-03T11:38:11.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.1_1 2023-12-03T11:38:11.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.1_2 2023-12-03T11:38:11.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.2 2023-12-03T11:38:11.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.2_1 2023-12-03T11:38:11.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.2_2 2023-12-03T11:38:11.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.3 2023-12-03T11:38:11.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.3_1 2023-12-03T11:38:11.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.3_2 2023-12-03T11:38:11.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.4 2023-12-03T11:38:11.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.4_1 2023-12-03T11:38:11.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.314+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.4_2 2023-12-03T11:38:11.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.317+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.5 2023-12-03T11:38:11.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.317+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.5_1 2023-12-03T11:38:11.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.318+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.5_2 2023-12-03T11:38:11.320 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.318+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~aD1wG9gG5Cq07_p4J8H8b6cVghmq50f.6 2023-12-03T11:38:11.322 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.321+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.323+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:38:11.326 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.324+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.326 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.12310773969739566892', time=2023-12-03T13:38:04.233437+0000, chain.objs.size()=19 2023-12-03T11:38:11.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.1 2023-12-03T11:38:11.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.1_1 2023-12-03T11:38:11.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.2 2023-12-03T11:38:11.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.2_1 2023-12-03T11:38:11.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.3 2023-12-03T11:38:11.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.3_1 2023-12-03T11:38:11.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.4 2023-12-03T11:38:11.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.4_1 2023-12-03T11:38:11.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.5 2023-12-03T11:38:11.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.5_1 2023-12-03T11:38:11.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.6 2023-12-03T11:38:11.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.325+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.6_1 2023-12-03T11:38:11.330 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.329+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.7 2023-12-03T11:38:11.330 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.329+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.7_1 2023-12-03T11:38:11.330 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.329+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.8 2023-12-03T11:38:11.331 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.329+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.8_1 2023-12-03T11:38:11.332 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.330+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.9 2023-12-03T11:38:11.332 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.330+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.9_1 2023-12-03T11:38:11.332 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.331+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~DE7V2xC97kbMjVW_Io75Y70FbTU2Nxl.10 2023-12-03T11:38:11.334 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.333+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.335+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:38:11.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.336+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.338 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.336+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.338 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.337+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.339 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.337+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:38:11.340 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.340 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.341 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.341 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='2~-8FtEQbOvO0enbvpxfDhPxqWvAZTc4s', time=2023-12-03T13:37:46.959664+0000, chain.objs.size()=9 2023-12-03T11:38:11.341 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.28__multipart_key1.2~-8FtEQbOvO0enbvpxfDhPxqWvAZTc4s.1 2023-12-03T11:38:11.341 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.28__shadow_key1.2~-8FtEQbOvO0enbvpxfDhPxqWvAZTc4s.1_1 2023-12-03T11:38:11.341 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.28__multipart_key1.2~-8FtEQbOvO0enbvpxfDhPxqWvAZTc4s.2 2023-12-03T11:38:11.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.28__shadow_key1.2~-8FtEQbOvO0enbvpxfDhPxqWvAZTc4s.2_1 2023-12-03T11:38:11.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.28__multipart_key1.2~-8FtEQbOvO0enbvpxfDhPxqWvAZTc4s.3 2023-12-03T11:38:11.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.28__shadow_key1.2~-8FtEQbOvO0enbvpxfDhPxqWvAZTc4s.3_1 2023-12-03T11:38:11.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.28__multipart_key1.2~-8FtEQbOvO0enbvpxfDhPxqWvAZTc4s.4 2023-12-03T11:38:11.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.28__shadow_key1.2~-8FtEQbOvO0enbvpxfDhPxqWvAZTc4s.4_1 2023-12-03T11:38:11.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.339+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.28__multipart_key1.2~-8FtEQbOvO0enbvpxfDhPxqWvAZTc4s.5 2023-12-03T11:38:11.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.343+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.345+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:38:11.348 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.347+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.348 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.347+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.348 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.347+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.349 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.348+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:38:11.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.350+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.350+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.351+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.351+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:38:11.354 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.354 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.17481021770068388075', time=2023-12-03T13:37:52.676940+0000, chain.objs.size()=9 2023-12-03T11:38:11.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~jNz14ndrpCnu_FU7toSWX-FQBzRznkp.1 2023-12-03T11:38:11.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~jNz14ndrpCnu_FU7toSWX-FQBzRznkp.1_1 2023-12-03T11:38:11.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~jNz14ndrpCnu_FU7toSWX-FQBzRznkp.2 2023-12-03T11:38:11.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~jNz14ndrpCnu_FU7toSWX-FQBzRznkp.2_1 2023-12-03T11:38:11.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~jNz14ndrpCnu_FU7toSWX-FQBzRznkp.3 2023-12-03T11:38:11.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~jNz14ndrpCnu_FU7toSWX-FQBzRznkp.3_1 2023-12-03T11:38:11.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~jNz14ndrpCnu_FU7toSWX-FQBzRznkp.4 2023-12-03T11:38:11.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~jNz14ndrpCnu_FU7toSWX-FQBzRznkp.4_1 2023-12-03T11:38:11.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.353+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~jNz14ndrpCnu_FU7toSWX-FQBzRznkp.5 2023-12-03T11:38:11.358 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.357+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.360 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.359+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:38:11.361 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.360+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.362 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.361+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.362 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.361+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.363 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.362+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:38:11.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.363+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.364+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.364+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.365+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:38:11.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.366+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:38:11.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.17712712720601136225', time=2023-12-03T13:37:54.290990+0000, chain.objs.size()=7 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~mevL-7gUHzEj3Qb0RfCfINswPxQyZ0s.1 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~mevL-7gUHzEj3Qb0RfCfINswPxQyZ0s.1_1 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~mevL-7gUHzEj3Qb0RfCfINswPxQyZ0s.1_2 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~mevL-7gUHzEj3Qb0RfCfINswPxQyZ0s.2 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~mevL-7gUHzEj3Qb0RfCfINswPxQyZ0s.2_1 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~mevL-7gUHzEj3Qb0RfCfINswPxQyZ0s.2_2 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~mevL-7gUHzEj3Qb0RfCfINswPxQyZ0s.3 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.6862732144422557354', time=2023-12-03T13:37:55.351568+0000, chain.objs.size()=9 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.39__multipart_key1.2~RgvVmhK2vnluUWiH2nMl2LVEexDQZZG.1 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.39__shadow_key1.2~RgvVmhK2vnluUWiH2nMl2LVEexDQZZG.1_1 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.367+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.39__multipart_key1.2~RgvVmhK2vnluUWiH2nMl2LVEexDQZZG.2 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.368+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.39__shadow_key1.2~RgvVmhK2vnluUWiH2nMl2LVEexDQZZG.2_1 2023-12-03T11:38:11.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.368+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.39__multipart_key1.2~RgvVmhK2vnluUWiH2nMl2LVEexDQZZG.3 2023-12-03T11:38:11.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.370+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.39__shadow_key1.2~RgvVmhK2vnluUWiH2nMl2LVEexDQZZG.3_1 2023-12-03T11:38:11.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.370+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.39__multipart_key1.2~RgvVmhK2vnluUWiH2nMl2LVEexDQZZG.4 2023-12-03T11:38:11.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.371+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.39__shadow_key1.2~RgvVmhK2vnluUWiH2nMl2LVEexDQZZG.4_1 2023-12-03T11:38:11.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.371+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.39__multipart_key1.2~RgvVmhK2vnluUWiH2nMl2LVEexDQZZG.5 2023-12-03T11:38:11.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.373+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.376 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.375+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:38:11.377 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.376+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.377 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.376+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.378 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.377+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.379 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.378+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:38:11.380 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.379+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.381 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.380+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.381 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.380+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.381+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:38:11.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.382+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.382+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.384 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.383+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.385 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.384+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:38:11.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.385+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.385+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.385+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.387+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:38:11.389 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.388+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.390 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.388+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.391 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.389+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.391 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.389+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.9049352172335981405', time=2023-12-03T13:37:48.091856+0000, chain.objs.size()=9 2023-12-03T11:38:11.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.389+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.30__multipart_key1.2~6E-q4xiRCmn0bJqpvXLLSx4SoGKkgmc.1 2023-12-03T11:38:11.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.389+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.30__shadow_key1.2~6E-q4xiRCmn0bJqpvXLLSx4SoGKkgmc.1_1 2023-12-03T11:38:11.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.389+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.30__multipart_key1.2~6E-q4xiRCmn0bJqpvXLLSx4SoGKkgmc.2 2023-12-03T11:38:11.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.389+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.30__shadow_key1.2~6E-q4xiRCmn0bJqpvXLLSx4SoGKkgmc.2_1 2023-12-03T11:38:11.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.389+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.30__multipart_key1.2~6E-q4xiRCmn0bJqpvXLLSx4SoGKkgmc.3 2023-12-03T11:38:11.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.389+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.30__shadow_key1.2~6E-q4xiRCmn0bJqpvXLLSx4SoGKkgmc.3_1 2023-12-03T11:38:11.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.389+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.30__multipart_key1.2~6E-q4xiRCmn0bJqpvXLLSx4SoGKkgmc.4 2023-12-03T11:38:11.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.389+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.30__shadow_key1.2~6E-q4xiRCmn0bJqpvXLLSx4SoGKkgmc.4_1 2023-12-03T11:38:11.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.389+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.30__multipart_key1.2~6E-q4xiRCmn0bJqpvXLLSx4SoGKkgmc.5 2023-12-03T11:38:11.394 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.393+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.395+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:38:11.397 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.396+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.398 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.11951167798966178046', time=2023-12-03T13:37:48.953236+0000, chain.objs.size()=9 2023-12-03T11:38:11.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__multipart_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.1 2023-12-03T11:38:11.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__shadow_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.1_1 2023-12-03T11:38:11.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__multipart_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.2 2023-12-03T11:38:11.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__shadow_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.2_1 2023-12-03T11:38:11.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__multipart_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.3 2023-12-03T11:38:11.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__shadow_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.3_1 2023-12-03T11:38:11.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__multipart_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.4 2023-12-03T11:38:11.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__shadow_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.4_1 2023-12-03T11:38:11.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.397+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.32__multipart_key1.2~Azj_2a7u8JhcL3SBkYC6cJHk2NrZmF8.5 2023-12-03T11:38:11.400 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.399+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.402 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.401+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:38:11.404 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.403+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.404 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.403+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.405 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.403+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.403+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.6004488302092032521', time=2023-12-03T13:38:05.720419+0000, chain.objs.size()=16 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.1 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.1_1 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.1_2 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.2 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.2_1 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.2_2 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.3 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.3_1 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.3_2 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.4 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.4_1 2023-12-03T11:38:11.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.404+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.4_2 2023-12-03T11:38:11.409 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.408+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.5 2023-12-03T11:38:11.409 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.408+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.5_1 2023-12-03T11:38:11.409 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.408+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.5_2 2023-12-03T11:38:11.410 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.408+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~AH96dHOnF-MA22hrlmEoJSYOjxh7ZNF.6 2023-12-03T11:38:11.411 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.410+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.413 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.412+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:38:11.415 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.413+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.415 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.939501144866151461', time=2023-12-03T13:37:58.717974+0000, chain.objs.size()=9 2023-12-03T11:38:11.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__multipart_file2.mpg.2~o9GhXHww8DNJ8hv65NU2lLbRoqKPEcp.1 2023-12-03T11:38:11.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__shadow_file2.mpg.2~o9GhXHww8DNJ8hv65NU2lLbRoqKPEcp.1_1 2023-12-03T11:38:11.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__multipart_file2.mpg.2~o9GhXHww8DNJ8hv65NU2lLbRoqKPEcp.2 2023-12-03T11:38:11.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__shadow_file2.mpg.2~o9GhXHww8DNJ8hv65NU2lLbRoqKPEcp.2_1 2023-12-03T11:38:11.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__multipart_file2.mpg.2~o9GhXHww8DNJ8hv65NU2lLbRoqKPEcp.3 2023-12-03T11:38:11.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__shadow_file2.mpg.2~o9GhXHww8DNJ8hv65NU2lLbRoqKPEcp.3_1 2023-12-03T11:38:11.417 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__multipart_file2.mpg.2~o9GhXHww8DNJ8hv65NU2lLbRoqKPEcp.4 2023-12-03T11:38:11.417 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__shadow_file2.mpg.2~o9GhXHww8DNJ8hv65NU2lLbRoqKPEcp.4_1 2023-12-03T11:38:11.417 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.414+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__multipart_file2.mpg.2~o9GhXHww8DNJ8hv65NU2lLbRoqKPEcp.5 2023-12-03T11:38:11.419 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.418+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.420+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:38:11.423 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.421+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.423 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.4102818483646780176', time=2023-12-03T13:38:07.100764+0000, chain.objs.size()=9 2023-12-03T11:38:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.44__multipart_key1.2~stJXJ0lZv7dDMGCnQt1xlx25A5I1iP4.1 2023-12-03T11:38:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.44__shadow_key1.2~stJXJ0lZv7dDMGCnQt1xlx25A5I1iP4.1_1 2023-12-03T11:38:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.44__multipart_key1.2~stJXJ0lZv7dDMGCnQt1xlx25A5I1iP4.2 2023-12-03T11:38:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.44__shadow_key1.2~stJXJ0lZv7dDMGCnQt1xlx25A5I1iP4.2_1 2023-12-03T11:38:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.44__multipart_key1.2~stJXJ0lZv7dDMGCnQt1xlx25A5I1iP4.3 2023-12-03T11:38:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.44__shadow_key1.2~stJXJ0lZv7dDMGCnQt1xlx25A5I1iP4.3_1 2023-12-03T11:38:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.44__multipart_key1.2~stJXJ0lZv7dDMGCnQt1xlx25A5I1iP4.4 2023-12-03T11:38:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.44__shadow_key1.2~stJXJ0lZv7dDMGCnQt1xlx25A5I1iP4.4_1 2023-12-03T11:38:11.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.422+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.44__multipart_key1.2~stJXJ0lZv7dDMGCnQt1xlx25A5I1iP4.5 2023-12-03T11:38:11.427 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.426+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.429 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.428+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:38:11.431 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.429+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.431 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.432 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.432 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.17241998417610967946', time=2023-12-03T13:38:03.489886+0000, chain.objs.size()=21 2023-12-03T11:38:11.432 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.1 2023-12-03T11:38:11.432 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.1_1 2023-12-03T11:38:11.432 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.2 2023-12-03T11:38:11.432 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.2_1 2023-12-03T11:38:11.432 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.3 2023-12-03T11:38:11.433 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.3_1 2023-12-03T11:38:11.433 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.4 2023-12-03T11:38:11.433 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.4_1 2023-12-03T11:38:11.433 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.5 2023-12-03T11:38:11.433 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.5_1 2023-12-03T11:38:11.433 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.6 2023-12-03T11:38:11.433 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.430+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.6_1 2023-12-03T11:38:11.435 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.434+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.7 2023-12-03T11:38:11.435 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.434+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.7_1 2023-12-03T11:38:11.436 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.434+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.8 2023-12-03T11:38:11.436 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.434+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.8_1 2023-12-03T11:38:11.436 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.434+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.9 2023-12-03T11:38:11.436 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.434+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.9_1 2023-12-03T11:38:11.436 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.434+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.10 2023-12-03T11:38:11.436 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.434+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__shadow_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.10_1 2023-12-03T11:38:11.436 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.434+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.43__multipart_key1.2~6KHTXnOTdbAUREOtSXXcMOVWca9rLU2.11 2023-12-03T11:38:11.438 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.437+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.440 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.439+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:38:11.441 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.440+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.441+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.441+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.441+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.17194898784832743602', time=2023-12-03T13:37:53.096895+0000, chain.objs.size()=7 2023-12-03T11:38:11.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.441+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~5-FwSp1YfMMeQaieMkf37v0JvUxij9X.1 2023-12-03T11:38:11.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.441+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~5-FwSp1YfMMeQaieMkf37v0JvUxij9X.1_1 2023-12-03T11:38:11.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.441+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~5-FwSp1YfMMeQaieMkf37v0JvUxij9X.1_2 2023-12-03T11:38:11.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.441+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~5-FwSp1YfMMeQaieMkf37v0JvUxij9X.2 2023-12-03T11:38:11.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.441+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~5-FwSp1YfMMeQaieMkf37v0JvUxij9X.2_1 2023-12-03T11:38:11.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.441+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__shadow_key1.2~5-FwSp1YfMMeQaieMkf37v0JvUxij9X.2_2 2023-12-03T11:38:11.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.441+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.35__multipart_key1.2~5-FwSp1YfMMeQaieMkf37v0JvUxij9X.3 2023-12-03T11:38:11.446 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.444+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.448 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.447+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:38:11.449 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.448+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.449+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.449+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.451 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.450+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:38:11.452 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.451+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.453 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5301980125314888355', time=2023-12-03T13:37:58.708620+0000, chain.objs.size()=9 2023-12-03T11:38:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__multipart_file.mpg.2~nn-VRMux7P_mhEgGIOH-FmOyIU1IJBY.1 2023-12-03T11:38:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__shadow_file.mpg.2~nn-VRMux7P_mhEgGIOH-FmOyIU1IJBY.1_1 2023-12-03T11:38:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__multipart_file.mpg.2~nn-VRMux7P_mhEgGIOH-FmOyIU1IJBY.2 2023-12-03T11:38:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__shadow_file.mpg.2~nn-VRMux7P_mhEgGIOH-FmOyIU1IJBY.2_1 2023-12-03T11:38:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__multipart_file.mpg.2~nn-VRMux7P_mhEgGIOH-FmOyIU1IJBY.3 2023-12-03T11:38:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__shadow_file.mpg.2~nn-VRMux7P_mhEgGIOH-FmOyIU1IJBY.3_1 2023-12-03T11:38:11.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__multipart_file.mpg.2~nn-VRMux7P_mhEgGIOH-FmOyIU1IJBY.4 2023-12-03T11:38:11.455 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__shadow_file.mpg.2~nn-VRMux7P_mhEgGIOH-FmOyIU1IJBY.4_1 2023-12-03T11:38:11.455 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.452+0000 7f2687b25800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.41__multipart_file.mpg.2~nn-VRMux7P_mhEgGIOH-FmOyIU1IJBY.5 2023-12-03T11:38:11.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.456+0000 7f2687b25800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:11.459 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.458+0000 7f2687b25800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:38:11.461 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.460+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.461 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.460+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.461 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.460+0000 7f2687b25800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.463 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.462+0000 7f2649fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:11.465 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.464+0000 7f2687b25800 20 remove_watcher() i=0 2023-12-03T11:38:11.465 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.464+0000 7f2687b25800 2 removed watcher, disabling cache 2023-12-03T11:38:11.466 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.465+0000 7f2687b25800 20 remove_watcher() i=1 2023-12-03T11:38:11.467 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.466+0000 7f2687b25800 20 remove_watcher() i=2 2023-12-03T11:38:11.468 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.467+0000 7f2687b25800 20 remove_watcher() i=3 2023-12-03T11:38:11.469 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.468+0000 7f2687b25800 20 remove_watcher() i=4 2023-12-03T11:38:11.470 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.469+0000 7f2687b25800 20 remove_watcher() i=5 2023-12-03T11:38:11.471 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.470+0000 7f2687b25800 20 remove_watcher() i=6 2023-12-03T11:38:11.472 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.471+0000 7f2687b25800 20 remove_watcher() i=7 2023-12-03T11:38:11.477 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:38:11.526 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:11.526 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:11.540 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.539+0000 7f2f6b525800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.542 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.541+0000 7f2f6b525800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.542 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.541+0000 7f2f6b525800 20 realm 2023-12-03T11:38:11.542 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.541+0000 7f2f6b525800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.543 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.541+0000 7f2f6b525800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.543 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.541+0000 7f2f6b525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:11.543 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.541+0000 7f2f6b525800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.543 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.541+0000 7f2f6b525800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.543 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.541+0000 7f2f6b525800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.543 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.542+0000 7f2f6b525800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:11.544 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.542+0000 7f2f6b525800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.544 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.542+0000 7f2f6b525800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:11.544 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.542+0000 7f2f6b525800 20 searching for the correct realm 2023-12-03T11:38:11.553 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.552+0000 7f2f67154640 0 -- 172.21.15.131:0/3479209160 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55733081eda0 msgr2=0x5573308211d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:11.555 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.553+0000 7f2f6b525800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:11.555 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.553+0000 7f2f6b525800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:11.555 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.553+0000 7f2f6b525800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:11.555 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.553+0000 7f2f6b525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:11.555 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.553+0000 7f2f6b525800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.555 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.555 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.556 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:11.556 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:11.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 20 zone default found 2023-12-03T11:38:11.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 4 Realm: () 2023-12-03T11:38:11.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:11.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:11.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:11.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 20 zonegroup default 2023-12-03T11:38:11.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.554+0000 7f2f6b525800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.558 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.555+0000 7f2f6b525800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.558 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.555+0000 7f2f6b525800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.558 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.555+0000 7f2f6b525800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.558 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.555+0000 7f2f6b525800 20 started sync module instance, tier type = 2023-12-03T11:38:11.558 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.555+0000 7f2f6b525800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:11.563 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.562+0000 7f2f67955640 0 -- 172.21.15.131:0/3479209160 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f2f5c0898f0 msgr2=0x7f2f5c08b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:11.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.564+0000 7f2f6b525800 20 add_watcher() i=0 2023-12-03T11:38:11.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.564+0000 7f2f6b525800 20 add_watcher() i=1 2023-12-03T11:38:11.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.564+0000 7f2f6b525800 20 add_watcher() i=2 2023-12-03T11:38:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.564+0000 7f2f6b525800 20 add_watcher() i=3 2023-12-03T11:38:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.564+0000 7f2f6b525800 20 add_watcher() i=4 2023-12-03T11:38:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.564+0000 7f2f6b525800 20 add_watcher() i=5 2023-12-03T11:38:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.564+0000 7f2f6b525800 20 add_watcher() i=6 2023-12-03T11:38:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.565+0000 7f2f6b525800 20 add_watcher() i=7 2023-12-03T11:38:11.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.565+0000 7f2f6b525800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:11.568 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.566+0000 7f2f2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:11.568 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.567+0000 7f2f6b525800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:11.568 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.567+0000 7f2f6b525800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:11.608 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.606+0000 7f2e9bfff640 20 reqs_thread_entry: start 2023-12-03T11:38:11.608 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.606+0000 7f2f6b525800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:11.608 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.606+0000 7f2f6b525800 20 Filter name: none 2023-12-03T11:38:11.608 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.606+0000 7f2e99ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:11.608 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.606+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:38:11.609 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.608+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.610 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.609+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.610 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.609+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.610+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:38:11.612 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.611+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.613 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.612+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.613 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.612+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.613+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:38:11.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.614+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.615+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.615+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.617 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.616+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:38:11.618 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.617+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.619 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.618+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.619 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.618+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.620 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.619+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:38:11.621 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.620+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.622 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.621+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.622 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.621+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.623 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.622+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:38:11.624 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.623+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.624 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.623+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.625 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.624+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.626 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.624+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:38:11.627 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.626+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.627 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.626+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.628 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.627+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.629 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.627+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:38:11.630 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.629+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.630 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.629+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.630 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.629+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.631 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.630+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:38:11.632 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.631+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.632+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.632+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.634 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.633+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:38:11.635 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.634+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.636 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.635+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.636 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.635+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.637 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.636+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:38:11.638 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.637+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.639 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.638+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.639 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.638+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.640 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.639+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:38:11.641 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.640+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.642 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.640+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.642 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.641+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.643 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.641+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:38:11.644 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.643+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.644 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.643+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.644 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.643+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.645 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.644+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:38:11.646 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.645+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.647 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.646+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.647 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.646+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.648 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.647+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:38:11.649 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.648+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.649 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.648+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.650 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.649+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.651 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.650+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:38:11.652 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.651+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.653 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.652+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.653 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.652+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.654 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.653+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:38:11.656 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.654+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.656 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.655+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.656 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.655+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.657 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.656+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:38:11.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.657+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.658+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.658+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.660 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.659+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:38:11.662 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.660+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.662 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.661+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.662 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.661+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.663 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.662+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:38:11.665 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.663+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.665 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.664+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.665 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.664+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.667 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.665+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:38:11.668 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.667+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.668 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.667+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.668 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.667+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.669 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.668+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:38:11.671 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.670+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.671 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.670+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.672 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.670+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.673 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.671+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:38:11.674 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.673+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.674 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.673+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.673+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.674+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:38:11.677 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.676+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.677 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.676+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.677 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.676+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.678 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.677+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:38:11.679 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.678+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.680 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.679+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.680 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.679+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.681 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.680+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:38:11.682 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.681+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.683 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.682+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.683 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.682+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.684 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.683+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:38:11.685 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.684+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.686 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.685+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.686 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.685+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.687 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.686+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:38:11.688 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.687+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.688 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.687+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.689 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.688+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.690 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.689+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:38:11.691 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.690+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.691 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.690+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.692 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.691+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.693 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.691+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:38:11.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.693+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.693+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.693+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.695+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:38:11.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.696+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.698 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.697+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.698 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.697+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.699 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.698+0000 7f2f6b525800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:38:11.700 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.699+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.701 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.700+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.701 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.700+0000 7f2f6b525800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.702+0000 7f2f2d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:11.705 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.704+0000 7f2f6b525800 20 remove_watcher() i=0 2023-12-03T11:38:11.705 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.704+0000 7f2f6b525800 2 removed watcher, disabling cache 2023-12-03T11:38:11.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.705+0000 7f2f6b525800 20 remove_watcher() i=1 2023-12-03T11:38:11.707 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.706+0000 7f2f6b525800 20 remove_watcher() i=2 2023-12-03T11:38:11.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.707+0000 7f2f6b525800 20 remove_watcher() i=3 2023-12-03T11:38:11.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.707+0000 7f2f6b525800 20 remove_watcher() i=4 2023-12-03T11:38:11.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.708+0000 7f2f6b525800 20 remove_watcher() i=5 2023-12-03T11:38:11.710 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.709+0000 7f2f6b525800 20 remove_watcher() i=6 2023-12-03T11:38:11.711 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.710+0000 7f2f6b525800 20 remove_watcher() i=7 2023-12-03T11:38:11.716 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:38:11.765 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:11.765 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:11.778 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.777+0000 7f8025b22800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.780 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.779+0000 7f8025b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.780 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.779+0000 7f8025b22800 20 realm 2023-12-03T11:38:11.780 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.779+0000 7f8025b22800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.780 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.779+0000 7f8025b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.780 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.779+0000 7f8025b22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:11.780 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.779+0000 7f8025b22800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.781 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.779+0000 7f8025b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.781 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.779+0000 7f8025b22800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.781 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.780+0000 7f8025b22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:11.781 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.780+0000 7f8025b22800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.781 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.780+0000 7f8025b22800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:11.781 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.780+0000 7f8025b22800 20 searching for the correct realm 2023-12-03T11:38:11.790 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.789+0000 7f801907d640 0 -- 172.21.15.131:0/770583394 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x557f857ef310 msgr2=0x557f857f1700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:11.791 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.790+0000 7f8025b22800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:11.791 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.790+0000 7f8025b22800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:11.791 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.790+0000 7f8025b22800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:11.791 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.790+0000 7f8025b22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:11.792 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.790+0000 7f8025b22800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.792 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.790+0000 7f8025b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.792 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.790+0000 7f8025b22800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.790+0000 7f8025b22800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:11.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.790+0000 7f8025b22800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:11.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 20 zone default found 2023-12-03T11:38:11.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 4 Realm: () 2023-12-03T11:38:11.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:11.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:11.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:11.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 20 zonegroup default 2023-12-03T11:38:11.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 20 rados->read ofs=0 len=0 2023-12-03T11:38:11.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:11.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 20 started sync module instance, tier type = 2023-12-03T11:38:11.794 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.791+0000 7f8025b22800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:11.800 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.799+0000 7f801907d640 0 -- 172.21.15.131:0/770583394 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x7f7ffc079640 msgr2=0x7f7ffc07ba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:11.801 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.800+0000 7f8025b22800 20 add_watcher() i=0 2023-12-03T11:38:11.801 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.800+0000 7f8025b22800 20 add_watcher() i=1 2023-12-03T11:38:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.800+0000 7f8025b22800 20 add_watcher() i=2 2023-12-03T11:38:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.800+0000 7f8025b22800 20 add_watcher() i=3 2023-12-03T11:38:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.800+0000 7f8025b22800 20 add_watcher() i=4 2023-12-03T11:38:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.800+0000 7f8025b22800 20 add_watcher() i=5 2023-12-03T11:38:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.800+0000 7f8025b22800 20 add_watcher() i=6 2023-12-03T11:38:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.801+0000 7f8025b22800 20 add_watcher() i=7 2023-12-03T11:38:11.802 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.801+0000 7f8025b22800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:11.804 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.802+0000 7f7fe77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:11.804 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.803+0000 7f8025b22800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:11.804 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.803+0000 7f8025b22800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:11.844 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.843+0000 7f7f567fc640 20 reqs_thread_entry: start 2023-12-03T11:38:11.845 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.843+0000 7f8025b22800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:11.845 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.843+0000 7f8025b22800 20 Filter name: none 2023-12-03T11:38:11.845 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.843+0000 7f7f47fff640 20 reqs_thread_entry: start 2023-12-03T11:38:11.845 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.843+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:38:11.846 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.845+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.846 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.845+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.846 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.845+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.848 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.846+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:38:11.849 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.848+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.849 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.848+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.849 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.848+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.851 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.849+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:38:11.852 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.851+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.852 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.851+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.853 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.851+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.854 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.852+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:38:11.855 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.854+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.855 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.854+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.855 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.854+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.856 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.855+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:38:11.858 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.856+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.858 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.857+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.858 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.857+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.859 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.858+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:38:11.861 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.860+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.862 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.861+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.862 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.861+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.863 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.862+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:38:11.864 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.863+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.865 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.863+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.865 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.864+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.866 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.865+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:38:11.867 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.866+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.868 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.866+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.868 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.867+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.869 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.868+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:38:11.870 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.869+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.870 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.869+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.869+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.870+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:38:11.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.872+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.872+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.874 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.872+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.873+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:38:11.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.875+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.875+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.875+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.876+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:38:11.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.877+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.879 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.878+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.879 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.878+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.880 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.879+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:38:11.881 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.880+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.881 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.880+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.882 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.881+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.883 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.882+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:38:11.884 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.883+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.884 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.883+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.885 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.883+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.886 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.885+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:38:11.887 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.886+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.887 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.886+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.888 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.886+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.889 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.887+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:38:11.890 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.889+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.890 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.889+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.890 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.889+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.891 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.890+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:38:11.893 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.891+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.893 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.892+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.893 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.892+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.894 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.893+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:38:11.896 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.894+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.896 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.895+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.896 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.895+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.897 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.896+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:38:11.898 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.897+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.899 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.898+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.899 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.898+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.900 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.899+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:38:11.902 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.900+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.902 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.901+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.902 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.901+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.903 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.902+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:38:11.904 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.903+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.905 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.904+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.905 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.904+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.906 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.905+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:38:11.907 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.906+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.908 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.907+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.908 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.907+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.909 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.908+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:38:11.911 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.910+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.911 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.910+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.911 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.910+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.912 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.911+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:38:11.913 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.912+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.914 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.913+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.914 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.913+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.915 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.914+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:38:11.916 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.915+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.916 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.915+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.917 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.916+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.917+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:38:11.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.918+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.918+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.920 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.919+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.921 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.919+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:38:11.922 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.921+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.922 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.921+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.922 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.921+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.923 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.922+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:38:11.924 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.923+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.925 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.924+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.925 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.924+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.925+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:38:11.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.926+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.927+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.928 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.927+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.929 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.928+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:38:11.930 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.929+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.931 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.930+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.931 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.930+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.932 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.931+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:38:11.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.932+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.933+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.933+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.935 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.934+0000 7f8025b22800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:38:11.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.935+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.935+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:11.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.936+0000 7f8025b22800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:11.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.937+0000 7f7fe77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:11.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.939+0000 7f8025b22800 20 remove_watcher() i=0 2023-12-03T11:38:11.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.939+0000 7f8025b22800 2 removed watcher, disabling cache 2023-12-03T11:38:11.941 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.940+0000 7f8025b22800 20 remove_watcher() i=1 2023-12-03T11:38:11.942 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.941+0000 7f8025b22800 20 remove_watcher() i=2 2023-12-03T11:38:11.943 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.942+0000 7f8025b22800 20 remove_watcher() i=3 2023-12-03T11:38:11.944 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.943+0000 7f8025b22800 20 remove_watcher() i=4 2023-12-03T11:38:11.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.944+0000 7f8025b22800 20 remove_watcher() i=5 2023-12-03T11:38:11.946 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.945+0000 7f8025b22800 20 remove_watcher() i=6 2023-12-03T11:38:11.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:11.946+0000 7f8025b22800 20 remove_watcher() i=7 2023-12-03T11:38:11.952 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:38:12.001 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:12.001 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:12.015 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.014+0000 7f7089b20800 20 rados->read ofs=0 len=0 2023-12-03T11:38:12.017 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.015+0000 7f7089b20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:12.017 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.015+0000 7f7089b20800 20 realm 2023-12-03T11:38:12.017 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.015+0000 7f7089b20800 20 rados->read ofs=0 len=0 2023-12-03T11:38:12.017 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.015+0000 7f7089b20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:12.017 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.015+0000 7f7089b20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:12.017 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.015+0000 7f7089b20800 20 rados->read ofs=0 len=0 2023-12-03T11:38:12.017 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.016+0000 7f7089b20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:12.017 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.016+0000 7f7089b20800 20 rados->read ofs=0 len=0 2023-12-03T11:38:12.018 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.016+0000 7f7089b20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:12.018 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.016+0000 7f7089b20800 20 rados->read ofs=0 len=0 2023-12-03T11:38:12.018 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.017+0000 7f7089b20800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:12.018 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.017+0000 7f7089b20800 20 searching for the correct realm 2023-12-03T11:38:12.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.026+0000 7f70857ed640 0 -- 172.21.15.131:0/2486039159 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f708001d060 msgr2=0x7f708005a170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:12.029 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.027+0000 7f7089b20800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:12.029 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.027+0000 7f7089b20800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:12.029 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.027+0000 7f7089b20800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:12.029 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.027+0000 7f7089b20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.027+0000 7f7089b20800 20 rados->read ofs=0 len=0 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.027+0000 7f7089b20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.027+0000 7f7089b20800 20 rados->read ofs=0 len=0 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 20 rados->read ofs=0 len=0 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 20 zone default found 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 4 Realm: () 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:12.030 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 20 zonegroup default 2023-12-03T11:38:12.031 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 20 rados->read ofs=0 len=0 2023-12-03T11:38:12.031 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:12.031 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 20 rados->read ofs=0 len=0 2023-12-03T11:38:12.031 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:12.032 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.028+0000 7f7089b20800 20 rados->read ofs=0 len=0 2023-12-03T11:38:12.032 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.029+0000 7f7089b20800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:12.032 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.029+0000 7f7089b20800 20 started sync module instance, tier type = 2023-12-03T11:38:12.032 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.029+0000 7f7089b20800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:12.035 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.034+0000 7f70857ed640 0 -- 172.21.15.131:0/2486039159 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f7060079670 msgr2=0x7f706007baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:12.039 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.038+0000 7f7089b20800 20 add_watcher() i=0 2023-12-03T11:38:12.039 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.038+0000 7f7089b20800 20 add_watcher() i=1 2023-12-03T11:38:12.039 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.038+0000 7f7089b20800 20 add_watcher() i=2 2023-12-03T11:38:12.040 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.038+0000 7f7089b20800 20 add_watcher() i=3 2023-12-03T11:38:12.040 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.038+0000 7f7089b20800 20 add_watcher() i=4 2023-12-03T11:38:12.040 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.038+0000 7f7089b20800 20 add_watcher() i=5 2023-12-03T11:38:12.040 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.038+0000 7f7089b20800 20 add_watcher() i=6 2023-12-03T11:38:12.040 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.039+0000 7f7089b20800 20 add_watcher() i=7 2023-12-03T11:38:12.040 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.039+0000 7f7089b20800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:12.041 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.040+0000 7f704afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:12.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.041+0000 7f7089b20800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:12.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.041+0000 7f7089b20800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:12.083 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.081+0000 7f6fb9ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:12.083 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.081+0000 7f7089b20800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:12.083 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.081+0000 7f7089b20800 20 Filter name: none 2023-12-03T11:38:12.083 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.081+0000 7f6fab7fe640 20 reqs_thread_entry: start 2023-12-03T11:38:12.083 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.081+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:38:12.084 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.083+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.084 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.083+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.085 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.083+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.085 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.084+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:38:12.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.086+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.086+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.088 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.086+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.089 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.087+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:38:12.090 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.089+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.090 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.089+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.090 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.089+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.091 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.090+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:38:12.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.091+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.093 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.092+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.093 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.092+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.093+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:38:12.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.094+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.095+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.095+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.096+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:38:12.098 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.097+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.099 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.098+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.099 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.098+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.099+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:38:12.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.101+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.101+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.101+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.102+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:38:12.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.103+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.104+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.104+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.106 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.105+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:38:12.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.106+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.108 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.107+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.108 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.107+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.109 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.108+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:38:12.110 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.109+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.109+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.110+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.110+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:38:12.113 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.112+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.113 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.112+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.113+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.113+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:38:12.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.115+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.115+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.115+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.116+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:38:12.119 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.118+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.119 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.118+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.119 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.118+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.120 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.119+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:38:12.121 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.120+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.122 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.121+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.122 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.121+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.123 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.122+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:38:12.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.123+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.124+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.124+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.125+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:38:12.128 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.126+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.128 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.127+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.128 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.127+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.128+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:38:12.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.129+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.130+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.130+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.131+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:38:12.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.132+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.133+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.133+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.134+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:38:12.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.136+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.136+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.136+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.137+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:38:12.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.139+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.139+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.139+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.141 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.140+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:38:12.143 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.142+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.143 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.142+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.143 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.142+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.145 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.143+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:38:12.146 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.145+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.146 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.145+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.146+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.146+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:38:12.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.148+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.148+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.148+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.151 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.149+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:38:12.152 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.151+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.152 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.151+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.153 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.151+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.153 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.152+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:38:12.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.153+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.154+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.154+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.155+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:38:12.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.156+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.157+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.157+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.159 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.158+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:38:12.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.160+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.160+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.160+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.161+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:38:12.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.162+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.163+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.163+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.165 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.164+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:38:12.166 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.165+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.166+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.166+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.167+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:38:12.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.168+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.169+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.169+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.170+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:38:12.173 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.171+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.173 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.172+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.174 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.172+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.174 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.173+0000 7f7089b20800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:38:12.176 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.175+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.176 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.175+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:12.176 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.175+0000 7f7089b20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:12.178 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.177+0000 7f704afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:12.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.180+0000 7f7089b20800 20 remove_watcher() i=0 2023-12-03T11:38:12.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.180+0000 7f7089b20800 2 removed watcher, disabling cache 2023-12-03T11:38:12.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.181+0000 7f7089b20800 20 remove_watcher() i=1 2023-12-03T11:38:12.183 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.181+0000 7f7089b20800 20 remove_watcher() i=2 2023-12-03T11:38:12.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.183+0000 7f7089b20800 20 remove_watcher() i=3 2023-12-03T11:38:12.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.183+0000 7f7089b20800 20 remove_watcher() i=4 2023-12-03T11:38:12.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.184+0000 7f7089b20800 20 remove_watcher() i=5 2023-12-03T11:38:12.187 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.186+0000 7f7089b20800 20 remove_watcher() i=6 2023-12-03T11:38:12.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:12.187+0000 7f7089b20800 20 remove_watcher() i=7 2023-12-03T11:38:12.193 DEBUG:teuthology.orchestra.run.smithi131:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2023-12-03T11:38:12.658 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :clean 2023-12-03T11:38:13.355 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :compileJava 2023-12-03T11:38:13.356 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :processResources 2023-12-03T11:38:13.356 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :classes 2023-12-03T11:38:13.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:13.656 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :compileTestJava 2023-12-03T11:38:13.657 INFO:teuthology.orchestra.run.smithi131.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-12-03T11:38:13.657 INFO:teuthology.orchestra.run.smithi131.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-12-03T11:38:13.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:13.658 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :processTestResources NO-SOURCE 2023-12-03T11:38:13.659 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :testClasses 2023-12-03T11:38:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:15.657 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :test 2023-12-03T11:38:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:15.657 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2023-12-03T11:38:15.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2023-12-03T11:38:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2023-12-03T11:38:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2023-12-03T11:38:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2023-12-03T11:38:15.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:15.658 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2023-12-03T11:38:15.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:15.756 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2023-12-03T11:38:15.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:15.756 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2023-12-03T11:38:15.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:15.855 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2023-12-03T11:38:15.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:15.955 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2023-12-03T11:38:16.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:16.156 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2023-12-03T11:38:16.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:16.156 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2023-12-03T11:38:16.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:16.255 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2023-12-03T11:38:16.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:16.355 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2023-12-03T11:38:16.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:16.555 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2023-12-03T11:38:16.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:16.655 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2023-12-03T11:38:16.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:16.855 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2023-12-03T11:38:16.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:16.856 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2023-12-03T11:38:16.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:16.956 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------- 2023-12-03T11:38:16.956 INFO:teuthology.orchestra.run.smithi131.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2023-12-03T11:38:16.956 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------- 2023-12-03T11:38:16.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:16.981 INFO:teuthology.orchestra.run.smithi131.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-12-03T11:38:16.981 INFO:teuthology.orchestra.run.smithi131.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-12-03T11:38:16.981 INFO:teuthology.orchestra.run.smithi131.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-12-03T11:38:16.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:16.982 INFO:teuthology.orchestra.run.smithi131.stdout:BUILD SUCCESSFUL in 4s 2023-12-03T11:38:16.982 INFO:teuthology.orchestra.run.smithi131.stdout:5 actionable tasks: 5 executed 2023-12-03T11:38:16.985 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:38:17.033 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:17.034 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:17.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.046+0000 7f4d2fd2d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.047+0000 7f4d2fd2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.047+0000 7f4d2fd2d800 20 realm 2023-12-03T11:38:17.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.047+0000 7f4d2fd2d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.048+0000 7f4d2fd2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.048+0000 7f4d2fd2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:17.050 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.048+0000 7f4d2fd2d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.050 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.048+0000 7f4d2fd2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.050 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.048+0000 7f4d2fd2d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.050 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.049+0000 7f4d2fd2d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:17.050 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.049+0000 7f4d2fd2d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.049+0000 7f4d2fd2d800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:17.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.049+0000 7f4d2fd2d800 20 searching for the correct realm 2023-12-03T11:38:17.061 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.059+0000 7f4d2b97e640 0 -- 172.21.15.131:0/445051948 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x557f5ee79cd0 msgr2=0x557f5ee7c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:17.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.061+0000 7f4d2fd2d800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:17.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.061+0000 7f4d2fd2d800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:17.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.061+0000 7f4d2fd2d800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:17.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.061+0000 7f4d2fd2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:17.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.061+0000 7f4d2fd2d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.061+0000 7f4d2fd2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.061+0000 7f4d2fd2d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.061+0000 7f4d2fd2d800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.061+0000 7f4d2fd2d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 20 zone default found 2023-12-03T11:38:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 4 Realm: () 2023-12-03T11:38:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 20 zonegroup default 2023-12-03T11:38:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 20 started sync module instance, tier type = 2023-12-03T11:38:17.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.062+0000 7f4d2fd2d800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:17.070 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.069+0000 7f4d2b17d640 0 -- 172.21.15.131:0/445051948 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x557f5ee7ecf0 msgr2=0x557f5ee810e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.072+0000 7f4d2fd2d800 20 add_watcher() i=0 2023-12-03T11:38:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.072+0000 7f4d2fd2d800 20 add_watcher() i=1 2023-12-03T11:38:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.072+0000 7f4d2fd2d800 20 add_watcher() i=2 2023-12-03T11:38:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.072+0000 7f4d2fd2d800 20 add_watcher() i=3 2023-12-03T11:38:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.072+0000 7f4d2fd2d800 20 add_watcher() i=4 2023-12-03T11:38:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.072+0000 7f4d2fd2d800 20 add_watcher() i=5 2023-12-03T11:38:17.073 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.072+0000 7f4d2fd2d800 20 add_watcher() i=6 2023-12-03T11:38:17.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.073+0000 7f4d2fd2d800 20 add_watcher() i=7 2023-12-03T11:38:17.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.073+0000 7f4d2fd2d800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:17.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.075+0000 7f4cf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:17.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.075+0000 7f4d2fd2d800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:17.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.075+0000 7f4d2fd2d800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:17.119 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.118+0000 7f4c68ff9640 20 reqs_thread_entry: start 2023-12-03T11:38:17.120 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.118+0000 7f4d2fd2d800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:17.120 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.118+0000 7f4d2fd2d800 20 Filter name: none 2023-12-03T11:38:17.120 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.118+0000 7f4c5e7fc640 20 reqs_thread_entry: start 2023-12-03T11:38:17.120 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.118+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:38:17.121 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.120+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.121 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.120+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.122 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.121+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.123 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.122+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:38:17.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.123+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.124+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.124+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.125+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:38:17.128 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.127+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.128 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.127+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.128 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.127+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.129 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.128+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:38:17.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.130+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.131+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.131+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.132+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:38:17.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.133+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.134+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.134+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.136 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.135+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:38:17.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.136+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.137+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.137+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.139 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.138+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:38:17.141 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.139+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.141 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.140+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.141 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.140+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.141+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:38:17.143 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.142+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.143+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.143+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.145 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.144+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:38:17.146 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.145+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.146+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.147 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.146+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.147+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:38:17.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.148+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.149+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.149+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.151 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.150+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:38:17.153 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.151+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.153 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.152+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.153 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.152+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.155 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.153+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:38:17.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.155+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.156+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.156+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.157+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:38:17.159 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.158+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.159 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.158+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.159+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.160+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:38:17.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.161+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.161+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.161+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.162+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:38:17.165 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.164+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.166 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.164+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.166 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.165+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.166+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:38:17.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.167+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.168 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.167+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.169 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.168+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.170 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.169+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:38:17.171 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.170+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.172 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.171+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.172 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.171+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.173 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.172+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:38:17.175 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.174+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.176 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.175+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.176 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.175+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.177 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.176+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:38:17.178 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.177+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.178+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.179 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.178+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.180 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.179+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:38:17.181 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.180+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.181+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.182 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.181+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.183 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.182+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:38:17.184 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.183+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.184+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.185 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.184+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.185+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:38:17.187 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.186+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.187+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.187+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.188+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:38:17.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.189+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.190 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.189+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.191 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.190+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.191+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:38:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.192+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.192+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.193+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.194+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:38:17.196 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.195+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.196+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.196+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.197+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:38:17.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.198+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.199+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.199+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.200+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:38:17.203 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.202+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.203 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.202+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.202+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.204 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.203+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:38:17.206 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.205+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.206 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.205+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.205+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.207 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.206+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:38:17.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.208+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.208+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.208+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.209+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:38:17.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.210+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.211+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.213 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.211+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.214 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.213+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:38:17.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.214+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.214+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.215 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.214+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.216 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.215+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:38:17.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.216+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.217+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.217+0000 7f4d2fd2d800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.219+0000 7f4cf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:17.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.221+0000 7f4d2fd2d800 20 remove_watcher() i=0 2023-12-03T11:38:17.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.221+0000 7f4d2fd2d800 2 removed watcher, disabling cache 2023-12-03T11:38:17.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.222+0000 7f4d2fd2d800 20 remove_watcher() i=1 2023-12-03T11:38:17.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.223+0000 7f4d2fd2d800 20 remove_watcher() i=2 2023-12-03T11:38:17.225 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.224+0000 7f4d2fd2d800 20 remove_watcher() i=3 2023-12-03T11:38:17.226 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.225+0000 7f4d2fd2d800 20 remove_watcher() i=4 2023-12-03T11:38:17.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.225+0000 7f4d2fd2d800 20 remove_watcher() i=5 2023-12-03T11:38:17.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.226+0000 7f4d2fd2d800 20 remove_watcher() i=6 2023-12-03T11:38:17.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.227+0000 7f4d2fd2d800 20 remove_watcher() i=7 2023-12-03T11:38:17.234 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:38:17.282 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:17.282 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:17.297 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.296+0000 7f67ee72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.297+0000 7f67ee72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.297+0000 7f67ee72f800 20 realm 2023-12-03T11:38:17.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.297+0000 7f67ee72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.299 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.298+0000 7f67ee72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.298+0000 7f67ee72f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:17.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.298+0000 7f67ee72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.298+0000 7f67ee72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.300 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.298+0000 7f67ee72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.299+0000 7f67ee72f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:17.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.299+0000 7f67ee72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.299+0000 7f67ee72f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:17.301 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.299+0000 7f67ee72f800 20 searching for the correct realm 2023-12-03T11:38:17.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.308+0000 7f67ea3d7640 0 -- 172.21.15.131:0/2152058040 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x561820c30260 msgr2=0x561820c32650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:17.310 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.309+0000 7f67ee72f800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:17.310 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.309+0000 7f67ee72f800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:17.310 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.309+0000 7f67ee72f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:17.311 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.309+0000 7f67ee72f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:17.311 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.309+0000 7f67ee72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.311 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.309+0000 7f67ee72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.311 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.309+0000 7f67ee72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.309+0000 7f67ee72f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:17.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.309+0000 7f67ee72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.310+0000 7f67ee72f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:17.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.310+0000 7f67ee72f800 20 zone default found 2023-12-03T11:38:17.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.310+0000 7f67ee72f800 4 Realm: () 2023-12-03T11:38:17.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.310+0000 7f67ee72f800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:17.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.310+0000 7f67ee72f800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:17.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.310+0000 7f67ee72f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:17.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.310+0000 7f67ee72f800 20 zonegroup default 2023-12-03T11:38:17.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.310+0000 7f67ee72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.310+0000 7f67ee72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.310+0000 7f67ee72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.311+0000 7f67ee72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.311+0000 7f67ee72f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.311+0000 7f67ee72f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.311+0000 7f67ee72f800 20 started sync module instance, tier type = 2023-12-03T11:38:17.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.311+0000 7f67ee72f800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:17.318 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.317+0000 7f67e9bd6640 0 -- 172.21.15.131:0/2152058040 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x561820c35240 msgr2=0x561820c37630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:17.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.320+0000 7f67ee72f800 20 add_watcher() i=0 2023-12-03T11:38:17.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.320+0000 7f67ee72f800 20 add_watcher() i=1 2023-12-03T11:38:17.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.320+0000 7f67ee72f800 20 add_watcher() i=2 2023-12-03T11:38:17.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.320+0000 7f67ee72f800 20 add_watcher() i=3 2023-12-03T11:38:17.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.320+0000 7f67ee72f800 20 add_watcher() i=4 2023-12-03T11:38:17.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.320+0000 7f67ee72f800 20 add_watcher() i=5 2023-12-03T11:38:17.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.320+0000 7f67ee72f800 20 add_watcher() i=6 2023-12-03T11:38:17.322 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.321+0000 7f67ee72f800 20 add_watcher() i=7 2023-12-03T11:38:17.322 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.321+0000 7f67ee72f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:17.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.322+0000 7f67affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:17.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.322+0000 7f67ee72f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:17.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.322+0000 7f67ee72f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:17.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.362+0000 7f671effd640 20 reqs_thread_entry: start 2023-12-03T11:38:17.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.363+0000 7f67ee72f800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:17.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.363+0000 7f67ee72f800 20 Filter name: none 2023-12-03T11:38:17.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.363+0000 7f671cff9640 20 reqs_thread_entry: start 2023-12-03T11:38:17.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.363+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:38:17.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.364+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.365+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.365+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.367 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.366+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:38:17.369 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.368+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.369 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.368+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.369+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.370+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:38:17.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.371+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.371+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.371+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.372+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:38:17.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.374+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.374+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.376 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.374+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.376 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.375+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:38:17.378 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.377+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.379 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.378+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.379 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.378+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.380 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.379+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:38:17.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.380+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.381+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.381+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.382+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:38:17.384 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.383+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.385 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.384+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.385 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.384+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.385+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:38:17.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.386+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.386+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.386+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.387+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:38:17.390 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.389+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.390 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.389+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.390 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.389+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.391 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.390+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:38:17.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.392+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.392+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.392+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.395 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.393+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:38:17.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.395+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.395+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.397 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.396+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.398 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.397+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:38:17.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.398+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.398+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.400 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.399+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.401 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.400+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:38:17.402 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.401+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.402 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.401+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.403 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.402+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.404 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.402+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:38:17.405 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.404+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.405 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.404+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.405+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.407 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.406+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:38:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.407+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.407+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.407+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.409 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.408+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:38:17.411 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.410+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.411 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.410+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.411 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.410+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.412 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.411+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:38:17.414 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.412+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.414 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.413+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.414 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.413+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.416 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.414+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:38:17.417 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.416+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.418 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.417+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.418 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.417+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.419 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.418+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:38:17.420 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.419+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.420+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.421 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.420+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.422 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.421+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:38:17.423 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.422+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.423+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.424 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.423+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.424+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:38:17.427 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.426+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.427 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.426+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.428 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.426+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.428 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.427+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:38:17.430 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.429+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.430 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.429+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.431 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.430+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.432 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.431+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:38:17.433 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.432+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.433 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.432+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.434 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.432+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.434 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.433+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:38:17.436 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.435+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.436 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.435+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.437 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.436+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.438 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.437+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:38:17.439 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.438+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.439 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.438+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.440 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.439+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.440 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.439+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:38:17.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.441+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.441+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.441+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.444 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.442+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:38:17.445 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.444+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.445 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.444+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.446 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.444+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.446 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.445+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:38:17.448 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.447+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.448 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.447+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.448 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.447+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.449 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.448+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:38:17.451 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.450+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.451 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.450+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.452 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.451+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.453 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.452+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:38:17.454 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.453+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.455 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.454+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.455 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.454+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.456 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.455+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:38:17.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.456+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.458 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.457+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.458 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.457+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.459 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.458+0000 7f67ee72f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:38:17.460 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.459+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.461 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.460+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.461 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.460+0000 7f67ee72f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.463 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.462+0000 7f67affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:17.465 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.464+0000 7f67ee72f800 20 remove_watcher() i=0 2023-12-03T11:38:17.465 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.464+0000 7f67ee72f800 2 removed watcher, disabling cache 2023-12-03T11:38:17.467 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.466+0000 7f67ee72f800 20 remove_watcher() i=1 2023-12-03T11:38:17.468 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.467+0000 7f67ee72f800 20 remove_watcher() i=2 2023-12-03T11:38:17.469 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.468+0000 7f67ee72f800 20 remove_watcher() i=3 2023-12-03T11:38:17.470 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.469+0000 7f67ee72f800 20 remove_watcher() i=4 2023-12-03T11:38:17.471 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.470+0000 7f67ee72f800 20 remove_watcher() i=5 2023-12-03T11:38:17.472 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.471+0000 7f67ee72f800 20 remove_watcher() i=6 2023-12-03T11:38:17.473 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.472+0000 7f67ee72f800 20 remove_watcher() i=7 2023-12-03T11:38:17.478 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:38:17.528 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:17.528 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:17.542 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.541+0000 7f4dc613b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.544 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.543+0000 7f4dc613b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.547 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.543+0000 7f4dc613b800 20 realm 2023-12-03T11:38:17.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.543+0000 7f4dc613b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.543+0000 7f4dc613b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.543+0000 7f4dc613b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:17.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.543+0000 7f4dc613b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.543+0000 7f4dc613b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.543+0000 7f4dc613b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.544+0000 7f4dc613b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:17.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.544+0000 7f4dc613b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.544+0000 7f4dc613b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:17.548 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.544+0000 7f4dc613b800 20 searching for the correct realm 2023-12-03T11:38:17.554 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.553+0000 7f4dc1e40640 0 -- 172.21.15.131:0/2283705982 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7f4dac05f520 msgr2=0x7f4dac055dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:17.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.555+0000 7f4dc613b800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:17.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.555+0000 7f4dc613b800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:17.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.555+0000 7f4dc613b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:17.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.555+0000 7f4dc613b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:17.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.555+0000 7f4dc613b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.555+0000 7f4dc613b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.555+0000 7f4dc613b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.555+0000 7f4dc613b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:17.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.555+0000 7f4dc613b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 20 zone default found 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 4 Realm: () 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 20 zonegroup default 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.556+0000 7f4dc613b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.559 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.557+0000 7f4dc613b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.560 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.557+0000 7f4dc613b800 20 started sync module instance, tier type = 2023-12-03T11:38:17.560 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.557+0000 7f4dc613b800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:17.562 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.561+0000 7f4dc1e40640 0 -- 172.21.15.131:0/2283705982 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f4dbc057070 msgr2=0x7f4dbc075410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:17.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.565+0000 7f4dc613b800 20 add_watcher() i=0 2023-12-03T11:38:17.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.565+0000 7f4dc613b800 20 add_watcher() i=1 2023-12-03T11:38:17.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.565+0000 7f4dc613b800 20 add_watcher() i=2 2023-12-03T11:38:17.567 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.565+0000 7f4dc613b800 20 add_watcher() i=3 2023-12-03T11:38:17.567 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.565+0000 7f4dc613b800 20 add_watcher() i=4 2023-12-03T11:38:17.567 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.565+0000 7f4dc613b800 20 add_watcher() i=5 2023-12-03T11:38:17.567 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.565+0000 7f4dc613b800 20 add_watcher() i=6 2023-12-03T11:38:17.567 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.566+0000 7f4dc613b800 20 add_watcher() i=7 2023-12-03T11:38:17.567 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.566+0000 7f4dc613b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:17.569 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.568+0000 7f4d877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:17.569 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.568+0000 7f4dc613b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:17.569 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.568+0000 7f4dc613b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:17.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.609+0000 7f4cf67fc640 20 reqs_thread_entry: start 2023-12-03T11:38:17.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.609+0000 7f4dc613b800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:17.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.609+0000 7f4dc613b800 20 Filter name: none 2023-12-03T11:38:17.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.609+0000 7f4ce7fff640 20 reqs_thread_entry: start 2023-12-03T11:38:17.611 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.609+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:38:17.612 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.611+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.612 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.611+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.613 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.611+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.614 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.613+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:38:17.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.614+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.615 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.614+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.614+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.616 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.615+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:38:17.618 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.617+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.618 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.617+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.618 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.617+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.619 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.618+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:38:17.621 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.619+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.621 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.620+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.621 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.620+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.622 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.621+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:38:17.623 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.622+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.624 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.622+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.624 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.623+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.625 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.623+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:38:17.626 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.625+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.626 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.625+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.626 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.625+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.627 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.626+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:38:17.629 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.628+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.629 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.628+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.629 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.628+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.630 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.629+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:38:17.632 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.630+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.632 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.631+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.632 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.631+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.632+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:38:17.635 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.633+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.635 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.634+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.635 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.634+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.636 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.635+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:38:17.637 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.636+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.638 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.637+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.638 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.637+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.639 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.638+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:38:17.640 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.639+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.641 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.640+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.641 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.640+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.641+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:38:17.643 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.642+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.644 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.643+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.644 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.643+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.645 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.644+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:38:17.646 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.645+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.647 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.645+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.647 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.646+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.647 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.646+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:38:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.648+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.648+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.648+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.650 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.649+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:38:17.652 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.650+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.652 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.651+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.652 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.651+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.653 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.652+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:38:17.655 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.653+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.655 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.654+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.655 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.654+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.656 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.655+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:38:17.658 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.657+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.658 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.657+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.658 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.657+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.659 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.658+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:38:17.661 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.660+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.662 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.660+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.662 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.660+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.662 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.661+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:38:17.664 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.663+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.664 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.663+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.664 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.663+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.665 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.664+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:38:17.667 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.666+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.667 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.666+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.667 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.666+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.668 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.667+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:38:17.670 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.668+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.670 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.669+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.670 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.669+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.671 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.670+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:38:17.673 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.672+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.674 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.672+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.674 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.673+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.675 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.674+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:38:17.676 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.675+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.677 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.675+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.677 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.675+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.677 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.676+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:38:17.679 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.677+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.679 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.678+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.679 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.678+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.680 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.679+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:38:17.681 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.680+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.682 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.681+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.682 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.681+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.683 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.682+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:38:17.684 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.683+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.685 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.684+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.685 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.684+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.686 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.685+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:38:17.687 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.686+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.688 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.687+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.688 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.687+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.689 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.688+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:38:17.690 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.689+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.690 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.689+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.691 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.690+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.692 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.690+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:38:17.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.692+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.693+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.695 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.693+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.695 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.694+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:38:17.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.695+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.696+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.696+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.698 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.697+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:38:17.699 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.698+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.699 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.698+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.700 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.699+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.701 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.700+0000 7f4dc613b800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:38:17.702 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.701+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.701+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.703 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.701+0000 7f4dc613b800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.704 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.703+0000 7f4d877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:17.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.705+0000 7f4dc613b800 20 remove_watcher() i=0 2023-12-03T11:38:17.707 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.705+0000 7f4dc613b800 2 removed watcher, disabling cache 2023-12-03T11:38:17.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.707+0000 7f4dc613b800 20 remove_watcher() i=1 2023-12-03T11:38:17.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.708+0000 7f4dc613b800 20 remove_watcher() i=2 2023-12-03T11:38:17.710 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.709+0000 7f4dc613b800 20 remove_watcher() i=3 2023-12-03T11:38:17.710 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.709+0000 7f4dc613b800 20 remove_watcher() i=4 2023-12-03T11:38:17.711 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.710+0000 7f4dc613b800 20 remove_watcher() i=5 2023-12-03T11:38:17.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.712+0000 7f4dc613b800 20 remove_watcher() i=6 2023-12-03T11:38:17.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.713+0000 7f4dc613b800 20 remove_watcher() i=7 2023-12-03T11:38:17.719 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:38:17.768 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:17.768 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:17.781 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.780+0000 7f533d612800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.784 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.782+0000 7f533d612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.784 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.782+0000 7f533d612800 20 realm 2023-12-03T11:38:17.784 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.782+0000 7f533d612800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.784 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.782+0000 7f533d612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.784 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.782+0000 7f533d612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:17.784 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.782+0000 7f533d612800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.784 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.782+0000 7f533d612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.784 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.782+0000 7f533d612800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.785 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.783+0000 7f533d612800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:17.785 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.783+0000 7f533d612800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.785 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.783+0000 7f533d612800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:17.785 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.783+0000 7f533d612800 20 searching for the correct realm 2023-12-03T11:38:17.793 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.792+0000 7f5338d2a640 0 -- 172.21.15.131:0/62798497 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55fcd37db620 msgr2=0x55fcd37dda10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:17.795 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.793+0000 7f533d612800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:17.795 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.793+0000 7f533d612800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:17.795 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.793+0000 7f533d612800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:17.795 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.793+0000 7f533d612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:17.795 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.793+0000 7f533d612800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.795 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.795 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.796 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:17.796 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:17.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 20 zone default found 2023-12-03T11:38:17.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 4 Realm: () 2023-12-03T11:38:17.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:17.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:17.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:17.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 20 zonegroup default 2023-12-03T11:38:17.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.794+0000 7f533d612800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.797 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.795+0000 7f533d612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.798 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.795+0000 7f533d612800 20 rados->read ofs=0 len=0 2023-12-03T11:38:17.798 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.795+0000 7f533d612800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:17.798 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.795+0000 7f533d612800 20 started sync module instance, tier type = 2023-12-03T11:38:17.798 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.795+0000 7f533d612800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:17.802 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.801+0000 7f5333fff640 0 -- 172.21.15.131:0/62798497 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55fcd37e05b0 msgr2=0x55fcd37e29a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.804+0000 7f533d612800 20 add_watcher() i=0 2023-12-03T11:38:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.804+0000 7f533d612800 20 add_watcher() i=1 2023-12-03T11:38:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.804+0000 7f533d612800 20 add_watcher() i=2 2023-12-03T11:38:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.804+0000 7f533d612800 20 add_watcher() i=3 2023-12-03T11:38:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.804+0000 7f533d612800 20 add_watcher() i=4 2023-12-03T11:38:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.804+0000 7f533d612800 20 add_watcher() i=5 2023-12-03T11:38:17.806 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.804+0000 7f533d612800 20 add_watcher() i=6 2023-12-03T11:38:17.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.805+0000 7f533d612800 20 add_watcher() i=7 2023-12-03T11:38:17.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.805+0000 7f533d612800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.807+0000 7f52fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.807+0000 7f533d612800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:17.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.807+0000 7f533d612800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:17.850 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.848+0000 7f526d7fa640 20 reqs_thread_entry: start 2023-12-03T11:38:17.850 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.848+0000 7f533d612800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:17.850 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.848+0000 7f533d612800 20 Filter name: none 2023-12-03T11:38:17.850 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.849+0000 7f5266ffd640 20 reqs_thread_entry: start 2023-12-03T11:38:17.850 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.849+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:38:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.850+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.851 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.850+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.852 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.850+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.852 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.851+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:38:17.854 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.853+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.854 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.853+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.855 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.853+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.856 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.854+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:38:17.857 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.856+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.857 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.856+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.857 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.856+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.858 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.857+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:38:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.859+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.859+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.859+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.862 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.860+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:38:17.863 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.862+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.863 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.862+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.863 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.862+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.865 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.863+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:38:17.866 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.865+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.866 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.865+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.866 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.865+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.867 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.866+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:38:17.868 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.867+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.869 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.868+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.869 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.868+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.870 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.869+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:38:17.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.870+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.872 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.871+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.872 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.871+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.872+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:38:17.874 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.873+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.874+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.874+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.876 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.875+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:38:17.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.876+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.877 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.876+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.878 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.877+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.879 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.878+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:38:17.880 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.879+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.880 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.879+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.881 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.879+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.881 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.880+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:38:17.883 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.882+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.883 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.882+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.883 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.882+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.884 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.883+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:38:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.885+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.885+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.886 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.885+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.887 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.886+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:38:17.889 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.888+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.889 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.888+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.890 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.888+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.891 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.890+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:38:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.891+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.892 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.891+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.893 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.891+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.894 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.892+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:38:17.895 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.894+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.896 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.894+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.896 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.895+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.897 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.896+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:38:17.899 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.898+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.899 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.898+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.900 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.898+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.901 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.900+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:38:17.902 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.901+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.903 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.901+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.903 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.902+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.904 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.903+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:38:17.905 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.904+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.906 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.904+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.906 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.905+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.907 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.906+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:38:17.908 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.907+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.909 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.908+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.909 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.908+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.910 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.909+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:38:17.912 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.910+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.912 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.911+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.912 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.911+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.913 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.912+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:38:17.914 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.913+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.915 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.914+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.915 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.914+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.916 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.915+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:38:17.917 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.916+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.917+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.917+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.918+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:38:17.920 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.919+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.921 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.920+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.921 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.920+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.922 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.921+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:38:17.923 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.922+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.924 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.923+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.924 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.923+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.925 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.924+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:38:17.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.925+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.926+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.926+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.928 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.927+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:38:17.929 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.928+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.930 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.929+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.930 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.929+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.931 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.930+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:38:17.932 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.931+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.931+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.932+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.933+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:38:17.935 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.934+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.934+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.935+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.936+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:38:17.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.937+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.937+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.937+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.939 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.938+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:38:17.941 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.939+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.941 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.940+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.941 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.940+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.943 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.942+0000 7f533d612800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:38:17.944 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.943+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.943+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:17.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.944+0000 7f533d612800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:17.946 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.945+0000 7f52fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:17.948 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.947+0000 7f533d612800 20 remove_watcher() i=0 2023-12-03T11:38:17.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.947+0000 7f533d612800 2 removed watcher, disabling cache 2023-12-03T11:38:17.950 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.949+0000 7f533d612800 20 remove_watcher() i=1 2023-12-03T11:38:17.951 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.949+0000 7f533d612800 20 remove_watcher() i=2 2023-12-03T11:38:17.952 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.950+0000 7f533d612800 20 remove_watcher() i=3 2023-12-03T11:38:17.952 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.951+0000 7f533d612800 20 remove_watcher() i=4 2023-12-03T11:38:17.953 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.952+0000 7f533d612800 20 remove_watcher() i=5 2023-12-03T11:38:17.954 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.953+0000 7f533d612800 20 remove_watcher() i=6 2023-12-03T11:38:17.955 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:17.954+0000 7f533d612800 20 remove_watcher() i=7 2023-12-03T11:38:17.961 DEBUG:teuthology.orchestra.run.smithi131:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2023-12-03T11:38:18.426 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :clean 2023-12-03T11:38:19.023 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :compileJava 2023-12-03T11:38:19.024 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :processResources 2023-12-03T11:38:19.024 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :classes 2023-12-03T11:38:19.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:19.723 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :compileTestJava 2023-12-03T11:38:19.724 INFO:teuthology.orchestra.run.smithi131.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2023-12-03T11:38:19.724 INFO:teuthology.orchestra.run.smithi131.stderr:Note: Recompile with -Xlint:deprecation for details. 2023-12-03T11:38:19.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:19.725 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :processTestResources NO-SOURCE 2023-12-03T11:38:19.725 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :testClasses 2023-12-03T11:38:21.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:21.725 INFO:teuthology.orchestra.run.smithi131.stdout:> Task :test 2023-12-03T11:38:21.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:21.725 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2023-12-03T11:38:21.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:21.725 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2023-12-03T11:38:21.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:21.726 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2023-12-03T11:38:21.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:21.726 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2023-12-03T11:38:21.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:21.726 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2023-12-03T11:38:21.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:21.825 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2023-12-03T11:38:22.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:22.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2023-12-03T11:38:22.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:22.323 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2023-12-03T11:38:22.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:22.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2023-12-03T11:38:22.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:22.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2023-12-03T11:38:22.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:22.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2023-12-03T11:38:22.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:22.824 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2023-12-03T11:38:23.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:23.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2023-12-03T11:38:23.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:23.024 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2023-12-03T11:38:23.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:23.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2023-12-03T11:38:23.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:23.124 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2023-12-03T11:38:23.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:23.323 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2023-12-03T11:38:23.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:23.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2023-12-03T11:38:23.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:23.723 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2023-12-03T11:38:23.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:23.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2023-12-03T11:38:23.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:23.923 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2023-12-03T11:38:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:24.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2023-12-03T11:38:24.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:24.224 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2023-12-03T11:38:24.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:24.224 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2023-12-03T11:38:24.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:24.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2023-12-03T11:38:24.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:24.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2023-12-03T11:38:24.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:24.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2023-12-03T11:38:24.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:24.723 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2023-12-03T11:38:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:24.923 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2023-12-03T11:38:24.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:24.924 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2023-12-03T11:38:25.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:25.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2023-12-03T11:38:25.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:25.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2023-12-03T11:38:25.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:25.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2023-12-03T11:38:25.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:25.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2023-12-03T11:38:26.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:26.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2023-12-03T11:38:29.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:29.723 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2023-12-03T11:38:30.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:30.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2023-12-03T11:38:30.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:30.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2023-12-03T11:38:30.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:30.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2023-12-03T11:38:30.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:30.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2023-12-03T11:38:30.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:30.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2023-12-03T11:38:30.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:30.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2023-12-03T11:38:31.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:31.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2023-12-03T11:38:31.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:31.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2023-12-03T11:38:31.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:31.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2023-12-03T11:38:31.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:31.824 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2023-12-03T11:38:32.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:32.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2023-12-03T11:38:32.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:32.323 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2023-12-03T11:38:32.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:32.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2023-12-03T11:38:32.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:32.923 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2023-12-03T11:38:33.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:33.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2023-12-03T11:38:35.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:35.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2023-12-03T11:38:35.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:35.723 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2023-12-03T11:38:36.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:36.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2023-12-03T11:38:36.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:36.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2023-12-03T11:38:37.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:37.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2023-12-03T11:38:37.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:37.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2023-12-03T11:38:37.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:37.825 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2023-12-03T11:38:38.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:38.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2023-12-03T11:38:38.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:38.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2023-12-03T11:38:38.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:38.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2023-12-03T11:38:38.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:38.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2023-12-03T11:38:38.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:38.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2023-12-03T11:38:38.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:38.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2023-12-03T11:38:38.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:38.723 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2023-12-03T11:38:38.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:38.724 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2023-12-03T11:38:38.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:38.923 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2023-12-03T11:38:39.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:39.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2023-12-03T11:38:39.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:39.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2023-12-03T11:38:39.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:39.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2023-12-03T11:38:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:39.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2023-12-03T11:38:39.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:39.424 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2023-12-03T11:38:39.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:39.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2023-12-03T11:38:39.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:39.624 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2023-12-03T11:38:39.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:39.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2023-12-03T11:38:39.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:39.923 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2023-12-03T11:38:40.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:40.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2023-12-03T11:38:40.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:40.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2023-12-03T11:38:40.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:40.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2023-12-03T11:38:40.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:40.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2023-12-03T11:38:40.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:40.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2023-12-03T11:38:40.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:40.723 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2023-12-03T11:38:40.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:40.923 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2023-12-03T11:38:41.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:41.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2023-12-03T11:38:41.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:41.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2023-12-03T11:38:41.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:41.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2023-12-03T11:38:41.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:41.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2023-12-03T11:38:41.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:41.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2023-12-03T11:38:41.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:41.723 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2023-12-03T11:38:41.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:41.724 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2023-12-03T11:38:42.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:42.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2023-12-03T11:38:42.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:42.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2023-12-03T11:38:42.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:42.223 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2023-12-03T11:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:42.323 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2023-12-03T11:38:42.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2023-12-03T11:38:42.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2023-12-03T11:38:42.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:42.723 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2023-12-03T11:38:42.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:42.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2023-12-03T11:38:43.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:43.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2023-12-03T11:38:43.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:43.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2023-12-03T11:38:43.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:43.323 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2023-12-03T11:38:43.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:43.324 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2023-12-03T11:38:43.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:43.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2023-12-03T11:38:43.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:43.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2023-12-03T11:38:43.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:43.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2023-12-03T11:38:43.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:43.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2023-12-03T11:38:44.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:44.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2023-12-03T11:38:44.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:44.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2023-12-03T11:38:44.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:44.323 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2023-12-03T11:38:44.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:44.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2023-12-03T11:38:44.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:44.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2023-12-03T11:38:44.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:44.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2023-12-03T11:38:44.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:44.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2023-12-03T11:38:44.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:44.923 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2023-12-03T11:38:45.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:45.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2023-12-03T11:38:45.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:45.124 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2023-12-03T11:38:45.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:45.323 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2023-12-03T11:38:45.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:45.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2023-12-03T11:38:45.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:45.625 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2023-12-03T11:38:45.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:45.626 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2023-12-03T11:38:45.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:45.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2023-12-03T11:38:45.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:45.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2023-12-03T11:38:45.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:45.923 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2023-12-03T11:38:46.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:46.023 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2023-12-03T11:38:46.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:46.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2023-12-03T11:38:46.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:46.323 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2023-12-03T11:38:46.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:46.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2023-12-03T11:38:46.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:46.523 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2023-12-03T11:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2023-12-03T11:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:46.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2023-12-03T11:38:46.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:46.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2023-12-03T11:38:46.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:46.923 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2023-12-03T11:38:47.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:47.323 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2023-12-03T11:38:47.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:47.423 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2023-12-03T11:38:47.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:47.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2023-12-03T11:38:47.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:47.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2023-12-03T11:38:47.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:47.823 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2023-12-03T11:38:48.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:48.123 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2023-12-03T11:38:48.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:48.323 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2023-12-03T11:38:48.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:48.623 INFO:teuthology.orchestra.run.smithi131.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2023-12-03T11:38:48.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:48.792 INFO:teuthology.orchestra.run.smithi131.stdout:---------------------------------------------------------------------- 2023-12-03T11:38:48.792 INFO:teuthology.orchestra.run.smithi131.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2023-12-03T11:38:48.792 INFO:teuthology.orchestra.run.smithi131.stdout:---------------------------------------------------------------------- 2023-12-03T11:38:48.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:48.792 INFO:teuthology.orchestra.run.smithi131.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2023-12-03T11:38:48.792 INFO:teuthology.orchestra.run.smithi131.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2023-12-03T11:38:48.792 INFO:teuthology.orchestra.run.smithi131.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2023-12-03T11:38:48.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:48.793 INFO:teuthology.orchestra.run.smithi131.stdout:BUILD SUCCESSFUL in 30s 2023-12-03T11:38:48.793 INFO:teuthology.orchestra.run.smithi131.stdout:5 actionable tasks: 5 executed 2023-12-03T11:38:48.796 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:38:48.845 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:48.845 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:48.859 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.857+0000 7f8502811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:48.861 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.859+0000 7f8502811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:48.861 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.859+0000 7f8502811800 20 realm 2023-12-03T11:38:48.861 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.859+0000 7f8502811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:48.862 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.859+0000 7f8502811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:48.862 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.859+0000 7f8502811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:48.862 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.859+0000 7f8502811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:48.862 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.859+0000 7f8502811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:48.862 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.859+0000 7f8502811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:48.863 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.860+0000 7f8502811800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:48.863 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.860+0000 7f8502811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:48.864 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.860+0000 7f8502811800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:48.864 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.860+0000 7f8502811800 20 searching for the correct realm 2023-12-03T11:38:48.871 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.869+0000 7f8500311640 0 -- 172.21.15.131:0/3444575242 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5625a50ae130 msgr2=0x5625a50b0520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:48.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.871+0000 7f8502811800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:48.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.871+0000 7f8502811800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:48.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.871+0000 7f8502811800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:48.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.871+0000 7f8502811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:48.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.871+0000 7f8502811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:48.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.871+0000 7f8502811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:48.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.871+0000 7f8502811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:48.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.871+0000 7f8502811800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:48.873 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.871+0000 7f8502811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:48.874 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.872+0000 7f8502811800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:48.874 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.872+0000 7f8502811800 20 zone default found 2023-12-03T11:38:48.874 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.872+0000 7f8502811800 4 Realm: () 2023-12-03T11:38:48.874 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.872+0000 7f8502811800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:48.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.872+0000 7f8502811800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:48.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.872+0000 7f8502811800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:48.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.872+0000 7f8502811800 20 zonegroup default 2023-12-03T11:38:48.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.872+0000 7f8502811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:48.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.872+0000 7f8502811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:48.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.872+0000 7f8502811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:48.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.873+0000 7f8502811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:48.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.873+0000 7f8502811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:48.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.873+0000 7f8502811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:48.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.873+0000 7f8502811800 20 started sync module instance, tier type = 2023-12-03T11:38:48.875 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.873+0000 7f8502811800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:48.879 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.878+0000 7f8500b12640 0 -- 172.21.15.131:0/3444575242 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f84f4058050 msgr2=0x7f84f4028970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:48.882 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.881+0000 7f8502811800 20 add_watcher() i=0 2023-12-03T11:38:48.882 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.881+0000 7f8502811800 20 add_watcher() i=1 2023-12-03T11:38:48.882 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.881+0000 7f8502811800 20 add_watcher() i=2 2023-12-03T11:38:48.883 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.881+0000 7f8502811800 20 add_watcher() i=3 2023-12-03T11:38:48.883 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.881+0000 7f8502811800 20 add_watcher() i=4 2023-12-03T11:38:48.883 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.881+0000 7f8502811800 20 add_watcher() i=5 2023-12-03T11:38:48.883 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.881+0000 7f8502811800 20 add_watcher() i=6 2023-12-03T11:38:48.883 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.882+0000 7f8502811800 20 add_watcher() i=7 2023-12-03T11:38:48.883 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.882+0000 7f8502811800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:48.885 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.883+0000 7f84c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:48.885 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.884+0000 7f8502811800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:48.885 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.884+0000 7f8502811800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:48.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.924+0000 7f84357fa640 20 reqs_thread_entry: start 2023-12-03T11:38:48.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.925+0000 7f8502811800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:48.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.925+0000 7f8502811800 20 Filter name: none 2023-12-03T11:38:48.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.925+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:38:48.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.925+0000 7f842effd640 20 reqs_thread_entry: start 2023-12-03T11:38:48.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.926+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.928 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.927+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:48.928 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.927+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.929 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.928+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:38:48.931 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.930+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.931 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.930+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:48.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:48.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27', time=2023-12-03T13:38:37.997385+0000, chain.objs.size()=115 2023-12-03T11:38:48.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.1 2023-12-03T11:38:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.2 2023-12-03T11:38:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.3 2023-12-03T11:38:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.4 2023-12-03T11:38:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.5 2023-12-03T11:38:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.6 2023-12-03T11:38:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.7 2023-12-03T11:38:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.8 2023-12-03T11:38:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.9 2023-12-03T11:38:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.10 2023-12-03T11:38:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.11 2023-12-03T11:38:48.934 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.931+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.12 2023-12-03T11:38:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.934+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.13 2023-12-03T11:38:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.934+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.14 2023-12-03T11:38:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.934+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.15 2023-12-03T11:38:48.935 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.934+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.16 2023-12-03T11:38:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.934+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.17 2023-12-03T11:38:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.934+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.18 2023-12-03T11:38:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.934+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.19 2023-12-03T11:38:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.935+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.20 2023-12-03T11:38:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.935+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.21 2023-12-03T11:38:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.935+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.22 2023-12-03T11:38:48.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.935+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.23 2023-12-03T11:38:48.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.936+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.24 2023-12-03T11:38:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.936+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.25 2023-12-03T11:38:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.936+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.26 2023-12-03T11:38:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.936+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.27 2023-12-03T11:38:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.936+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.28 2023-12-03T11:38:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.936+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.29 2023-12-03T11:38:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.936+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.30 2023-12-03T11:38:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.936+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.31 2023-12-03T11:38:48.938 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.936+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.32 2023-12-03T11:38:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.937+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.33 2023-12-03T11:38:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.937+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.34 2023-12-03T11:38:48.939 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.938+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.35 2023-12-03T11:38:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.938+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.36 2023-12-03T11:38:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.938+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.37 2023-12-03T11:38:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.938+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.38 2023-12-03T11:38:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.938+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.39 2023-12-03T11:38:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.938+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.40 2023-12-03T11:38:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.938+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.41 2023-12-03T11:38:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.938+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.42 2023-12-03T11:38:48.940 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.938+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.43 2023-12-03T11:38:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.940+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.44 2023-12-03T11:38:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.940+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.45 2023-12-03T11:38:48.941 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.940+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.46 2023-12-03T11:38:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.940+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.47 2023-12-03T11:38:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.940+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.48 2023-12-03T11:38:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.940+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.49 2023-12-03T11:38:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.940+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.50 2023-12-03T11:38:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.940+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.51 2023-12-03T11:38:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.940+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.52 2023-12-03T11:38:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.940+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.53 2023-12-03T11:38:48.942 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.941+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.54 2023-12-03T11:38:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.941+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.55 2023-12-03T11:38:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.942+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.56 2023-12-03T11:38:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.942+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.57 2023-12-03T11:38:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.942+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.58 2023-12-03T11:38:48.943 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.942+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.59 2023-12-03T11:38:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.942+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.60 2023-12-03T11:38:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.942+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.61 2023-12-03T11:38:48.944 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.942+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.62 2023-12-03T11:38:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.943+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.63 2023-12-03T11:38:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.943+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.64 2023-12-03T11:38:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.943+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.65 2023-12-03T11:38:48.945 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.943+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.66 2023-12-03T11:38:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.944+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.67 2023-12-03T11:38:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.944+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.68 2023-12-03T11:38:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.944+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.69 2023-12-03T11:38:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.944+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.70 2023-12-03T11:38:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.944+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.71 2023-12-03T11:38:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.944+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.72 2023-12-03T11:38:48.946 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.944+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.73 2023-12-03T11:38:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.945+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.74 2023-12-03T11:38:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.945+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.75 2023-12-03T11:38:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.945+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.76 2023-12-03T11:38:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.945+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.77 2023-12-03T11:38:48.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.946+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.78 2023-12-03T11:38:48.948 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.947+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.79 2023-12-03T11:38:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.947+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.80 2023-12-03T11:38:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.947+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.81 2023-12-03T11:38:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.947+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.82 2023-12-03T11:38:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.947+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.83 2023-12-03T11:38:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.947+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.84 2023-12-03T11:38:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.947+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.85 2023-12-03T11:38:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.947+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.86 2023-12-03T11:38:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.947+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.87 2023-12-03T11:38:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.947+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.88 2023-12-03T11:38:48.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.947+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.89 2023-12-03T11:38:48.950 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.949+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.90 2023-12-03T11:38:48.950 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.949+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.91 2023-12-03T11:38:48.950 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.949+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.92 2023-12-03T11:38:48.951 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.949+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.93 2023-12-03T11:38:48.951 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.949+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.94 2023-12-03T11:38:48.951 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.949+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.95 2023-12-03T11:38:48.951 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.949+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.96 2023-12-03T11:38:48.951 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.949+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.97 2023-12-03T11:38:48.951 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.949+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.98 2023-12-03T11:38:48.951 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.949+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.99 2023-12-03T11:38:48.951 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.949+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.100 2023-12-03T11:38:48.952 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.950+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.101 2023-12-03T11:38:48.952 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.950+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.102 2023-12-03T11:38:48.952 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.951+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.103 2023-12-03T11:38:48.952 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.951+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.104 2023-12-03T11:38:48.952 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.951+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.105 2023-12-03T11:38:48.953 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.951+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.106 2023-12-03T11:38:48.953 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.952+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.107 2023-12-03T11:38:48.954 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.952+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.108 2023-12-03T11:38:48.954 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.952+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.109 2023-12-03T11:38:48.954 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.952+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.110 2023-12-03T11:38:48.954 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.952+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.111 2023-12-03T11:38:48.954 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.952+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.112 2023-12-03T11:38:48.954 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.952+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.113 2023-12-03T11:38:48.954 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.953+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.114 2023-12-03T11:38:48.954 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.953+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.93__multipart_key1.2~rxeLt9ddsaXElbDyBX2i1nl-aYluK27.115 2023-12-03T11:38:48.956 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.954+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:48.958 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.956+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:38:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.958+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.958+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:48.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.958+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.961 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.959+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:38:48.962 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.960+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:48.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:48.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.7625273490206953546', time=2023-12-03T13:38:27.345264+0000, chain.objs.size()=9 2023-12-03T11:38:48.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~fvLbkFVK0JJ4V88TzHrxin8Dcn0yLyn.1 2023-12-03T11:38:48.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~fvLbkFVK0JJ4V88TzHrxin8Dcn0yLyn.1_1 2023-12-03T11:38:48.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~fvLbkFVK0JJ4V88TzHrxin8Dcn0yLyn.2 2023-12-03T11:38:48.963 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~fvLbkFVK0JJ4V88TzHrxin8Dcn0yLyn.2_1 2023-12-03T11:38:48.964 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~fvLbkFVK0JJ4V88TzHrxin8Dcn0yLyn.3 2023-12-03T11:38:48.964 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~fvLbkFVK0JJ4V88TzHrxin8Dcn0yLyn.3_1 2023-12-03T11:38:48.964 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~fvLbkFVK0JJ4V88TzHrxin8Dcn0yLyn.4 2023-12-03T11:38:48.964 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~fvLbkFVK0JJ4V88TzHrxin8Dcn0yLyn.4_1 2023-12-03T11:38:48.964 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.961+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~fvLbkFVK0JJ4V88TzHrxin8Dcn0yLyn.5 2023-12-03T11:38:48.968 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.966+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:48.970 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.969+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:38:48.971 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.970+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.972 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.971+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:48.972 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.971+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.973 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.972+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:38:48.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.973+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:48.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:48.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.12333920086108504600', time=2023-12-03T13:38:33.735927+0000, chain.objs.size()=9 2023-12-03T11:38:48.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~atSGpdrDfiUR6pekhkgmJs_L4x5tH-D.1 2023-12-03T11:38:48.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~atSGpdrDfiUR6pekhkgmJs_L4x5tH-D.1_1 2023-12-03T11:38:48.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~atSGpdrDfiUR6pekhkgmJs_L4x5tH-D.2 2023-12-03T11:38:48.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~atSGpdrDfiUR6pekhkgmJs_L4x5tH-D.2_1 2023-12-03T11:38:48.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~atSGpdrDfiUR6pekhkgmJs_L4x5tH-D.3 2023-12-03T11:38:48.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~atSGpdrDfiUR6pekhkgmJs_L4x5tH-D.3_1 2023-12-03T11:38:48.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~atSGpdrDfiUR6pekhkgmJs_L4x5tH-D.4 2023-12-03T11:38:48.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~atSGpdrDfiUR6pekhkgmJs_L4x5tH-D.4_1 2023-12-03T11:38:48.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.974+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~atSGpdrDfiUR6pekhkgmJs_L4x5tH-D.5 2023-12-03T11:38:48.979 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.978+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:48.981 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.980+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:38:48.982 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.981+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.982 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.981+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:48.983 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.982+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:48.983 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.982+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5844615773270774584', time=2023-12-03T13:38:35.408720+0000, chain.objs.size()=7 2023-12-03T11:38:48.983 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.982+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~5Q8f0lZCgKpJaZeSLs2EgmxN3CIOFX3.1 2023-12-03T11:38:48.983 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.982+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~5Q8f0lZCgKpJaZeSLs2EgmxN3CIOFX3.1_1 2023-12-03T11:38:48.984 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.982+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~5Q8f0lZCgKpJaZeSLs2EgmxN3CIOFX3.1_2 2023-12-03T11:38:48.984 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.982+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~5Q8f0lZCgKpJaZeSLs2EgmxN3CIOFX3.2 2023-12-03T11:38:48.984 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.982+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~5Q8f0lZCgKpJaZeSLs2EgmxN3CIOFX3.2_1 2023-12-03T11:38:48.984 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.982+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~5Q8f0lZCgKpJaZeSLs2EgmxN3CIOFX3.2_2 2023-12-03T11:38:48.984 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.982+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~5Q8f0lZCgKpJaZeSLs2EgmxN3CIOFX3.3 2023-12-03T11:38:48.988 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.987+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:48.990 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.989+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:38:48.991 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.990+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.992 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.991+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:48.992 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.991+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.993 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.992+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:38:48.994 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.993+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.994 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.993+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:48.995 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.994+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.996 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.994+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:38:48.997 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.996+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.997 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.996+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:48.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.996+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:48.999 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.997+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:38:49.000 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.999+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.000 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.999+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.001 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.999+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:49.001 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.999+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.1836969667093247768', time=2023-12-03T13:38:35.545864+0000, chain.objs.size()=7 2023-12-03T11:38:49.001 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.999+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~xatwiFe3uyHGT-axyTy67AOg_OZ1cFd.1 2023-12-03T11:38:49.001 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.999+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~xatwiFe3uyHGT-axyTy67AOg_OZ1cFd.1_1 2023-12-03T11:38:49.001 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.999+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~xatwiFe3uyHGT-axyTy67AOg_OZ1cFd.1_2 2023-12-03T11:38:49.001 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.999+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~xatwiFe3uyHGT-axyTy67AOg_OZ1cFd.2 2023-12-03T11:38:49.001 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.999+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~xatwiFe3uyHGT-axyTy67AOg_OZ1cFd.2_1 2023-12-03T11:38:49.001 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:48.999+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~xatwiFe3uyHGT-axyTy67AOg_OZ1cFd.2_2 2023-12-03T11:38:49.001 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.000+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~xatwiFe3uyHGT-axyTy67AOg_OZ1cFd.3 2023-12-03T11:38:49.004 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.002+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.005 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.004+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:38:49.007 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.005+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.007 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__shadow_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.1_1_30af0ae5377faf951d2958e0da9d4bbc', time=2023-12-03T13:38:25.917207+0000, chain.objs.size()=9 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__multipart_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.1 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__shadow_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.1_1 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__multipart_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.2 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__shadow_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.2_1 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__multipart_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.3 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__shadow_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.3_1 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__multipart_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.4 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__shadow_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.4_1 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__multipart_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.5 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.4377647671656889124', time=2023-12-03T13:38:48.147557+0000, chain.objs.size()=9 2023-12-03T11:38:49.008 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.131__multipart_key1.2~EZLzfB4CfY-tF92ZbkVjHcoMnBNRi1N.1 2023-12-03T11:38:49.009 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.131__shadow_key1.2~EZLzfB4CfY-tF92ZbkVjHcoMnBNRi1N.1_1 2023-12-03T11:38:49.009 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.006+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.131__multipart_key1.2~EZLzfB4CfY-tF92ZbkVjHcoMnBNRi1N.2 2023-12-03T11:38:49.010 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.008+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.131__shadow_key1.2~EZLzfB4CfY-tF92ZbkVjHcoMnBNRi1N.2_1 2023-12-03T11:38:49.010 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.008+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.131__multipart_key1.2~EZLzfB4CfY-tF92ZbkVjHcoMnBNRi1N.3 2023-12-03T11:38:49.010 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.008+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.131__shadow_key1.2~EZLzfB4CfY-tF92ZbkVjHcoMnBNRi1N.3_1 2023-12-03T11:38:49.010 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.008+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.131__multipart_key1.2~EZLzfB4CfY-tF92ZbkVjHcoMnBNRi1N.4 2023-12-03T11:38:49.010 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.008+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.131__shadow_key1.2~EZLzfB4CfY-tF92ZbkVjHcoMnBNRi1N.4_1 2023-12-03T11:38:49.010 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.009+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.131__multipart_key1.2~EZLzfB4CfY-tF92ZbkVjHcoMnBNRi1N.5 2023-12-03T11:38:49.015 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.014+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.017 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.016+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:38:49.018 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.017+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.018 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.017+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.019 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.017+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:49.019 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.017+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.9187509032692662123', time=2023-12-03T13:38:32.402230+0000, chain.objs.size()=9 2023-12-03T11:38:49.019 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.017+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__multipart_file2.mpg.2~rAMW2sLobx_igtgtvKvZI0htiLOc7Uo.1 2023-12-03T11:38:49.019 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.018+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__shadow_file2.mpg.2~rAMW2sLobx_igtgtvKvZI0htiLOc7Uo.1_1 2023-12-03T11:38:49.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.018+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__multipart_file2.mpg.2~rAMW2sLobx_igtgtvKvZI0htiLOc7Uo.2 2023-12-03T11:38:49.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.018+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__shadow_file2.mpg.2~rAMW2sLobx_igtgtvKvZI0htiLOc7Uo.2_1 2023-12-03T11:38:49.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.018+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__multipart_file2.mpg.2~rAMW2sLobx_igtgtvKvZI0htiLOc7Uo.3 2023-12-03T11:38:49.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.018+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__shadow_file2.mpg.2~rAMW2sLobx_igtgtvKvZI0htiLOc7Uo.3_1 2023-12-03T11:38:49.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.018+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__multipart_file2.mpg.2~rAMW2sLobx_igtgtvKvZI0htiLOc7Uo.4 2023-12-03T11:38:49.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.018+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__shadow_file2.mpg.2~rAMW2sLobx_igtgtvKvZI0htiLOc7Uo.4_1 2023-12-03T11:38:49.020 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.018+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__multipart_file2.mpg.2~rAMW2sLobx_igtgtvKvZI0htiLOc7Uo.5 2023-12-03T11:38:49.022 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.020+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.024 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.022+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:38:49.025 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.024+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.026 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.024+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.4038131803565117269', time=2023-12-03T13:38:29.883744+0000, chain.objs.size()=7 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~pziD1luZQPo_Ya1DXux1j6O7fyvZuHJ.1 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~pziD1luZQPo_Ya1DXux1j6O7fyvZuHJ.1_1 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~pziD1luZQPo_Ya1DXux1j6O7fyvZuHJ.1_2 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~pziD1luZQPo_Ya1DXux1j6O7fyvZuHJ.2 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~pziD1luZQPo_Ya1DXux1j6O7fyvZuHJ.2_1 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~pziD1luZQPo_Ya1DXux1j6O7fyvZuHJ.2_2 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~pziD1luZQPo_Ya1DXux1j6O7fyvZuHJ.3 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.5263389424059600600', time=2023-12-03T13:38:35.137503+0000, chain.objs.size()=7 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~sLifMJA4oUV3-WfyUD7XTlimvj1t_f_.1 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~sLifMJA4oUV3-WfyUD7XTlimvj1t_f_.1_1 2023-12-03T11:38:49.027 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~sLifMJA4oUV3-WfyUD7XTlimvj1t_f_.1_2 2023-12-03T11:38:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~sLifMJA4oUV3-WfyUD7XTlimvj1t_f_.2 2023-12-03T11:38:49.028 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.025+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~sLifMJA4oUV3-WfyUD7XTlimvj1t_f_.2_1 2023-12-03T11:38:49.031 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.029+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~sLifMJA4oUV3-WfyUD7XTlimvj1t_f_.2_2 2023-12-03T11:38:49.031 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.029+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~sLifMJA4oUV3-WfyUD7XTlimvj1t_f_.3 2023-12-03T11:38:49.033 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.031+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.035 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.033+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:38:49.036 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.035+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.036 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.035+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.036 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.035+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.037 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.036+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:38:49.040 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.039+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.040 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.039+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.040+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.040+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.1038779429384285709', time=2023-12-03T13:38:29.236761+0000, chain.objs.size()=7 2023-12-03T11:38:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.040+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~jKgqj0ZeIN9GSM6hgWx0GTMM_mw4s10.1 2023-12-03T11:38:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.040+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~jKgqj0ZeIN9GSM6hgWx0GTMM_mw4s10.1_1 2023-12-03T11:38:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.040+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~jKgqj0ZeIN9GSM6hgWx0GTMM_mw4s10.1_2 2023-12-03T11:38:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.040+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~jKgqj0ZeIN9GSM6hgWx0GTMM_mw4s10.2 2023-12-03T11:38:49.041 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.040+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~jKgqj0ZeIN9GSM6hgWx0GTMM_mw4s10.2_1 2023-12-03T11:38:49.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.040+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~jKgqj0ZeIN9GSM6hgWx0GTMM_mw4s10.2_2 2023-12-03T11:38:49.042 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.040+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~jKgqj0ZeIN9GSM6hgWx0GTMM_mw4s10.3 2023-12-03T11:38:49.043 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.042+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.046 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.045+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:38:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.047 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:49.048 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.10635207303500536931', time=2023-12-03T13:38:36.671868+0000, chain.objs.size()=9 2023-12-03T11:38:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.91__multipart_key1.2~GF8tFMM_Ru7tw8kFYE9QVngl1Jq1IQZ.1 2023-12-03T11:38:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.91__shadow_key1.2~GF8tFMM_Ru7tw8kFYE9QVngl1Jq1IQZ.1_1 2023-12-03T11:38:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.91__multipart_key1.2~GF8tFMM_Ru7tw8kFYE9QVngl1Jq1IQZ.2 2023-12-03T11:38:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.91__shadow_key1.2~GF8tFMM_Ru7tw8kFYE9QVngl1Jq1IQZ.2_1 2023-12-03T11:38:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.91__multipart_key1.2~GF8tFMM_Ru7tw8kFYE9QVngl1Jq1IQZ.3 2023-12-03T11:38:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.91__shadow_key1.2~GF8tFMM_Ru7tw8kFYE9QVngl1Jq1IQZ.3_1 2023-12-03T11:38:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.91__multipart_key1.2~GF8tFMM_Ru7tw8kFYE9QVngl1Jq1IQZ.4 2023-12-03T11:38:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.91__shadow_key1.2~GF8tFMM_Ru7tw8kFYE9QVngl1Jq1IQZ.4_1 2023-12-03T11:38:49.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.046+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.91__multipart_key1.2~GF8tFMM_Ru7tw8kFYE9QVngl1Jq1IQZ.5 2023-12-03T11:38:49.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.049+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.053 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.052+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:38:49.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.053+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.053+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.055 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.054+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.056 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.055+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:38:49.057 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.056+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.057 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.056+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.058 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.057+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:49.058 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.057+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.14969973692551801679', time=2023-12-03T13:38:37.257992+0000, chain.objs.size()=9 2023-12-03T11:38:49.058 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.057+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.92__multipart_key1.2~Vgzw7RSXEuvjC-3fujZwryGZn5gFFP5.1 2023-12-03T11:38:49.058 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.057+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.92__shadow_key1.2~Vgzw7RSXEuvjC-3fujZwryGZn5gFFP5.1_1 2023-12-03T11:38:49.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.057+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.92__multipart_key1.2~Vgzw7RSXEuvjC-3fujZwryGZn5gFFP5.2 2023-12-03T11:38:49.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.057+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.92__shadow_key1.2~Vgzw7RSXEuvjC-3fujZwryGZn5gFFP5.2_1 2023-12-03T11:38:49.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.057+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.92__multipart_key1.2~Vgzw7RSXEuvjC-3fujZwryGZn5gFFP5.3 2023-12-03T11:38:49.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.057+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.92__shadow_key1.2~Vgzw7RSXEuvjC-3fujZwryGZn5gFFP5.3_1 2023-12-03T11:38:49.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.057+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.92__multipart_key1.2~Vgzw7RSXEuvjC-3fujZwryGZn5gFFP5.4 2023-12-03T11:38:49.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.057+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.92__shadow_key1.2~Vgzw7RSXEuvjC-3fujZwryGZn5gFFP5.4_1 2023-12-03T11:38:49.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.057+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.92__multipart_key1.2~Vgzw7RSXEuvjC-3fujZwryGZn5gFFP5.5 2023-12-03T11:38:49.061 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.060+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.062+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:38:49.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.064+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.064+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.066 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.13109745949153482241', time=2023-12-03T13:38:25.811714+0000, chain.objs.size()=9 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__multipart_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.1 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__shadow_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.1_1 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__multipart_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.2 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__shadow_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.2_1 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__multipart_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.3 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__shadow_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.3_1 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__multipart_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.4 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__shadow_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.4_1 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.79__multipart_key1.2~Vt1pRxTTQiqq1cnMUHb2iMx7gdh7dmY.5 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.18318588391400922434', time=2023-12-03T13:38:34.066951+0000, chain.objs.size()=9 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~GXDtw6_mNKuY1OpdmFEvhRhForEEyng.1 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~GXDtw6_mNKuY1OpdmFEvhRhForEEyng.1_1 2023-12-03T11:38:49.067 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.065+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~GXDtw6_mNKuY1OpdmFEvhRhForEEyng.2 2023-12-03T11:38:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.066+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~GXDtw6_mNKuY1OpdmFEvhRhForEEyng.2_1 2023-12-03T11:38:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.066+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~GXDtw6_mNKuY1OpdmFEvhRhForEEyng.3 2023-12-03T11:38:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.066+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~GXDtw6_mNKuY1OpdmFEvhRhForEEyng.3_1 2023-12-03T11:38:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.066+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~GXDtw6_mNKuY1OpdmFEvhRhForEEyng.4 2023-12-03T11:38:49.068 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.066+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~GXDtw6_mNKuY1OpdmFEvhRhForEEyng.4_1 2023-12-03T11:38:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.067+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~GXDtw6_mNKuY1OpdmFEvhRhForEEyng.5 2023-12-03T11:38:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.067+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.18138878178966335708', time=2023-12-03T13:38:34.870572+0000, chain.objs.size()=9 2023-12-03T11:38:49.069 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.067+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~z-1Y_G85o3dSYxWq11qJ2mQQGVOXd41.1 2023-12-03T11:38:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.069+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~z-1Y_G85o3dSYxWq11qJ2mQQGVOXd41.1_1 2023-12-03T11:38:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.069+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~z-1Y_G85o3dSYxWq11qJ2mQQGVOXd41.2 2023-12-03T11:38:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.069+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~z-1Y_G85o3dSYxWq11qJ2mQQGVOXd41.2_1 2023-12-03T11:38:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.069+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~z-1Y_G85o3dSYxWq11qJ2mQQGVOXd41.3 2023-12-03T11:38:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.069+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~z-1Y_G85o3dSYxWq11qJ2mQQGVOXd41.3_1 2023-12-03T11:38:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.069+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~z-1Y_G85o3dSYxWq11qJ2mQQGVOXd41.4 2023-12-03T11:38:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.070+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__shadow_key1.2~z-1Y_G85o3dSYxWq11qJ2mQQGVOXd41.4_1 2023-12-03T11:38:49.071 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.070+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.90__multipart_key1.2~z-1Y_G85o3dSYxWq11qJ2mQQGVOXd41.5 2023-12-03T11:38:49.075 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.073+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.076+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:38:49.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.077+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.078+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.079 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.078+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.080 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.079+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:38:49.081 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.080+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.082 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.080+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.082 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.081+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.082 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.081+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:38:49.084 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.083+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.084 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.083+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.084 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.083+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.085 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.084+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:38:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.085+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.086+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.086+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.088 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.087+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:38:49.089 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.088+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.090 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:38:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16692354646741347709', time=2023-12-03T13:38:29.777420+0000, chain.objs.size()=5 2023-12-03T11:38:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.81__shadow_.SLAj-O28bzlBFMW0ZwtXpsmtBlUbKu__1 2023-12-03T11:38:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.81__shadow_.SLAj-O28bzlBFMW0ZwtXpsmtBlUbKu__2 2023-12-03T11:38:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.81__shadow_.SLAj-O28bzlBFMW0ZwtXpsmtBlUbKu__3 2023-12-03T11:38:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.81__shadow_.SLAj-O28bzlBFMW0ZwtXpsmtBlUbKu__4 2023-12-03T11:38:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.81__shadow_.SLAj-O28bzlBFMW0ZwtXpsmtBlUbKu__5 2023-12-03T11:38:49.091 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.9678270035515283294', time=2023-12-03T13:38:48.649146+0000, chain.objs.size()=9 2023-12-03T11:38:49.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.132__multipart_key1/data/file.mpg.2~MymkOO_L_A6XQD89_sEN2xv7RUi1gCn.1 2023-12-03T11:38:49.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.132__shadow_key1/data/file.mpg.2~MymkOO_L_A6XQD89_sEN2xv7RUi1gCn.1_1 2023-12-03T11:38:49.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.132__multipart_key1/data/file.mpg.2~MymkOO_L_A6XQD89_sEN2xv7RUi1gCn.2 2023-12-03T11:38:49.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.132__shadow_key1/data/file.mpg.2~MymkOO_L_A6XQD89_sEN2xv7RUi1gCn.2_1 2023-12-03T11:38:49.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.132__multipart_key1/data/file.mpg.2~MymkOO_L_A6XQD89_sEN2xv7RUi1gCn.3 2023-12-03T11:38:49.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.132__shadow_key1/data/file.mpg.2~MymkOO_L_A6XQD89_sEN2xv7RUi1gCn.3_1 2023-12-03T11:38:49.092 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.089+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.132__multipart_key1/data/file.mpg.2~MymkOO_L_A6XQD89_sEN2xv7RUi1gCn.4 2023-12-03T11:38:49.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.092+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.132__shadow_key1/data/file.mpg.2~MymkOO_L_A6XQD89_sEN2xv7RUi1gCn.4_1 2023-12-03T11:38:49.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.092+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.132__multipart_key1/data/file.mpg.2~MymkOO_L_A6XQD89_sEN2xv7RUi1gCn.5 2023-12-03T11:38:49.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.096+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.099 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.098+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:38:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.099+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.101 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2023-12-03T11:38:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.2671572484395420613', time=2023-12-03T13:38:23.604899+0000, chain.objs.size()=2 2023-12-03T11:38:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.71__shadow_.6xicPt5w2wNX28I0tEKupSiNS79DgUD_1 2023-12-03T11:38:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.71__shadow_.6xicPt5w2wNX28I0tEKupSiNS79DgUD_2 2023-12-03T11:38:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.16939618810995112859', time=2023-12-03T13:38:28.824833+0000, chain.objs.size()=9 2023-12-03T11:38:49.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~KJT38vFo-f4Q5N87qPR1YBF1rEGd9B5.1 2023-12-03T11:38:49.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~KJT38vFo-f4Q5N87qPR1YBF1rEGd9B5.1_1 2023-12-03T11:38:49.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~KJT38vFo-f4Q5N87qPR1YBF1rEGd9B5.2 2023-12-03T11:38:49.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~KJT38vFo-f4Q5N87qPR1YBF1rEGd9B5.2_1 2023-12-03T11:38:49.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~KJT38vFo-f4Q5N87qPR1YBF1rEGd9B5.3 2023-12-03T11:38:49.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~KJT38vFo-f4Q5N87qPR1YBF1rEGd9B5.3_1 2023-12-03T11:38:49.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~KJT38vFo-f4Q5N87qPR1YBF1rEGd9B5.4 2023-12-03T11:38:49.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~KJT38vFo-f4Q5N87qPR1YBF1rEGd9B5.4_1 2023-12-03T11:38:49.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~KJT38vFo-f4Q5N87qPR1YBF1rEGd9B5.5 2023-12-03T11:38:49.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.12801323965610160835', time=2023-12-03T13:38:29.639601+0000, chain.objs.size()=7 2023-12-03T11:38:49.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.100+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~8MzpkuUg9ELPbtAFKQzTKTJKTTEboZn.1 2023-12-03T11:38:49.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.103+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~8MzpkuUg9ELPbtAFKQzTKTJKTTEboZn.1_1 2023-12-03T11:38:49.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.103+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~8MzpkuUg9ELPbtAFKQzTKTJKTTEboZn.1_2 2023-12-03T11:38:49.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.106+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~8MzpkuUg9ELPbtAFKQzTKTJKTTEboZn.2 2023-12-03T11:38:49.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.106+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~8MzpkuUg9ELPbtAFKQzTKTJKTTEboZn.2_1 2023-12-03T11:38:49.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.106+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~8MzpkuUg9ELPbtAFKQzTKTJKTTEboZn.2_2 2023-12-03T11:38:49.108 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.106+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~8MzpkuUg9ELPbtAFKQzTKTJKTTEboZn.3 2023-12-03T11:38:49.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.111+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.113+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:38:49.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.114+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:49.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.3217315556916980896', time=2023-12-03T13:38:27.889368+0000, chain.objs.size()=9 2023-12-03T11:38:49.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~cYvC962vkVxe3VYhvPiGBn65IVyNSgu.1 2023-12-03T11:38:49.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~cYvC962vkVxe3VYhvPiGBn65IVyNSgu.1_1 2023-12-03T11:38:49.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~cYvC962vkVxe3VYhvPiGBn65IVyNSgu.2 2023-12-03T11:38:49.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~cYvC962vkVxe3VYhvPiGBn65IVyNSgu.2_1 2023-12-03T11:38:49.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~cYvC962vkVxe3VYhvPiGBn65IVyNSgu.3 2023-12-03T11:38:49.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~cYvC962vkVxe3VYhvPiGBn65IVyNSgu.3_1 2023-12-03T11:38:49.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~cYvC962vkVxe3VYhvPiGBn65IVyNSgu.4 2023-12-03T11:38:49.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__shadow_key1.2~cYvC962vkVxe3VYhvPiGBn65IVyNSgu.4_1 2023-12-03T11:38:49.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.115+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.82__multipart_key1.2~cYvC962vkVxe3VYhvPiGBn65IVyNSgu.5 2023-12-03T11:38:49.119 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.118+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.121 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.120+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:38:49.122 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.121+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.123 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:49.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='2~hIrTV7dZW4y7XfzCXkWMwmkyeIo7ZlT', time=2023-12-03T13:38:22.297475+0000, chain.objs.size()=9 2023-12-03T11:38:49.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.67__multipart_key1.2~hIrTV7dZW4y7XfzCXkWMwmkyeIo7ZlT.1 2023-12-03T11:38:49.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.67__shadow_key1.2~hIrTV7dZW4y7XfzCXkWMwmkyeIo7ZlT.1_1 2023-12-03T11:38:49.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.67__multipart_key1.2~hIrTV7dZW4y7XfzCXkWMwmkyeIo7ZlT.2 2023-12-03T11:38:49.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.67__shadow_key1.2~hIrTV7dZW4y7XfzCXkWMwmkyeIo7ZlT.2_1 2023-12-03T11:38:49.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.67__multipart_key1.2~hIrTV7dZW4y7XfzCXkWMwmkyeIo7ZlT.3 2023-12-03T11:38:49.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.67__shadow_key1.2~hIrTV7dZW4y7XfzCXkWMwmkyeIo7ZlT.3_1 2023-12-03T11:38:49.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.67__multipart_key1.2~hIrTV7dZW4y7XfzCXkWMwmkyeIo7ZlT.4 2023-12-03T11:38:49.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.67__shadow_key1.2~hIrTV7dZW4y7XfzCXkWMwmkyeIo7ZlT.4_1 2023-12-03T11:38:49.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.122+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.67__multipart_key1.2~hIrTV7dZW4y7XfzCXkWMwmkyeIo7ZlT.5 2023-12-03T11:38:49.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.125+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.128 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.127+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:38:49.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.130 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2023-12-03T11:38:49.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.8026812618123390622', time=2023-12-03T13:38:31.851521+0000, chain.objs.size()=9 2023-12-03T11:38:49.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.87__multipart_key1.2~1BppHVPIDkTpGbHBoj6o2Cc2FTHP-DU.1 2023-12-03T11:38:49.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.87__shadow_key1.2~1BppHVPIDkTpGbHBoj6o2Cc2FTHP-DU.1_1 2023-12-03T11:38:49.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.87__multipart_key1.2~1BppHVPIDkTpGbHBoj6o2Cc2FTHP-DU.2 2023-12-03T11:38:49.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.87__shadow_key1.2~1BppHVPIDkTpGbHBoj6o2Cc2FTHP-DU.2_1 2023-12-03T11:38:49.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.87__multipart_key1.2~1BppHVPIDkTpGbHBoj6o2Cc2FTHP-DU.3 2023-12-03T11:38:49.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.87__shadow_key1.2~1BppHVPIDkTpGbHBoj6o2Cc2FTHP-DU.3_1 2023-12-03T11:38:49.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.87__multipart_key1.2~1BppHVPIDkTpGbHBoj6o2Cc2FTHP-DU.4 2023-12-03T11:38:49.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.87__shadow_key1.2~1BppHVPIDkTpGbHBoj6o2Cc2FTHP-DU.4_1 2023-12-03T11:38:49.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.87__multipart_key1.2~1BppHVPIDkTpGbHBoj6o2Cc2FTHP-DU.5 2023-12-03T11:38:49.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.11487643561570623294', time=2023-12-03T13:38:32.392128+0000, chain.objs.size()=9 2023-12-03T11:38:49.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__multipart_file.mpg.2~MP_XbWDi7nNxDXKtGcET7AXOjNmISQF.1 2023-12-03T11:38:49.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__shadow_file.mpg.2~MP_XbWDi7nNxDXKtGcET7AXOjNmISQF.1_1 2023-12-03T11:38:49.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.129+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__multipart_file.mpg.2~MP_XbWDi7nNxDXKtGcET7AXOjNmISQF.2 2023-12-03T11:38:49.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.133+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__shadow_file.mpg.2~MP_XbWDi7nNxDXKtGcET7AXOjNmISQF.2_1 2023-12-03T11:38:49.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.133+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__multipart_file.mpg.2~MP_XbWDi7nNxDXKtGcET7AXOjNmISQF.3 2023-12-03T11:38:49.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.134+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__shadow_file.mpg.2~MP_XbWDi7nNxDXKtGcET7AXOjNmISQF.3_1 2023-12-03T11:38:49.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.134+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__multipart_file.mpg.2~MP_XbWDi7nNxDXKtGcET7AXOjNmISQF.4 2023-12-03T11:38:49.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.134+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__shadow_file.mpg.2~MP_XbWDi7nNxDXKtGcET7AXOjNmISQF.4_1 2023-12-03T11:38:49.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.134+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.88__multipart_file.mpg.2~MP_XbWDi7nNxDXKtGcET7AXOjNmISQF.5 2023-12-03T11:38:49.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.137+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.139+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:38:49.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.140+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.143 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.143 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2023-12-03T11:38:49.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 20 garbage collection: RGWGC::process iterating over entry tag='e1920b66-3a00-44a2-8d9c-7e860031ca81.4683.6317409105809633859', time=2023-12-03T13:38:30.894492+0000, chain.objs.size()=9 2023-12-03T11:38:49.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.86__multipart_key1.2~FGhDzlLve7JQtEFJt7iemHJxJICOiRp.1 2023-12-03T11:38:49.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.86__shadow_key1.2~FGhDzlLve7JQtEFJt7iemHJxJICOiRp.1_1 2023-12-03T11:38:49.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.86__multipart_key1.2~FGhDzlLve7JQtEFJt7iemHJxJICOiRp.2 2023-12-03T11:38:49.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.86__shadow_key1.2~FGhDzlLve7JQtEFJt7iemHJxJICOiRp.2_1 2023-12-03T11:38:49.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.86__multipart_key1.2~FGhDzlLve7JQtEFJt7iemHJxJICOiRp.3 2023-12-03T11:38:49.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.86__shadow_key1.2~FGhDzlLve7JQtEFJt7iemHJxJICOiRp.3_1 2023-12-03T11:38:49.144 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.86__multipart_key1.2~FGhDzlLve7JQtEFJt7iemHJxJICOiRp.4 2023-12-03T11:38:49.145 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.86__shadow_key1.2~FGhDzlLve7JQtEFJt7iemHJxJICOiRp.4_1 2023-12-03T11:38:49.145 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.141+0000 7f8502811800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e1920b66-3a00-44a2-8d9c-7e860031ca81.4556.86__multipart_key1.2~FGhDzlLve7JQtEFJt7iemHJxJICOiRp.5 2023-12-03T11:38:49.146 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.145+0000 7f8502811800 5 garbage collection: RGWGC::process removing entries, marker: 2023-12-03T11:38:49.148 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.147+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:38:49.149 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.148+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.148+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.150 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.149+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.151 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.150+0000 7f8502811800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:38:49.152 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.151+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.153 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.151+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.153 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.151+0000 7f8502811800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.154 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.153+0000 7f84c67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:49.156 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.155+0000 7f8502811800 20 remove_watcher() i=0 2023-12-03T11:38:49.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.155+0000 7f8502811800 2 removed watcher, disabling cache 2023-12-03T11:38:49.157 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.156+0000 7f8502811800 20 remove_watcher() i=1 2023-12-03T11:38:49.158 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.157+0000 7f8502811800 20 remove_watcher() i=2 2023-12-03T11:38:49.159 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.158+0000 7f8502811800 20 remove_watcher() i=3 2023-12-03T11:38:49.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.159+0000 7f8502811800 20 remove_watcher() i=4 2023-12-03T11:38:49.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.160+0000 7f8502811800 20 remove_watcher() i=5 2023-12-03T11:38:49.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.161+0000 7f8502811800 20 remove_watcher() i=6 2023-12-03T11:38:49.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.162+0000 7f8502811800 20 remove_watcher() i=7 2023-12-03T11:38:49.168 DEBUG:teuthology.orchestra.run.smithi131:> radosgw-admin gc process --include-all 2023-12-03T11:38:49.219 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:49.219 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:49.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.232+0000 7f82db737800 20 rados->read ofs=0 len=0 2023-12-03T11:38:49.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.233+0000 7f82db737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:49.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.233+0000 7f82db737800 20 realm 2023-12-03T11:38:49.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.233+0000 7f82db737800 20 rados->read ofs=0 len=0 2023-12-03T11:38:49.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.234+0000 7f82db737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:49.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.234+0000 7f82db737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:49.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.234+0000 7f82db737800 20 rados->read ofs=0 len=0 2023-12-03T11:38:49.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.234+0000 7f82db737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:49.235 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.234+0000 7f82db737800 20 rados->read ofs=0 len=0 2023-12-03T11:38:49.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.234+0000 7f82db737800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:49.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.235+0000 7f82db737800 20 rados->read ofs=0 len=0 2023-12-03T11:38:49.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.235+0000 7f82db737800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:49.236 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.235+0000 7f82db737800 20 searching for the correct realm 2023-12-03T11:38:49.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.242+0000 7f82d7c70640 0 -- 172.21.15.131:0/3429184392 >> [v2:172.21.15.148:6817/2085634430,v1:172.21.15.148:6819/2085634430] conn(0x7f82c00030b0 msgr2=0x7f82cc0570d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:49.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:49.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:49.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:49.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:49.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 rados->read ofs=0 len=0 2023-12-03T11:38:49.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:49.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 rados->read ofs=0 len=0 2023-12-03T11:38:49.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:49.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 rados->read ofs=0 len=0 2023-12-03T11:38:49.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:49.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 zone default found 2023-12-03T11:38:49.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 4 Realm: () 2023-12-03T11:38:49.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:49.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:49.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:49.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 zonegroup default 2023-12-03T11:38:49.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.245+0000 7f82db737800 20 rados->read ofs=0 len=0 2023-12-03T11:38:49.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.246+0000 7f82db737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:49.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.246+0000 7f82db737800 20 rados->read ofs=0 len=0 2023-12-03T11:38:49.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.246+0000 7f82d6c6e640 0 -- 172.21.15.131:0/3429184392 >> [v2:172.21.15.148:6800/4184359357,v1:172.21.15.148:6801/4184359357] conn(0x7f82c805c040 msgr2=0x7f82c805c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:49.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.246+0000 7f82db737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:49.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.246+0000 7f82db737800 20 rados->read ofs=0 len=0 2023-12-03T11:38:49.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.247+0000 7f82db737800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:49.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.247+0000 7f82db737800 20 started sync module instance, tier type = 2023-12-03T11:38:49.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.247+0000 7f82db737800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:49.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.256+0000 7f82db737800 20 add_watcher() i=0 2023-12-03T11:38:49.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.256+0000 7f82db737800 20 add_watcher() i=1 2023-12-03T11:38:49.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.256+0000 7f82db737800 20 add_watcher() i=2 2023-12-03T11:38:49.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.256+0000 7f82db737800 20 add_watcher() i=3 2023-12-03T11:38:49.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.256+0000 7f82db737800 20 add_watcher() i=4 2023-12-03T11:38:49.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.256+0000 7f82db737800 20 add_watcher() i=5 2023-12-03T11:38:49.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.256+0000 7f82db737800 20 add_watcher() i=6 2023-12-03T11:38:49.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.257+0000 7f82db737800 20 add_watcher() i=7 2023-12-03T11:38:49.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.257+0000 7f82db737800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:49.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.258+0000 7f829d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:49.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.259+0000 7f82db737800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:49.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.259+0000 7f82db737800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.301+0000 7f820bfff640 20 reqs_thread_entry: start 2023-12-03T11:38:49.302 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.301+0000 7f82db737800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.301+0000 7f82db737800 20 Filter name: none 2023-12-03T11:38:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.301+0000 7f8209ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:49.303 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.301+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2023-12-03T11:38:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.302+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.303+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.304 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.303+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.306 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.304+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2023-12-03T11:38:49.307 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.305+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.307 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.306+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.308 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.306+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.308 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.307+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2023-12-03T11:38:49.309 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.308+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.310 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.309+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.310 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.309+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.310+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2023-12-03T11:38:49.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.311+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.311+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.313 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.312+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.314 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.312+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2023-12-03T11:38:49.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.314+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.314+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.314+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.315+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2023-12-03T11:38:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.316+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.317+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.318 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.317+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.319 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.318+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2023-12-03T11:38:49.320 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.319+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.320+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.320+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.322 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.321+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2023-12-03T11:38:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.322+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.322+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.323+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.325 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.323+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2023-12-03T11:38:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.325+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.325+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.326 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.325+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.327+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2023-12-03T11:38:49.329 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.328+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.329 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.328+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.329 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.328+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.330 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.329+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2023-12-03T11:38:49.332 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.331+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.332 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.331+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.332 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.331+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.333 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.332+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2023-12-03T11:38:49.334 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.333+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.334+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.334+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.335+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2023-12-03T11:38:49.338 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.336+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.338 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.337+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.338 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.337+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.339 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.338+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2023-12-03T11:38:49.341 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.339+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.341 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.340+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.341 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.340+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.341+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2023-12-03T11:38:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.343+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.343+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.343+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.344+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2023-12-03T11:38:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.346+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.347 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.346+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.348 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.346+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.349 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.348+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2023-12-03T11:38:49.350 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.349+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.350+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.350+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.351+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2023-12-03T11:38:49.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.352+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.352+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.354 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.353+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.354 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.353+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2023-12-03T11:38:49.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.355+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.355+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.357 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.355+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.358 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.356+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2023-12-03T11:38:49.359 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.358+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.359 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.358+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.359 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.358+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.361 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.359+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2023-12-03T11:38:49.362 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.360+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.362 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.361+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.362 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.361+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.363 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.362+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2023-12-03T11:38:49.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.364+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.364+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.365 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.364+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.365+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2023-12-03T11:38:49.367 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.366+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.368 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.367+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.368 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.367+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.369 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.368+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2023-12-03T11:38:49.370 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.369+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.370+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.371 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.370+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.372 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.371+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2023-12-03T11:38:49.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.372+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.373 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.372+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.374 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.373+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.375 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.374+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2023-12-03T11:38:49.376 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.375+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.376 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.375+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.377 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.375+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.378 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.376+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2023-12-03T11:38:49.379 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.378+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.379 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.378+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.379 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.378+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.380 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.379+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2023-12-03T11:38:49.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.380+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.381+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.382 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.381+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.383 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.382+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2023-12-03T11:38:49.385 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.384+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.384+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.386 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.385+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.387 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.385+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2023-12-03T11:38:49.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.387+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.387+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.387+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.395+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2023-12-03T11:38:49.397 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.396+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.398 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.396+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.398 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.397+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.398+0000 7f82db737800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2023-12-03T11:38:49.400 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.399+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.401 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.399+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2023-12-03T11:38:49.401 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.400+0000 7f82db737800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2023-12-03T11:38:49.402 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.401+0000 7f829d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:49.405 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.403+0000 7f82db737800 20 remove_watcher() i=0 2023-12-03T11:38:49.405 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.403+0000 7f82db737800 2 removed watcher, disabling cache 2023-12-03T11:38:49.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.405+0000 7f82db737800 20 remove_watcher() i=1 2023-12-03T11:38:49.406 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.405+0000 7f82db737800 20 remove_watcher() i=2 2023-12-03T11:38:49.407 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.406+0000 7f82db737800 20 remove_watcher() i=3 2023-12-03T11:38:49.408 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.407+0000 7f82db737800 20 remove_watcher() i=4 2023-12-03T11:38:49.409 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.408+0000 7f82db737800 20 remove_watcher() i=5 2023-12-03T11:38:49.410 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.409+0000 7f82db737800 20 remove_watcher() i=6 2023-12-03T11:38:49.411 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:49.410+0000 7f82db737800 20 remove_watcher() i=7 2023-12-03T11:38:49.416 INFO:teuthology.run_tasks:Running task s3tests... 2023-12-03T11:38:49.433 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2023-12-03T11:38:49.434 INFO:tasks.s3tests:Downloading s3-tests... 2023-12-03T11:38:49.434 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2023-12-03T11:38:49.434 DEBUG:teuthology.orchestra.run.smithi131:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2023-12-03T11:38:49.462 INFO:teuthology.orchestra.run.smithi131.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2023-12-03T11:38:50.079 INFO:tasks.s3tests:Creating rgw users... 2023-12-03T11:38:50.079 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2023-12-03T11:38:50.080 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --email foo.client.0+test@test.test --caps 'user-policy=*' --access-key ONHZBKXPRPOFFRKWSCAO --secret 8Qir+bY6VEfje9N7ZgnPGR1l6FNBfEMfr2lXZB9ebmtEolKfJvGT8A== --cluster ceph 2023-12-03T11:38:50.183 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:50.184 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:50.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.193+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.195+0000 7fe5f6d28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.195+0000 7fe5f6d28800 20 realm 2023-12-03T11:38:50.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.195+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.195+0000 7fe5f6d28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.195+0000 7fe5f6d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:50.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.195+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.195+0000 7fe5f6d28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.197 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.195+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.196+0000 7fe5f6d28800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:50.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.196+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.196+0000 7fe5f6d28800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:50.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.196+0000 7fe5f6d28800 20 searching for the correct realm 2023-12-03T11:38:50.207 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.206+0000 7fe5f2a61640 0 -- 172.21.15.131:0/752059749 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x555709cab0e0 msgr2=0x555709cad4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:50.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.207+0000 7fe5f6d28800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:50.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.207+0000 7fe5f6d28800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:50.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.207+0000 7fe5f6d28800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:50.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.207+0000 7fe5f6d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:50.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.207+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:50.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 20 zone default found 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 4 Realm: () 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 20 zonegroup default 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.208+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.209+0000 7fe5f6d28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.209+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.209+0000 7fe5f6d28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.209+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.209+0000 7fe5f6d28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.211 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.209+0000 7fe5f6d28800 20 started sync module instance, tier type = 2023-12-03T11:38:50.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.209+0000 7fe5f6d28800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:50.216 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.215+0000 7fe5f3262640 0 -- 172.21.15.131:0/752059749 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7fe5e80183f0 msgr2=0x7fe5e8018870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:50.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.218+0000 7fe5f6d28800 20 add_watcher() i=0 2023-12-03T11:38:50.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.218+0000 7fe5f6d28800 20 add_watcher() i=1 2023-12-03T11:38:50.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.218+0000 7fe5f6d28800 20 add_watcher() i=2 2023-12-03T11:38:50.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.218+0000 7fe5f6d28800 20 add_watcher() i=3 2023-12-03T11:38:50.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.218+0000 7fe5f6d28800 20 add_watcher() i=4 2023-12-03T11:38:50.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.218+0000 7fe5f6d28800 20 add_watcher() i=5 2023-12-03T11:38:50.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.218+0000 7fe5f6d28800 20 add_watcher() i=6 2023-12-03T11:38:50.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.219+0000 7fe5f6d28800 20 add_watcher() i=7 2023-12-03T11:38:50.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.219+0000 7fe5f6d28800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:50.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.220+0000 7fe533fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:50.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.220+0000 7fe5f6d28800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:50.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.220+0000 7fe5f6d28800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:50.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.225+0000 7fe5f6d28800 5 note: GC not initialized 2023-12-03T11:38:50.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.225+0000 7fe522ffd640 20 reqs_thread_entry: start 2023-12-03T11:38:50.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.225+0000 7fe5f6d28800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:50.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.225+0000 7fe5f6d28800 20 Filter name: none 2023-12-03T11:38:50.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.225+0000 7fe520ff9640 20 reqs_thread_entry: start 2023-12-03T11:38:50.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.225+0000 7fe5f6d28800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2023-12-03T11:38:50.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.225+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2023-12-03T11:38:50.227 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:38:50.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2023-12-03T11:38:50.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 10 cache get: name=default.rgw.meta+users.keys+ONHZBKXPRPOFFRKWSCAO : miss 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 10 cache put: name=default.rgw.meta+users.keys+ONHZBKXPRPOFFRKWSCAO info.flags=0x0 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 10 adding default.rgw.meta+users.keys+ONHZBKXPRPOFFRKWSCAO to cache LRU end 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 10 cache get: name=default.rgw.meta+users.keys+ONHZBKXPRPOFFRKWSCAO : hit (negative entry) 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.226+0000 7fe5f6d28800 10 cache get: name=default.rgw.meta+users.keys+ONHZBKXPRPOFFRKWSCAO : hit (negative entry) 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.227+0000 7fe5f6d28800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.227+0000 7fe5f6d28800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:38:50.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.227+0000 7fe5f6d28800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2023-12-03T11:38:50.230 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.228+0000 7fe5d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791518 cookie 140625416744960 notifier 7577 bl.length()=640 2023-12-03T11:38:50.230 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.228+0000 7fe5d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:38:50.230 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.228+0000 7fe5d97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:38:50.231 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.229+0000 7fe5f6d28800 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2023-12-03T11:38:50.231 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.229+0000 7fe5f6d28800 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-12-03T11:38:50.231 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.229+0000 7fe5f6d28800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.email:foo.client.0+test@test.test, ofs0, ns] 2023-12-03T11:38:50.231 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.230+0000 7fe5d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791528 cookie 93832314844400 notifier 7577 bl.length()=194 2023-12-03T11:38:50.231 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.230+0000 7fe5d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2023-12-03T11:38:50.231 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.230+0000 7fe5d8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2023-12-03T11:38:50.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.231+0000 7fe5f6d28800 10 cache put: name=default.rgw.meta+users.keys+ONHZBKXPRPOFFRKWSCAO info.flags=0x7 2023-12-03T11:38:50.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.231+0000 7fe5f6d28800 10 moving default.rgw.meta+users.keys+ONHZBKXPRPOFFRKWSCAO to cache LRU end 2023-12-03T11:38:50.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.231+0000 7fe5f6d28800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:ONHZBKXPRPOFFRKWSCAO, ofs0, ns] 2023-12-03T11:38:50.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.231+0000 7fe5d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1078036791397 cookie 93832314845440 notifier 7577 bl.length()=186 2023-12-03T11:38:50.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.231+0000 7fe5d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ONHZBKXPRPOFFRKWSCAO info.flags=0x7 2023-12-03T11:38:50.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.231+0000 7fe5d8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ONHZBKXPRPOFFRKWSCAO to cache LRU end 2023-12-03T11:38:50.233 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "user_id": "foo.client.0", 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "display_name": "Mr. foo.client.0", 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "email": "foo.client.0+test@test.test", 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "suspended": 0, 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "max_buckets": 1000, 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "subusers": [], 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "keys": [ 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "user": "foo.client.0", 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "access_key": "ONHZBKXPRPOFFRKWSCAO", 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: "secret_key": "8Qir+bY6VEfje9N7ZgnPGR1l6FNBfEMfr2lXZB9ebmtEolKfJvGT8A==" 2023-12-03T11:38:50.234 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "swift_keys": [], 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": [ 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "user-policy", 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "perm": "*" 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "op_mask": "read, write, delete", 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "default_placement": "", 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "default_storage_class": "", 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "placement_tags": [], 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "bucket_quota": { 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:50.235 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "user_quota": { 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "temp_url_keys": [], 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "rgw", 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: "mfa_ids": [] 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-12-03T11:38:50.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:50.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.232+0000 7fe533fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:50.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.235+0000 7fe5f6d28800 20 remove_watcher() i=0 2023-12-03T11:38:50.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.235+0000 7fe5f6d28800 2 removed watcher, disabling cache 2023-12-03T11:38:50.237 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.236+0000 7fe5f6d28800 20 remove_watcher() i=1 2023-12-03T11:38:50.238 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.237+0000 7fe5f6d28800 20 remove_watcher() i=2 2023-12-03T11:38:50.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.237+0000 7fe5f6d28800 20 remove_watcher() i=3 2023-12-03T11:38:50.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.238+0000 7fe5f6d28800 20 remove_watcher() i=4 2023-12-03T11:38:50.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.239+0000 7fe5f6d28800 20 remove_watcher() i=5 2023-12-03T11:38:50.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.240+0000 7fe5f6d28800 20 remove_watcher() i=6 2023-12-03T11:38:50.242 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.241+0000 7fe5f6d28800 20 remove_watcher() i=7 2023-12-03T11:38:50.247 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 9815026931 --totp-seed HCUUB7OHKRD2B6LTXF7EB2XHXMEAAALJE7N3D5H4UOLVO2SA6UQ6EC3ZRKMOSEYS --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:38:50.310 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:50.310 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:50.321 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.320+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.321+0000 7fc6ed120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.321+0000 7fc6ed120800 20 realm 2023-12-03T11:38:50.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.321+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.321+0000 7fc6ed120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.321+0000 7fc6ed120800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:50.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.321+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.321+0000 7fc6ed120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.323 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.321+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.322+0000 7fc6ed120800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:50.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.322+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.322+0000 7fc6ed120800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:50.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.322+0000 7fc6ed120800 20 searching for the correct realm 2023-12-03T11:38:50.333 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.332+0000 7fc6e8d70640 0 -- 172.21.15.131:0/3839982737 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5580020ef320 msgr2=0x5580020f1770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:50.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.333+0000 7fc6ed120800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:50.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.333+0000 7fc6ed120800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:50.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.333+0000 7fc6ed120800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:50.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.333+0000 7fc6ed120800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:50.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.333+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.333+0000 7fc6ed120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.333+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.333+0000 7fc6ed120800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.333+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 20 zone default found 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 4 Realm: () 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 20 zonegroup default 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:50.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 20 started sync module instance, tier type = 2023-12-03T11:38:50.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.334+0000 7fc6ed120800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:50.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.341+0000 7fc6e3fff640 0 -- 172.21.15.131:0/3839982737 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x5580020f4400 msgr2=0x5580020f67f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:50.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.343+0000 7fc6ed120800 20 add_watcher() i=0 2023-12-03T11:38:50.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.343+0000 7fc6ed120800 20 add_watcher() i=1 2023-12-03T11:38:50.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.343+0000 7fc6ed120800 20 add_watcher() i=2 2023-12-03T11:38:50.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.343+0000 7fc6ed120800 20 add_watcher() i=3 2023-12-03T11:38:50.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.343+0000 7fc6ed120800 20 add_watcher() i=4 2023-12-03T11:38:50.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.343+0000 7fc6ed120800 20 add_watcher() i=5 2023-12-03T11:38:50.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.343+0000 7fc6ed120800 20 add_watcher() i=6 2023-12-03T11:38:50.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.344+0000 7fc6ed120800 20 add_watcher() i=7 2023-12-03T11:38:50.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.344+0000 7fc6ed120800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:50.347 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.346+0000 7fc6ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:50.347 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.346+0000 7fc6ed120800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:50.347 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.346+0000 7fc6ed120800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:50.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.350+0000 7fc6ed120800 5 note: GC not initialized 2023-12-03T11:38:50.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.351+0000 7fc61d7fa640 20 reqs_thread_entry: start 2023-12-03T11:38:50.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.351+0000 7fc6ed120800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:50.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.351+0000 7fc6ed120800 20 Filter name: none 2023-12-03T11:38:50.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.351+0000 7fc616ffd640 20 reqs_thread_entry: start 2023-12-03T11:38:50.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.351+0000 7fc6ed120800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2023-12-03T11:38:50.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.351+0000 7fc6ed120800 20 rados->read ofs=0 len=0 2023-12-03T11:38:50.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.352+0000 7fc6ed120800 20 rados_obj.operate() r=0 bl.length=455 2023-12-03T11:38:50.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.352+0000 7fc6ed120800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2023-12-03T11:38:50.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.352+0000 7fc6ed120800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:38:50.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:50.352+0000 7fc6ed120800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:51.584 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.582+0000 7fc6ed120800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:38:51.584 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.582+0000 7fc6ed120800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:38:51.584 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.582+0000 7fc6ed120800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2023-12-03T11:38:51.584 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.583+0000 7fc6ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726111 cookie 140491937243136 notifier 7598 bl.length()=654 2023-12-03T11:38:51.584 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.583+0000 7fc6ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2023-12-03T11:38:51.584 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.583+0000 7fc6ca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2023-12-03T11:38:51.585 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.584+0000 7fc6ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:51.588 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.587+0000 7fc6ed120800 20 remove_watcher() i=0 2023-12-03T11:38:51.588 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.587+0000 7fc6ed120800 2 removed watcher, disabling cache 2023-12-03T11:38:51.589 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.588+0000 7fc6ed120800 20 remove_watcher() i=1 2023-12-03T11:38:51.590 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.589+0000 7fc6ed120800 20 remove_watcher() i=2 2023-12-03T11:38:51.592 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.591+0000 7fc6ed120800 20 remove_watcher() i=3 2023-12-03T11:38:51.593 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.592+0000 7fc6ed120800 20 remove_watcher() i=4 2023-12-03T11:38:51.594 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.593+0000 7fc6ed120800 20 remove_watcher() i=5 2023-12-03T11:38:51.595 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.594+0000 7fc6ed120800 20 remove_watcher() i=6 2023-12-03T11:38:51.596 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.595+0000 7fc6ed120800 20 remove_watcher() i=7 2023-12-03T11:38:51.602 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2023-12-03T11:38:51.602 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --email bar.client.0+test@test.test --caps 'user-policy=*' --access-key XTAQHFGXRGDKDCPVGSYP --secret suxYobq48zyh3xhxxbQ42b98tIZd7riegdHnHkjY6OZK1g3/kvlR6g== --cluster ceph 2023-12-03T11:38:51.668 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:51.669 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:51.680 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.678+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.682 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.680+0000 7fc10e126800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.682 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.680+0000 7fc10e126800 20 realm 2023-12-03T11:38:51.682 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.680+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.682 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.680+0000 7fc10e126800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.682 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.680+0000 7fc10e126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:51.682 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.680+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.682 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.680+0000 7fc10e126800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.682 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.680+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.683 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.681+0000 7fc10e126800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:51.683 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.681+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.683 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.682+0000 7fc10e126800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:51.683 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.682+0000 7fc10e126800 20 searching for the correct realm 2023-12-03T11:38:51.693 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.692+0000 7fc103fff640 0 -- 172.21.15.131:0/2746685087 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x5621b98ae330 msgr2=0x5621b98b0720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:51.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.693+0000 7fc10e126800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:51.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.693+0000 7fc10e126800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:51.695 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.693+0000 7fc10e126800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:51.695 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.693+0000 7fc10e126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:51.695 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.693+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.695 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.693+0000 7fc10e126800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.695 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.693+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:51.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:51.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 20 zone default found 2023-12-03T11:38:51.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 4 Realm: () 2023-12-03T11:38:51.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:51.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 20 zonegroup default 2023-12-03T11:38:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.694+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.695+0000 7fc10e126800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.695+0000 7fc10e126800 20 started sync module instance, tier type = 2023-12-03T11:38:51.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.695+0000 7fc10e126800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:51.702 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.701+0000 7fc103fff640 0 -- 172.21.15.131:0/2746685087 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x7fc0e407a3d0 msgr2=0x7fc0e407c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:51.705 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.704+0000 7fc10e126800 20 add_watcher() i=0 2023-12-03T11:38:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.704+0000 7fc10e126800 20 add_watcher() i=1 2023-12-03T11:38:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.704+0000 7fc10e126800 20 add_watcher() i=2 2023-12-03T11:38:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.704+0000 7fc10e126800 20 add_watcher() i=3 2023-12-03T11:38:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.704+0000 7fc10e126800 20 add_watcher() i=4 2023-12-03T11:38:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.704+0000 7fc10e126800 20 add_watcher() i=5 2023-12-03T11:38:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.704+0000 7fc10e126800 20 add_watcher() i=6 2023-12-03T11:38:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.705+0000 7fc10e126800 20 add_watcher() i=7 2023-12-03T11:38:51.706 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.705+0000 7fc10e126800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:51.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.707+0000 7fc0cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:51.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.707+0000 7fc10e126800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:51.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.707+0000 7fc10e126800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:51.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.711+0000 7fc10e126800 5 note: GC not initialized 2023-12-03T11:38:51.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.712+0000 7fc03e7fc640 20 reqs_thread_entry: start 2023-12-03T11:38:51.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.712+0000 7fc10e126800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:51.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.712+0000 7fc10e126800 20 Filter name: none 2023-12-03T11:38:51.713 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.712+0000 7fc02ffff640 20 reqs_thread_entry: start 2023-12-03T11:38:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.712+0000 7fc10e126800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2023-12-03T11:38:51.714 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.712+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2023-12-03T11:38:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:38:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2023-12-03T11:38:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.715 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2023-12-03T11:38:51.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-12-03T11:38:51.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 10 cache get: name=default.rgw.meta+users.keys+XTAQHFGXRGDKDCPVGSYP : miss 2023-12-03T11:38:51.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 10 cache put: name=default.rgw.meta+users.keys+XTAQHFGXRGDKDCPVGSYP info.flags=0x0 2023-12-03T11:38:51.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 10 adding default.rgw.meta+users.keys+XTAQHFGXRGDKDCPVGSYP to cache LRU end 2023-12-03T11:38:51.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 10 cache get: name=default.rgw.meta+users.keys+XTAQHFGXRGDKDCPVGSYP : hit (negative entry) 2023-12-03T11:38:51.716 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.713+0000 7fc10e126800 10 cache get: name=default.rgw.meta+users.keys+XTAQHFGXRGDKDCPVGSYP : hit (negative entry) 2023-12-03T11:38:51.717 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.715+0000 7fc10e126800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:38:51.717 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.715+0000 7fc10e126800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:38:51.717 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.715+0000 7fc10e126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2023-12-03T11:38:51.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.715+0000 7fc0ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726032 cookie 94702844333904 notifier 8031 bl.length()=640 2023-12-03T11:38:51.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.715+0000 7fc0ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:38:51.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.715+0000 7fc0ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:38:51.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.717+0000 7fc10e126800 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2023-12-03T11:38:51.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.717+0000 7fc10e126800 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-12-03T11:38:51.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.717+0000 7fc10e126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:bar.client.0+test@test.test, ofs0, ns] 2023-12-03T11:38:51.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.717+0000 7fc0ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726033 cookie 94702844333904 notifier 8031 bl.length()=194 2023-12-03T11:38:51.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.717+0000 7fc0ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2023-12-03T11:38:51.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.717+0000 7fc0ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2023-12-03T11:38:51.720 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.718+0000 7fc10e126800 10 cache put: name=default.rgw.meta+users.keys+XTAQHFGXRGDKDCPVGSYP info.flags=0x7 2023-12-03T11:38:51.720 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.718+0000 7fc10e126800 10 moving default.rgw.meta+users.keys+XTAQHFGXRGDKDCPVGSYP to cache LRU end 2023-12-03T11:38:51.720 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.718+0000 7fc10e126800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:XTAQHFGXRGDKDCPVGSYP, ofs0, ns] 2023-12-03T11:38:51.720 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.719+0000 7fc0ebfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725983 cookie 94702846812560 notifier 8031 bl.length()=186 2023-12-03T11:38:51.720 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.719+0000 7fc0ebfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XTAQHFGXRGDKDCPVGSYP info.flags=0x7 2023-12-03T11:38:51.720 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.719+0000 7fc0ebfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XTAQHFGXRGDKDCPVGSYP to cache LRU end 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "user_id": "bar.client.0", 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "display_name": "Mr. bar.client.0", 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "email": "bar.client.0+test@test.test", 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "suspended": 0, 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "max_buckets": 1000, 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "subusers": [], 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "keys": [ 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "user": "bar.client.0", 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "access_key": "XTAQHFGXRGDKDCPVGSYP", 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "secret_key": "suxYobq48zyh3xhxxbQ42b98tIZd7riegdHnHkjY6OZK1g3/kvlR6g==" 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "swift_keys": [], 2023-12-03T11:38:51.721 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": [ 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "user-policy", 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "perm": "*" 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "op_mask": "read, write, delete", 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "default_placement": "", 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "default_storage_class": "", 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "placement_tags": [], 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "bucket_quota": { 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:51.722 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout: "user_quota": { 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout: "temp_url_keys": [], 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "rgw", 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout: "mfa_ids": [] 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-12-03T11:38:51.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:51.724 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.720+0000 7fc0cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:51.724 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.722+0000 7fc10e126800 20 remove_watcher() i=0 2023-12-03T11:38:51.724 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.722+0000 7fc10e126800 2 removed watcher, disabling cache 2023-12-03T11:38:51.724 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.723+0000 7fc10e126800 20 remove_watcher() i=1 2023-12-03T11:38:51.726 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.724+0000 7fc10e126800 20 remove_watcher() i=2 2023-12-03T11:38:51.726 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.725+0000 7fc10e126800 20 remove_watcher() i=3 2023-12-03T11:38:51.727 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.726+0000 7fc10e126800 20 remove_watcher() i=4 2023-12-03T11:38:51.728 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.727+0000 7fc10e126800 20 remove_watcher() i=5 2023-12-03T11:38:51.729 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.728+0000 7fc10e126800 20 remove_watcher() i=6 2023-12-03T11:38:51.730 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.729+0000 7fc10e126800 20 remove_watcher() i=7 2023-12-03T11:38:51.735 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 0339978517 --totp-seed UUNFSPZXEY4W3QFJA332FGN4VXSVOUEVLJZFLAQJA6FJINGW7U7STC2JJM2NYL3U --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:38:51.797 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:51.798 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:51.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.807+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.808+0000 7f89df91f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.808+0000 7f89df91f800 20 realm 2023-12-03T11:38:51.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.808+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.809+0000 7f89df91f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.809+0000 7f89df91f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:51.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.809+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.809+0000 7f89df91f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.811 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.809+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.811 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.810+0000 7f89df91f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:51.811 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.810+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.811 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.810+0000 7f89df91f800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:51.811 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.810+0000 7f89df91f800 20 searching for the correct realm 2023-12-03T11:38:51.820 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.819+0000 7f89db54d640 0 -- 172.21.15.131:0/3964059438 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x5629499da6b0 msgr2=0x5629499dcb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:51.822 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.821+0000 7f89df91f800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:51.822 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.821+0000 7f89df91f800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:51.822 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.821+0000 7f89df91f800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:51.822 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.821+0000 7f89df91f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:51.823 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.821+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.823 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.821+0000 7f89df91f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.823 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.821+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.823 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.821+0000 7f89df91f800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:51.823 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.822+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.822+0000 7f89df91f800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:51.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.822+0000 7f89df91f800 20 zone default found 2023-12-03T11:38:51.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.822+0000 7f89df91f800 4 Realm: () 2023-12-03T11:38:51.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.822+0000 7f89df91f800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:51.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.822+0000 7f89df91f800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:51.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.822+0000 7f89df91f800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:51.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.822+0000 7f89df91f800 20 zonegroup default 2023-12-03T11:38:51.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.822+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.822+0000 7f89df91f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.824 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.822+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.825 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.823+0000 7f89df91f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.826 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.823+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.826 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.823+0000 7f89df91f800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.826 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.823+0000 7f89df91f800 20 started sync module instance, tier type = 2023-12-03T11:38:51.826 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.823+0000 7f89df91f800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:51.829 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.828+0000 7f89dbd4e640 0 -- 172.21.15.131:0/3964059438 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f89d0048910 msgr2=0x7f89d0010410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:51.833 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.831+0000 7f89df91f800 20 add_watcher() i=0 2023-12-03T11:38:51.833 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.831+0000 7f89df91f800 20 add_watcher() i=1 2023-12-03T11:38:51.833 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.831+0000 7f89df91f800 20 add_watcher() i=2 2023-12-03T11:38:51.833 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.831+0000 7f89df91f800 20 add_watcher() i=3 2023-12-03T11:38:51.833 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.831+0000 7f89df91f800 20 add_watcher() i=4 2023-12-03T11:38:51.833 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.831+0000 7f89df91f800 20 add_watcher() i=5 2023-12-03T11:38:51.833 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.831+0000 7f89df91f800 20 add_watcher() i=6 2023-12-03T11:38:51.833 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.832+0000 7f89df91f800 20 add_watcher() i=7 2023-12-03T11:38:51.833 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.832+0000 7f89df91f800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:51.835 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.834+0000 7f89a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:51.835 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.834+0000 7f89df91f800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:51.835 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.834+0000 7f89df91f800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:51.840 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.838+0000 7f89df91f800 5 note: GC not initialized 2023-12-03T11:38:51.840 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.839+0000 7f890ffff640 20 reqs_thread_entry: start 2023-12-03T11:38:51.841 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.839+0000 7f89df91f800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:51.841 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.839+0000 7f89df91f800 20 Filter name: none 2023-12-03T11:38:51.841 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.839+0000 7f890dffb640 20 reqs_thread_entry: start 2023-12-03T11:38:51.841 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.839+0000 7f89df91f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2023-12-03T11:38:51.841 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.839+0000 7f89df91f800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.841 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.840+0000 7f89df91f800 20 rados_obj.operate() r=0 bl.length=455 2023-12-03T11:38:51.841 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.840+0000 7f89df91f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2023-12-03T11:38:51.841 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.840+0000 7f89df91f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:38:51.841 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.840+0000 7f89df91f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:51.844 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.843+0000 7f89df91f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:38:51.844 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.843+0000 7f89df91f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:38:51.844 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.843+0000 7f89df91f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2023-12-03T11:38:51.844 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.843+0000 7f89c1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726034 cookie 94735326265168 notifier 8052 bl.length()=654 2023-12-03T11:38:51.844 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.843+0000 7f89c1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2023-12-03T11:38:51.844 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.843+0000 7f89c1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2023-12-03T11:38:51.845 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.844+0000 7f89a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.846+0000 7f89df91f800 20 remove_watcher() i=0 2023-12-03T11:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.846+0000 7f89df91f800 2 removed watcher, disabling cache 2023-12-03T11:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.847+0000 7f89df91f800 20 remove_watcher() i=1 2023-12-03T11:38:51.849 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.848+0000 7f89df91f800 20 remove_watcher() i=2 2023-12-03T11:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.849+0000 7f89df91f800 20 remove_watcher() i=3 2023-12-03T11:38:51.851 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.850+0000 7f89df91f800 20 remove_watcher() i=4 2023-12-03T11:38:51.852 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.851+0000 7f89df91f800 20 remove_watcher() i=5 2023-12-03T11:38:51.853 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.852+0000 7f89df91f800 20 remove_watcher() i=6 2023-12-03T11:38:51.854 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.853+0000 7f89df91f800 20 remove_watcher() i=7 2023-12-03T11:38:51.859 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2023-12-03T11:38:51.860 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --email 'testx$tenanteduser.client.0+test@test.test' --caps 'user-policy=*' --access-key REMLGOHFNUFZVVPHBSKM --secret uLFOXlRQcFFcYBxmas5l6rakdX8SQwm96aRTdI8AtPXS/Bvp22kiPQ== --cluster ceph 2023-12-03T11:38:51.923 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:51.923 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:51.933 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.932+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.935 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.934+0000 7f2461813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.935 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.934+0000 7f2461813800 20 realm 2023-12-03T11:38:51.935 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.934+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.934+0000 7f2461813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.934+0000 7f2461813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:51.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.934+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.934+0000 7f2461813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.934+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.936 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.935+0000 7f2461813800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:51.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.935+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.935+0000 7f2461813800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:51.937 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.935+0000 7f2461813800 20 searching for the correct realm 2023-12-03T11:38:51.946 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.945+0000 7f245f313640 0 -- 172.21.15.131:0/2494904440 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55c24a776ee0 msgr2=0x55c24a7792f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:51.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.945+0000 7f2461813800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:51.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.945+0000 7f2461813800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:51.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.945+0000 7f2461813800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:51.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.945+0000 7f2461813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:51.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.945+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.947 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 20 zone default found 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 4 Realm: () 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 20 zonegroup default 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.946+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.949 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.947+0000 7f2461813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.950 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.947+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.950 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.947+0000 7f2461813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.950 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.947+0000 7f2461813800 20 started sync module instance, tier type = 2023-12-03T11:38:51.950 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.947+0000 7f2461813800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:51.955 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.954+0000 7f245eb12640 0 -- 172.21.15.131:0/2494904440 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55c24a77bf80 msgr2=0x55c24a77e370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:51.957 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.955+0000 7f2461813800 20 add_watcher() i=0 2023-12-03T11:38:51.957 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.955+0000 7f2461813800 20 add_watcher() i=1 2023-12-03T11:38:51.957 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.955+0000 7f2461813800 20 add_watcher() i=2 2023-12-03T11:38:51.957 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.955+0000 7f2461813800 20 add_watcher() i=3 2023-12-03T11:38:51.957 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.955+0000 7f2461813800 20 add_watcher() i=4 2023-12-03T11:38:51.957 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.955+0000 7f2461813800 20 add_watcher() i=5 2023-12-03T11:38:51.957 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.956+0000 7f2461813800 20 add_watcher() i=6 2023-12-03T11:38:51.957 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.956+0000 7f2461813800 20 add_watcher() i=7 2023-12-03T11:38:51.958 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.956+0000 7f2461813800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:51.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.958+0000 7f24257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:51.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.958+0000 7f2461813800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:51.959 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.958+0000 7f2461813800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:51.964 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.962+0000 7f2461813800 5 note: GC not initialized 2023-12-03T11:38:51.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.963+0000 7f2393fff640 20 reqs_thread_entry: start 2023-12-03T11:38:51.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.963+0000 7f2461813800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:51.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.963+0000 7f2461813800 20 Filter name: none 2023-12-03T11:38:51.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.963+0000 7f2391ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:51.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.963+0000 7f2461813800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2023-12-03T11:38:51.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.963+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.963+0000 7f2461813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.963+0000 7f2461813800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2023-12-03T11:38:51.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.963+0000 7f2461813800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:38:51.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.963+0000 7f2461813800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2023-12-03T11:38:51.965 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.963+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.964+0000 7f2461813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.964+0000 7f2461813800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2023-12-03T11:38:51.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.964+0000 7f2461813800 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-12-03T11:38:51.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.964+0000 7f2461813800 10 cache get: name=default.rgw.meta+users.keys+REMLGOHFNUFZVVPHBSKM : miss 2023-12-03T11:38:51.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.964+0000 7f2461813800 20 rados->read ofs=0 len=0 2023-12-03T11:38:51.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.964+0000 7f2461813800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:51.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.964+0000 7f2461813800 10 cache put: name=default.rgw.meta+users.keys+REMLGOHFNUFZVVPHBSKM info.flags=0x0 2023-12-03T11:38:51.966 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.964+0000 7f2461813800 10 adding default.rgw.meta+users.keys+REMLGOHFNUFZVVPHBSKM to cache LRU end 2023-12-03T11:38:51.967 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.964+0000 7f2461813800 10 cache get: name=default.rgw.meta+users.keys+REMLGOHFNUFZVVPHBSKM : hit (negative entry) 2023-12-03T11:38:51.967 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.964+0000 7f2461813800 10 cache get: name=default.rgw.meta+users.keys+REMLGOHFNUFZVVPHBSKM : hit (negative entry) 2023-12-03T11:38:51.967 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.965+0000 7f2461813800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:38:51.967 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.965+0000 7f2461813800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:38:51.967 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.965+0000 7f2461813800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2023-12-03T11:38:51.967 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.965+0000 7f2445ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726121 cookie 94292961394768 notifier 8073 bl.length()=714 2023-12-03T11:38:51.967 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.965+0000 7f2445ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:38:51.967 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.965+0000 7f2445ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:38:51.968 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.967+0000 7f2461813800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2023-12-03T11:38:51.968 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.967+0000 7f2461813800 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-12-03T11:38:51.968 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.967+0000 7f2461813800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test, ofs0, ns] 2023-12-03T11:38:51.968 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.967+0000 7f2445ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725990 cookie 94292961409104 notifier 8073 bl.length()=224 2023-12-03T11:38:51.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.967+0000 7f2445ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2023-12-03T11:38:51.969 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.967+0000 7f2445ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-12-03T11:38:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.968+0000 7f2445ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725991 cookie 94292961409104 notifier 8073 bl.length()=224 2023-12-03T11:38:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.968+0000 7f2445ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2023-12-03T11:38:51.970 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.968+0000 7f2445ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2023-12-03T11:38:51.971 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.970+0000 7f2461813800 10 cache put: name=default.rgw.meta+users.keys+REMLGOHFNUFZVVPHBSKM info.flags=0x7 2023-12-03T11:38:51.971 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.970+0000 7f2461813800 10 moving default.rgw.meta+users.keys+REMLGOHFNUFZVVPHBSKM to cache LRU end 2023-12-03T11:38:51.971 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.970+0000 7f2461813800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:REMLGOHFNUFZVVPHBSKM, ofs0, ns] 2023-12-03T11:38:51.972 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.970+0000 7f2445ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726112 cookie 94292961399920 notifier 8073 bl.length()=201 2023-12-03T11:38:51.972 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.970+0000 7f2445ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+REMLGOHFNUFZVVPHBSKM info.flags=0x7 2023-12-03T11:38:51.972 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.970+0000 7f2445ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+REMLGOHFNUFZVVPHBSKM to cache LRU end 2023-12-03T11:38:51.972 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-12-03T11:38:51.972 INFO:teuthology.orchestra.run.smithi131.stdout: "user_id": "testx$tenanteduser.client.0", 2023-12-03T11:38:51.972 INFO:teuthology.orchestra.run.smithi131.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2023-12-03T11:38:51.972 INFO:teuthology.orchestra.run.smithi131.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2023-12-03T11:38:51.972 INFO:teuthology.orchestra.run.smithi131.stdout: "suspended": 0, 2023-12-03T11:38:51.972 INFO:teuthology.orchestra.run.smithi131.stdout: "max_buckets": 1000, 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: "subusers": [], 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: "keys": [ 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: "user": "testx$tenanteduser.client.0", 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: "access_key": "REMLGOHFNUFZVVPHBSKM", 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: "secret_key": "uLFOXlRQcFFcYBxmas5l6rakdX8SQwm96aRTdI8AtPXS/Bvp22kiPQ==" 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: "swift_keys": [], 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": [ 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "user-policy", 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: "perm": "*" 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:51.973 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "op_mask": "read, write, delete", 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "default_placement": "", 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "default_storage_class": "", 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "placement_tags": [], 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "bucket_quota": { 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "user_quota": { 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:51.974 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:51.975 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:51.975 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:51.975 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:51.975 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:51.975 INFO:teuthology.orchestra.run.smithi131.stdout: "temp_url_keys": [], 2023-12-03T11:38:51.975 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "rgw", 2023-12-03T11:38:51.975 INFO:teuthology.orchestra.run.smithi131.stdout: "mfa_ids": [] 2023-12-03T11:38:51.975 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-12-03T11:38:51.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.972+0000 7f24257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.973+0000 7f2461813800 20 remove_watcher() i=0 2023-12-03T11:38:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.973+0000 7f2461813800 2 removed watcher, disabling cache 2023-12-03T11:38:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.974+0000 7f2461813800 20 remove_watcher() i=1 2023-12-03T11:38:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.975+0000 7f2461813800 20 remove_watcher() i=2 2023-12-03T11:38:51.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.976+0000 7f2461813800 20 remove_watcher() i=3 2023-12-03T11:38:51.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.977+0000 7f2461813800 20 remove_watcher() i=4 2023-12-03T11:38:51.979 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.978+0000 7f2461813800 20 remove_watcher() i=5 2023-12-03T11:38:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.979+0000 7f2461813800 20 remove_watcher() i=6 2023-12-03T11:38:51.981 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:51.980+0000 7f2461813800 20 remove_watcher() i=7 2023-12-03T11:38:51.986 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 0229765444 --totp-seed 2XRGPF5GY7ZUBNRL6GF4QC5ZW25TL6NXLQOOMM622P2GANHVWBWRKJVTD5QIOXUA --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:38:52.051 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:52.051 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:52.062 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.061+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.063+0000 7fd410416800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.063+0000 7fd410416800 20 realm 2023-12-03T11:38:52.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.063+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.063+0000 7fd410416800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.063+0000 7fd410416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:52.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.063+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.063+0000 7fd410416800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.063+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.064+0000 7fd410416800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:52.065 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.064+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.066 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.064+0000 7fd410416800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:52.066 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.064+0000 7fd410416800 20 searching for the correct realm 2023-12-03T11:38:52.074 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.073+0000 7fd40ba93640 0 -- 172.21.15.131:0/3801011388 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x565341ba99e0 msgr2=0x565341babdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:52.075 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.074+0000 7fd410416800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:52.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.074+0000 7fd410416800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:52.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.074+0000 7fd410416800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:52.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.074+0000 7fd410416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:52.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.074+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.074+0000 7fd410416800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.076 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.074+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:52.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.077 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 20 zone default found 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 4 Realm: () 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 20 zonegroup default 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.075+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.076+0000 7fd410416800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.076+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.076+0000 7fd410416800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.076+0000 7fd410416800 20 started sync module instance, tier type = 2023-12-03T11:38:52.078 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.076+0000 7fd410416800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:52.083 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.082+0000 7fd403fff640 0 -- 172.21.15.131:0/3801011388 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x565341bae830 msgr2=0x565341bb0c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:52.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.085+0000 7fd410416800 20 add_watcher() i=0 2023-12-03T11:38:52.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.085+0000 7fd410416800 20 add_watcher() i=1 2023-12-03T11:38:52.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.085+0000 7fd410416800 20 add_watcher() i=2 2023-12-03T11:38:52.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.085+0000 7fd410416800 20 add_watcher() i=3 2023-12-03T11:38:52.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.085+0000 7fd410416800 20 add_watcher() i=4 2023-12-03T11:38:52.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.085+0000 7fd410416800 20 add_watcher() i=5 2023-12-03T11:38:52.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.085+0000 7fd410416800 20 add_watcher() i=6 2023-12-03T11:38:52.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.086+0000 7fd410416800 20 add_watcher() i=7 2023-12-03T11:38:52.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.086+0000 7fd410416800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:52.088 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.087+0000 7fd3d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:52.089 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.087+0000 7fd410416800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:52.089 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.087+0000 7fd410416800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:52.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.092+0000 7fd410416800 5 note: GC not initialized 2023-12-03T11:38:52.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.092+0000 7fd348ff9640 20 reqs_thread_entry: start 2023-12-03T11:38:52.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.092+0000 7fd410416800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:52.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.092+0000 7fd410416800 20 Filter name: none 2023-12-03T11:38:52.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.092+0000 7fd33e7fc640 20 reqs_thread_entry: start 2023-12-03T11:38:52.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.092+0000 7fd410416800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2023-12-03T11:38:52.094 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.092+0000 7fd410416800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.093+0000 7fd410416800 20 rados_obj.operate() r=0 bl.length=514 2023-12-03T11:38:52.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.093+0000 7fd410416800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2023-12-03T11:38:52.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.093+0000 7fd410416800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:38:52.095 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.093+0000 7fd410416800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:52.096 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.095+0000 7fd410416800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:38:52.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.095+0000 7fd410416800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:38:52.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.095+0000 7fd410416800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2023-12-03T11:38:52.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.096+0000 7fd401ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726122 cookie 94915585069520 notifier 8094 bl.length()=728 2023-12-03T11:38:52.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.096+0000 7fd401ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2023-12-03T11:38:52.097 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.096+0000 7fd401ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2023-12-03T11:38:52.098 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.097+0000 7fd3d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:52.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.099+0000 7fd410416800 20 remove_watcher() i=0 2023-12-03T11:38:52.100 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.099+0000 7fd410416800 2 removed watcher, disabling cache 2023-12-03T11:38:52.102 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.101+0000 7fd410416800 20 remove_watcher() i=1 2023-12-03T11:38:52.103 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.102+0000 7fd410416800 20 remove_watcher() i=2 2023-12-03T11:38:52.104 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.103+0000 7fd410416800 20 remove_watcher() i=3 2023-12-03T11:38:52.105 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.104+0000 7fd410416800 20 remove_watcher() i=4 2023-12-03T11:38:52.106 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.105+0000 7fd410416800 20 remove_watcher() i=5 2023-12-03T11:38:52.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.105+0000 7fd410416800 20 remove_watcher() i=6 2023-12-03T11:38:52.107 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.106+0000 7fd410416800 20 remove_watcher() i=7 2023-12-03T11:38:52.112 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2023-12-03T11:38:52.113 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name 'Mr. foobar.client.0' --email foobar.client.0+test@test.test --caps 'user-policy=*' --access-key JYYHSZDAHASFDMRQMDOM --secret VKw8EXpgEQkBNUGFV4N/icaUgiqtckvIh/3CRSLeln/wWOQ7V/Gk0A== --cluster ceph 2023-12-03T11:38:52.175 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:52.175 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:52.186 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.184+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.186+0000 7fc298b3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.186+0000 7fc298b3b800 20 realm 2023-12-03T11:38:52.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.186+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.186+0000 7fc298b3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.186+0000 7fc298b3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:52.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.186+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.187+0000 7fc298b3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.188 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.187+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.187+0000 7fc298b3b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:52.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.187+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.187+0000 7fc298b3b800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:52.189 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.188+0000 7fc298b3b800 20 searching for the correct realm 2023-12-03T11:38:52.198 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.196+0000 7fc294840640 0 -- 172.21.15.131:0/3270783724 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55bbb24dc580 msgr2=0x55bbb24de970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:52.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.197+0000 7fc298b3b800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:52.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.197+0000 7fc298b3b800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:52.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.197+0000 7fc298b3b800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:52.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.197+0000 7fc298b3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:52.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.197+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.197+0000 7fc298b3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.197+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.197+0000 7fc298b3b800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.197+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 20 zone default found 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 4 Realm: () 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 20 zonegroup default 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.201 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 20 started sync module instance, tier type = 2023-12-03T11:38:52.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.198+0000 7fc298b3b800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:52.206 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.204+0000 7fc29403f640 0 -- 172.21.15.131:0/3270783724 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55bbb24e13d0 msgr2=0x55bbb24e37c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:52.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.207+0000 7fc298b3b800 20 add_watcher() i=0 2023-12-03T11:38:52.209 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.207+0000 7fc298b3b800 20 add_watcher() i=1 2023-12-03T11:38:52.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.207+0000 7fc298b3b800 20 add_watcher() i=2 2023-12-03T11:38:52.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.207+0000 7fc298b3b800 20 add_watcher() i=3 2023-12-03T11:38:52.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.207+0000 7fc298b3b800 20 add_watcher() i=4 2023-12-03T11:38:52.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.207+0000 7fc298b3b800 20 add_watcher() i=5 2023-12-03T11:38:52.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.207+0000 7fc298b3b800 20 add_watcher() i=6 2023-12-03T11:38:52.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.208+0000 7fc298b3b800 20 add_watcher() i=7 2023-12-03T11:38:52.210 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.208+0000 7fc298b3b800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:52.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.209+0000 7fc25afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:52.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.210+0000 7fc298b3b800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:52.212 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.210+0000 7fc298b3b800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.214+0000 7fc298b3b800 5 note: GC not initialized 2023-12-03T11:38:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.214+0000 7fc1c9ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.214+0000 7fc298b3b800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.214+0000 7fc298b3b800 20 Filter name: none 2023-12-03T11:38:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc1bb7fe640 20 reqs_thread_entry: start 2023-12-03T11:38:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:38:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 10 cache get: name=default.rgw.meta+users.email+foobar.client.0+test@test.test : miss 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x0 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 10 adding default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 10 cache get: name=default.rgw.meta+users.keys+JYYHSZDAHASFDMRQMDOM : miss 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 10 cache put: name=default.rgw.meta+users.keys+JYYHSZDAHASFDMRQMDOM info.flags=0x0 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.215+0000 7fc298b3b800 10 adding default.rgw.meta+users.keys+JYYHSZDAHASFDMRQMDOM to cache LRU end 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.216+0000 7fc298b3b800 10 cache get: name=default.rgw.meta+users.keys+JYYHSZDAHASFDMRQMDOM : hit (negative entry) 2023-12-03T11:38:52.219 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.216+0000 7fc298b3b800 10 cache get: name=default.rgw.meta+users.keys+JYYHSZDAHASFDMRQMDOM : hit (negative entry) 2023-12-03T11:38:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.217+0000 7fc298b3b800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:38:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.217+0000 7fc298b3b800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.217+0000 7fc298b3b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:38:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.217+0000 7fc27b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725992 cookie 94264638727792 notifier 7694 bl.length()=655 2023-12-03T11:38:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.217+0000 7fc27b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:38:52.220 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.217+0000 7fc27b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.219+0000 7fc298b3b800 10 cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2023-12-03T11:38:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.219+0000 7fc298b3b800 10 moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-12-03T11:38:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.219+0000 7fc298b3b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:foobar.client.0+test@test.test, ofs0, ns] 2023-12-03T11:38:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.219+0000 7fc27b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626726123 cookie 94264638731968 notifier 7694 bl.length()=200 2023-12-03T11:38:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.219+0000 7fc27b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar.client.0+test@test.test info.flags=0x7 2023-12-03T11:38:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.219+0000 7fc27b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar.client.0+test@test.test to cache LRU end 2023-12-03T11:38:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.221+0000 7fc298b3b800 10 cache put: name=default.rgw.meta+users.keys+JYYHSZDAHASFDMRQMDOM info.flags=0x7 2023-12-03T11:38:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.221+0000 7fc298b3b800 10 moving default.rgw.meta+users.keys+JYYHSZDAHASFDMRQMDOM to cache LRU end 2023-12-03T11:38:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.221+0000 7fc298b3b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:JYYHSZDAHASFDMRQMDOM, ofs0, ns] 2023-12-03T11:38:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.221+0000 7fc27affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725982 cookie 94264638692784 notifier 7694 bl.length()=189 2023-12-03T11:38:52.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.221+0000 7fc27affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JYYHSZDAHASFDMRQMDOM info.flags=0x7 2023-12-03T11:38:52.224 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.221+0000 7fc27affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JYYHSZDAHASFDMRQMDOM to cache LRU end 2023-12-03T11:38:52.224 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-12-03T11:38:52.224 INFO:teuthology.orchestra.run.smithi131.stdout: "user_id": "foobar.client.0", 2023-12-03T11:38:52.224 INFO:teuthology.orchestra.run.smithi131.stdout: "display_name": "Mr. foobar.client.0", 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: "email": "foobar.client.0+test@test.test", 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: "suspended": 0, 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: "max_buckets": 1000, 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: "subusers": [], 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: "keys": [ 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: "user": "foobar.client.0", 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: "access_key": "JYYHSZDAHASFDMRQMDOM", 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: "secret_key": "VKw8EXpgEQkBNUGFV4N/icaUgiqtckvIh/3CRSLeln/wWOQ7V/Gk0A==" 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: "swift_keys": [], 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": [ 2023-12-03T11:38:52.225 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "user-policy", 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: "perm": "*" 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: "op_mask": "read, write, delete", 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: "default_placement": "", 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: "default_storage_class": "", 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: "placement_tags": [], 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: "bucket_quota": { 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:52.226 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: "user_quota": { 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: "temp_url_keys": [], 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "rgw", 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: "mfa_ids": [] 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-12-03T11:38:52.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.222+0000 7fc25afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.224+0000 7fc298b3b800 20 remove_watcher() i=0 2023-12-03T11:38:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.224+0000 7fc298b3b800 2 removed watcher, disabling cache 2023-12-03T11:38:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.225+0000 7fc298b3b800 20 remove_watcher() i=1 2023-12-03T11:38:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.226+0000 7fc298b3b800 20 remove_watcher() i=2 2023-12-03T11:38:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.227+0000 7fc298b3b800 20 remove_watcher() i=3 2023-12-03T11:38:52.230 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.228+0000 7fc298b3b800 20 remove_watcher() i=4 2023-12-03T11:38:52.231 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.229+0000 7fc298b3b800 20 remove_watcher() i=5 2023-12-03T11:38:52.232 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.230+0000 7fc298b3b800 20 remove_watcher() i=6 2023-12-03T11:38:52.233 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.231+0000 7fc298b3b800 20 remove_watcher() i=7 2023-12-03T11:38:52.238 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 5233631882 --totp-seed UMUPZTOVLE7OO45KL7AYYB4GY3SZZFJ62EAPNKWMSQ5RO4YW7Q24CYKQDEOBEO5D --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2023-12-03T11:38:52.301 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:52.301 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:52.312 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.310+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.314 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.311+0000 7f763d928800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.314 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.311+0000 7f763d928800 20 realm 2023-12-03T11:38:52.314 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.311+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.311+0000 7f763d928800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.311+0000 7f763d928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:52.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.311+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.312+0000 7f763d928800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.315 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.312+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.312+0000 7f763d928800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:52.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.312+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.316 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.313+0000 7f763d928800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:52.317 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.313+0000 7f763d928800 20 searching for the correct realm 2023-12-03T11:38:52.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.322+0000 7f7639577640 0 -- 172.21.15.131:0/3222349743 >> [v2:172.21.15.148:6816/1462848938,v1:172.21.15.148:6818/1462848938] conn(0x55ffe2d9fad0 msgr2=0x55ffe2da1f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.323+0000 7f763d928800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.323+0000 7f763d928800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.323+0000 7f763d928800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.323+0000 7f763d928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.323+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.323+0000 7f763d928800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.323+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 20 zone default found 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 4 Realm: () 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:52.327 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:52.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:52.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 20 zonegroup default 2023-12-03T11:38:52.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.328 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.324+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.329 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.325+0000 7f763d928800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.329 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.325+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.329 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.325+0000 7f763d928800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.329 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.325+0000 7f763d928800 20 started sync module instance, tier type = 2023-12-03T11:38:52.329 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.325+0000 7f763d928800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:52.333 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.331+0000 7f7630d76640 0 -- 172.21.15.131:0/3222349743 >> [v2:172.21.15.131:6824/184481672,v1:172.21.15.131:6825/184481672] conn(0x55ffe2da4be0 msgr2=0x55ffe2da6fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-03T11:38:52.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.333+0000 7f763d928800 20 add_watcher() i=0 2023-12-03T11:38:52.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.333+0000 7f763d928800 20 add_watcher() i=1 2023-12-03T11:38:52.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.333+0000 7f763d928800 20 add_watcher() i=2 2023-12-03T11:38:52.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.333+0000 7f763d928800 20 add_watcher() i=3 2023-12-03T11:38:52.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.333+0000 7f763d928800 20 add_watcher() i=4 2023-12-03T11:38:52.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.333+0000 7f763d928800 20 add_watcher() i=5 2023-12-03T11:38:52.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.333+0000 7f763d928800 20 add_watcher() i=6 2023-12-03T11:38:52.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.334+0000 7f763d928800 20 add_watcher() i=7 2023-12-03T11:38:52.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.334+0000 7f763d928800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.336+0000 7f75fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.336+0000 7f763d928800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:52.338 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.336+0000 7f763d928800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:52.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.340+0000 7f763d928800 5 note: GC not initialized 2023-12-03T11:38:52.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.340+0000 7f756dffb640 20 reqs_thread_entry: start 2023-12-03T11:38:52.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.341+0000 7f763d928800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:52.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.341+0000 7f763d928800 20 Filter name: none 2023-12-03T11:38:52.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.341+0000 7f755f7fe640 20 reqs_thread_entry: start 2023-12-03T11:38:52.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.341+0000 7f763d928800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:38:52.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.341+0000 7f763d928800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.341+0000 7f763d928800 20 rados_obj.operate() r=0 bl.length=467 2023-12-03T11:38:52.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.341+0000 7f763d928800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-12-03T11:38:52.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.341+0000 7f763d928800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.341+0000 7f763d928800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.344+0000 7f763d928800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:38:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.344+0000 7f763d928800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.344+0000 7f763d928800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:38:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.344+0000 7f761b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725993 cookie 94557511007392 notifier 7712 bl.length()=669 2023-12-03T11:38:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.344+0000 7f761b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:38:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.344+0000 7f761b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.347 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.345+0000 7f75fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:52.349 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.347+0000 7f763d928800 20 remove_watcher() i=0 2023-12-03T11:38:52.349 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.347+0000 7f763d928800 2 removed watcher, disabling cache 2023-12-03T11:38:52.350 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.348+0000 7f763d928800 20 remove_watcher() i=1 2023-12-03T11:38:52.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.349+0000 7f763d928800 20 remove_watcher() i=2 2023-12-03T11:38:52.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.350+0000 7f763d928800 20 remove_watcher() i=3 2023-12-03T11:38:52.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.351+0000 7f763d928800 20 remove_watcher() i=4 2023-12-03T11:38:52.354 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.352+0000 7f763d928800 20 remove_watcher() i=5 2023-12-03T11:38:52.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.353+0000 7f763d928800 20 remove_watcher() i=6 2023-12-03T11:38:52.356 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.354+0000 7f763d928800 20 remove_watcher() i=7 2023-12-03T11:38:52.361 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'roles=*' --cluster ceph 2023-12-03T11:38:52.415 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:52.416 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:52.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.424+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.428 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.426+0000 7f5669140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.426+0000 7f5669140800 20 realm 2023-12-03T11:38:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.426+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.426+0000 7f5669140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.426+0000 7f5669140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.426+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.426+0000 7f5669140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.426+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.430 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.427+0000 7f5669140800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:52.430 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.427+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.430 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.427+0000 7f5669140800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:52.430 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.427+0000 7f5669140800 20 searching for the correct realm 2023-12-03T11:38:52.437 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.434+0000 7f5664e45640 0 -- 172.21.15.131:0/389882763 >> [v2:172.21.15.131:6800/946067187,v1:172.21.15.131:6801/946067187] conn(0x7f56500030b0 msgr2=0x7f564c0268c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:52.439 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.437+0000 7f5669140800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:52.439 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.437+0000 7f5669140800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:52.439 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.437+0000 7f5669140800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:52.440 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.437+0000 7f5669140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:52.440 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.437+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.440 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.437+0000 7f5669140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.440 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.437+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.441 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.437+0000 7f5669140800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:52.441 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.437+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.441 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:52.441 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 20 zone default found 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 4 Realm: () 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 20 zonegroup default 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.438+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.439+0000 7f5669140800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.442 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.439+0000 7f5669140800 20 started sync module instance, tier type = 2023-12-03T11:38:52.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.439+0000 7f5669140800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:52.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.440+0000 7f5665646640 0 -- 172.21.15.131:0/389882763 >> [v2:172.21.15.148:6808/1983247150,v1:172.21.15.148:6809/1983247150] conn(0x7f564c018070 msgr2=0x7f564c033920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:52.449 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.447+0000 7f5669140800 20 add_watcher() i=0 2023-12-03T11:38:52.449 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.447+0000 7f5669140800 20 add_watcher() i=1 2023-12-03T11:38:52.450 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.447+0000 7f5669140800 20 add_watcher() i=2 2023-12-03T11:38:52.450 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.447+0000 7f5669140800 20 add_watcher() i=3 2023-12-03T11:38:52.450 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.447+0000 7f5669140800 20 add_watcher() i=4 2023-12-03T11:38:52.450 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.447+0000 7f5669140800 20 add_watcher() i=5 2023-12-03T11:38:52.450 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.447+0000 7f5669140800 20 add_watcher() i=6 2023-12-03T11:38:52.450 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.448+0000 7f5669140800 20 add_watcher() i=7 2023-12-03T11:38:52.450 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.448+0000 7f5669140800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:52.451 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.449+0000 7f562b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:52.452 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.449+0000 7f5669140800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:52.452 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.449+0000 7f5669140800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:52.456 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.454+0000 7f5669140800 5 note: GC not initialized 2023-12-03T11:38:52.456 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.454+0000 7f559a7fc640 20 reqs_thread_entry: start 2023-12-03T11:38:52.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.454+0000 7f5669140800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:52.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.454+0000 7f5669140800 20 Filter name: none 2023-12-03T11:38:52.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.454+0000 7f558bfff640 20 reqs_thread_entry: start 2023-12-03T11:38:52.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.454+0000 7f5669140800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:38:52.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.454+0000 7f5669140800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.455+0000 7f5669140800 20 rados_obj.operate() r=0 bl.length=481 2023-12-03T11:38:52.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.455+0000 7f5669140800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-12-03T11:38:52.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.455+0000 7f5669140800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.457 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.455+0000 7f5669140800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:52.458 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.456+0000 7f5669140800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:38:52.458 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.456+0000 7f5669140800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.458 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.456+0000 7f5669140800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:38:52.459 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.456+0000 7f565b642640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725994 cookie 93972050025104 notifier 8157 bl.length()=682 2023-12-03T11:38:52.459 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.456+0000 7f565b642640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:38:52.459 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.456+0000 7f565b642640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.459 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-12-03T11:38:52.459 INFO:teuthology.orchestra.run.smithi131.stdout: "user_id": "foobar.client.0", 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: "display_name": "Mr. foobar.client.0", 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: "email": "foobar.client.0+test@test.test", 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: "suspended": 0, 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: "max_buckets": 1000, 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: "subusers": [], 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: "keys": [ 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: "user": "foobar.client.0", 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: "access_key": "JYYHSZDAHASFDMRQMDOM", 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: "secret_key": "VKw8EXpgEQkBNUGFV4N/icaUgiqtckvIh/3CRSLeln/wWOQ7V/Gk0A==" 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:52.460 INFO:teuthology.orchestra.run.smithi131.stdout: "swift_keys": [], 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": [ 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "roles", 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: "perm": "*" 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "user-policy", 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: "perm": "*" 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: "op_mask": "read, write, delete", 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: "default_placement": "", 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: "default_storage_class": "", 2023-12-03T11:38:52.461 INFO:teuthology.orchestra.run.smithi131.stdout: "placement_tags": [], 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "bucket_quota": { 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "user_quota": { 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:52.462 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:52.463 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:52.463 INFO:teuthology.orchestra.run.smithi131.stdout: "temp_url_keys": [], 2023-12-03T11:38:52.463 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "rgw", 2023-12-03T11:38:52.463 INFO:teuthology.orchestra.run.smithi131.stdout: "mfa_ids": [ 2023-12-03T11:38:52.463 INFO:teuthology.orchestra.run.smithi131.stdout: "5233631882" 2023-12-03T11:38:52.463 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2023-12-03T11:38:52.463 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-12-03T11:38:52.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:52.464 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.458+0000 7f562b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:52.464 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.459+0000 7f5669140800 20 remove_watcher() i=0 2023-12-03T11:38:52.464 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.459+0000 7f5669140800 2 removed watcher, disabling cache 2023-12-03T11:38:52.464 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.460+0000 7f5669140800 20 remove_watcher() i=1 2023-12-03T11:38:52.464 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.461+0000 7f5669140800 20 remove_watcher() i=2 2023-12-03T11:38:52.465 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.462+0000 7f5669140800 20 remove_watcher() i=3 2023-12-03T11:38:52.465 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.463+0000 7f5669140800 20 remove_watcher() i=4 2023-12-03T11:38:52.466 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.464+0000 7f5669140800 20 remove_watcher() i=5 2023-12-03T11:38:52.468 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.465+0000 7f5669140800 20 remove_watcher() i=6 2023-12-03T11:38:52.468 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.466+0000 7f5669140800 20 remove_watcher() i=7 2023-12-03T11:38:52.474 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*' --cluster ceph 2023-12-03T11:38:52.528 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T11:38:52.528 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T11:38:52.539 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.537+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.538+0000 7f3239811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.538+0000 7f3239811800 20 realm 2023-12-03T11:38:52.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.538+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.538+0000 7f3239811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.538+0000 7f3239811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2023-12-03T11:38:52.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.538+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.539+0000 7f3239811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.541 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.539+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.542 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.539+0000 7f3239811800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:52.542 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.539+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.542 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.540+0000 7f3239811800 20 rados_obj.operate() r=0 bl.length=1020 2023-12-03T11:38:52.542 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.540+0000 7f3239811800 20 searching for the correct realm 2023-12-03T11:38:52.551 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.549+0000 7f3234e1a640 0 -- 172.21.15.131:0/1993901257 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x7f322c069020 msgr2=0x7f322c0a1d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.550+0000 7f3239811800 20 RGWRados::pool_iterate: got zone_info.e1920b66-3a00-44a2-8d9c-7e860031ca81 2023-12-03T11:38:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.550+0000 7f3239811800 20 RGWRados::pool_iterate: got zonegroup_info.7e207aac-c07d-4ff0-b5cc-475f4c07ab09 2023-12-03T11:38:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.550+0000 7f3239811800 20 RGWRados::pool_iterate: got zone_names.default 2023-12-03T11:38:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.550+0000 7f3239811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2023-12-03T11:38:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.550+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 20 rados_obj.operate() r=0 bl.length=46 2023-12-03T11:38:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.555 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 20 rados_obj.operate() r=0 bl.length=454 2023-12-03T11:38:52.555 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 20 zone default found 2023-12-03T11:38:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 4 Realm: () 2023-12-03T11:38:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 4 ZoneGroup: default (7e207aac-c07d-4ff0-b5cc-475f4c07ab09) 2023-12-03T11:38:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 4 Zone: default (e1920b66-3a00-44a2-8d9c-7e860031ca81) 2023-12-03T11:38:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 10 cannot find current period zonegroup using local zonegroup configuration 2023-12-03T11:38:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 20 zonegroup default 2023-12-03T11:38:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.551+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.552+0000 7f3239811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.552+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.552+0000 7f3239811800 20 rados_obj.operate() r=-2 bl.length=0 2023-12-03T11:38:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.552+0000 7f3239811800 20 started sync module instance, tier type = 2023-12-03T11:38:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.552+0000 7f3239811800 20 started zone id=e1920b66-3a00-44a2-8d9c-7e860031ca81 (name=default) with tier type = 2023-12-03T11:38:52.561 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.558+0000 7f3234e1a640 0 -- 172.21.15.131:0/1993901257 >> [v2:172.21.15.131:6816/3071035975,v1:172.21.15.131:6817/3071035975] conn(0x55a3a2efc0a0 msgr2=0x7f321007f4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-03T11:38:52.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.564+0000 7f3239811800 20 add_watcher() i=0 2023-12-03T11:38:52.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.564+0000 7f3239811800 20 add_watcher() i=1 2023-12-03T11:38:52.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.564+0000 7f3239811800 20 add_watcher() i=2 2023-12-03T11:38:52.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.564+0000 7f3239811800 20 add_watcher() i=3 2023-12-03T11:38:52.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.564+0000 7f3239811800 20 add_watcher() i=4 2023-12-03T11:38:52.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.564+0000 7f3239811800 20 add_watcher() i=5 2023-12-03T11:38:52.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.564+0000 7f3239811800 20 add_watcher() i=6 2023-12-03T11:38:52.571 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.569+0000 7f3239811800 20 add_watcher() i=7 2023-12-03T11:38:52.571 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.569+0000 7f3239811800 2 all 8 watchers are set, enabling cache 2023-12-03T11:38:52.575 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.573+0000 7f31fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:52.575 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.573+0000 7f3239811800 20 check_secure_mon_conn(): auth registry supported: methods=[2] modes=[2,1] 2023-12-03T11:38:52.575 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.573+0000 7f3239811800 20 check_secure_mon_conn(): mode 1 is insecure 2023-12-03T11:38:52.580 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.577+0000 7f3239811800 5 note: GC not initialized 2023-12-03T11:38:52.580 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.578+0000 7f3169ffb640 20 reqs_thread_entry: start 2023-12-03T11:38:52.581 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.578+0000 7f3239811800 20 init_complete bucket index max shards: 1 2023-12-03T11:38:52.581 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.578+0000 7f3239811800 20 Filter name: none 2023-12-03T11:38:52.581 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.578+0000 7f315b7fe640 20 reqs_thread_entry: start 2023-12-03T11:38:52.581 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.578+0000 7f3239811800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2023-12-03T11:38:52.581 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.578+0000 7f3239811800 20 rados->read ofs=0 len=0 2023-12-03T11:38:52.583 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.581+0000 7f3239811800 20 rados_obj.operate() r=0 bl.length=494 2023-12-03T11:38:52.584 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.581+0000 7f3239811800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2023-12-03T11:38:52.584 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.581+0000 7f3239811800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.584 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.581+0000 7f3239811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2023-12-03T11:38:52.585 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.583+0000 7f3239811800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:38:52.585 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.583+0000 7f3239811800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.585 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.583+0000 7f3239811800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2023-12-03T11:38:52.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.583+0000 7f321b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693291 cookie 94161301704656 notifier 7748 bl.length()=703 2023-12-03T11:38:52.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.583+0000 7f321b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2023-12-03T11:38:52.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.583+0000 7f321b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2023-12-03T11:38:52.586 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-12-03T11:38:52.586 INFO:teuthology.orchestra.run.smithi131.stdout: "user_id": "foobar.client.0", 2023-12-03T11:38:52.586 INFO:teuthology.orchestra.run.smithi131.stdout: "display_name": "Mr. foobar.client.0", 2023-12-03T11:38:52.586 INFO:teuthology.orchestra.run.smithi131.stdout: "email": "foobar.client.0+test@test.test", 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: "suspended": 0, 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: "max_buckets": 1000, 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: "subusers": [], 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: "keys": [ 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: "user": "foobar.client.0", 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: "access_key": "JYYHSZDAHASFDMRQMDOM", 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: "secret_key": "VKw8EXpgEQkBNUGFV4N/icaUgiqtckvIh/3CRSLeln/wWOQ7V/Gk0A==" 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: "swift_keys": [], 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": [ 2023-12-03T11:38:52.587 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "oidc-provider", 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: "perm": "*" 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "roles", 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: "perm": "*" 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: { 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "user-policy", 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: "perm": "*" 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-12-03T11:38:52.588 INFO:teuthology.orchestra.run.smithi131.stdout: ], 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: "op_mask": "read, write, delete", 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: "default_placement": "", 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: "default_storage_class": "", 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: "placement_tags": [], 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: "bucket_quota": { 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:52.589 INFO:teuthology.orchestra.run.smithi131.stdout: "user_quota": { 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout: "enabled": false, 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout: "check_on_raw": false, 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size": -1, 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout: "max_size_kb": 0, 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout: "max_objects": -1 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout: "temp_url_keys": [], 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "rgw", 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout: "mfa_ids": [ 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout: "5233631882" 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2023-12-03T11:38:52.590 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-12-03T11:38:52.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:38:52.591 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.584+0000 7f31fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2023-12-03T11:38:52.591 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.589+0000 7f3239811800 20 remove_watcher() i=0 2023-12-03T11:38:52.592 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.589+0000 7f3239811800 2 removed watcher, disabling cache 2023-12-03T11:38:52.592 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.590+0000 7f3239811800 20 remove_watcher() i=1 2023-12-03T11:38:52.597 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.594+0000 7f3239811800 20 remove_watcher() i=2 2023-12-03T11:38:52.598 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.595+0000 7f3239811800 20 remove_watcher() i=3 2023-12-03T11:38:52.599 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.596+0000 7f3239811800 20 remove_watcher() i=4 2023-12-03T11:38:52.599 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.597+0000 7f3239811800 20 remove_watcher() i=5 2023-12-03T11:38:52.600 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.598+0000 7f3239811800 20 remove_watcher() i=6 2023-12-03T11:38:52.601 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T11:38:52.599+0000 7f3239811800 20 remove_watcher() i=7 2023-12-03T11:38:52.607 INFO:tasks.s3tests:Configuring s3-tests... 2023-12-03T11:38:52.607 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:38:52.607 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2023-12-03T11:38:52.634 INFO:tasks.s3tests:Configuring boto... 2023-12-03T11:38:52.635 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-12-03T11:38:52.635 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2023-12-03T11:38:52.701 DEBUG:teuthology.orchestra.run.smithi131:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2023-12-03T11:38:52.868 INFO:teuthology.orchestra.run.smithi131.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2023-12-03T11:38:53.047 INFO:teuthology.orchestra.run.smithi131.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2023-12-03T11:38:53.284 INFO:teuthology.orchestra.run.smithi131.stdout:py installdeps: -rrequirements.txt 2023-12-03T11:40:46.538 INFO:teuthology.orchestra.run.smithi131.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2023-12-03T11:40:48.196 INFO:teuthology.orchestra.run.smithi131.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.3.2,certifi==2023.11.17,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.7,exceptiongroup==1.2.0,filelock==3.13.1,gevent==23.9.1,greenlet==3.0.1,httplib2==0.22.0,idna==3.6,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==4.9.3,munch==4.0.0,packaging==23.2,platformdirs==4.0.0,pluggy==1.3.0,pyparsing==3.1.1,pyproject-api==1.6.1,pytest==7.4.3,python-dateutil==2.8.2,pytz==2023.3.post1,PyYAML==6.0.1,requests==2.31.0,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=885d200d7e10522e3e2186325f2f84cbc9cbb4323245bfca971358d28b79794d,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.11.4,urllib3==1.26.18,virtualenv==20.25.0,zope.event==5.0,zope.interface==6.1 2023-12-03T11:40:48.196 INFO:teuthology.orchestra.run.smithi131.stdout:py run-test-pre: PYTHONHASHSEED='631574451' 2023-12-03T11:40:48.196 INFO:teuthology.orchestra.run.smithi131.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2023-12-03T11:40:48.343 INFO:teuthology.orchestra.run.smithi131.stdout:============================= test session starts ============================== 2023-12-03T11:40:48.343 INFO:teuthology.orchestra.run.smithi131.stdout:platform linux -- Python 3.9.17, pytest-7.4.3, pluggy-1.3.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2023-12-03T11:40:48.343 INFO:teuthology.orchestra.run.smithi131.stdout:cachedir: .tox/py/.pytest_cache 2023-12-03T11:40:48.343 INFO:teuthology.orchestra.run.smithi131.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2023-12-03T11:40:48.343 INFO:teuthology.orchestra.run.smithi131.stdout:configfile: pytest.ini 2023-12-03T11:40:49.926 INFO:teuthology.orchestra.run.smithi131.stdout:collecting ... collected 787 items / 124 deselected / 663 selected 2023-12-03T11:40:49.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T11:40:50.046 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2023-12-03T11:40:50.159 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2023-12-03T11:40:50.315 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2023-12-03T11:40:50.472 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2023-12-03T11:40:50.584 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2023-12-03T11:40:50.693 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2023-12-03T11:40:50.852 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 1%] 2023-12-03T11:40:50.960 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2023-12-03T11:40:51.046 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2023-12-03T11:40:51.133 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2023-12-03T11:40:51.243 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2023-12-03T11:40:51.354 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2023-12-03T11:40:51.464 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2023-12-03T11:40:51.573 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 2%] 2023-12-03T11:40:51.660 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2023-12-03T11:40:51.746 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2023-12-03T11:40:51.792 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2023-12-03T11:40:51.838 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2023-12-03T11:40:51.884 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2023-12-03T11:40:51.930 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 3%] 2023-12-03T11:40:51.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 3%] 2023-12-03T11:40:52.021 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2023-12-03T11:40:52.067 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2023-12-03T11:40:52.113 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2023-12-03T11:40:52.158 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2023-12-03T11:40:52.204 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2023-12-03T11:40:52.250 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 4%] 2023-12-03T11:40:52.295 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 4%] 2023-12-03T11:40:52.341 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 4%] 2023-12-03T11:40:52.387 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2023-12-03T11:40:52.434 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2023-12-03T11:40:52.480 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2023-12-03T11:40:52.525 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2023-12-03T11:40:52.571 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 5%] 2023-12-03T11:40:52.617 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 5%] 2023-12-03T11:40:52.663 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 5%] 2023-12-03T11:40:52.709 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2023-12-03T11:40:52.755 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2023-12-03T11:40:52.801 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2023-12-03T11:40:52.848 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 6%] 2023-12-03T11:40:52.894 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 6%] 2023-12-03T11:40:52.940 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 6%] 2023-12-03T11:40:52.987 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 6%] 2023-12-03T11:40:53.033 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2023-12-03T11:40:53.079 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2023-12-03T11:40:53.125 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2023-12-03T11:40:53.172 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 7%] 2023-12-03T11:40:53.217 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 7%] 2023-12-03T11:40:53.264 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 7%] 2023-12-03T11:40:53.310 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 7%] 2023-12-03T11:40:53.357 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 7%] 2023-12-03T11:40:53.403 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2023-12-03T11:40:53.450 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2023-12-03T11:40:53.711 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 8%] 2023-12-03T11:40:54.190 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 8%] 2023-12-03T11:40:55.158 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 8%] 2023-12-03T11:40:55.990 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 8%] 2023-12-03T11:40:57.501 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 8%] 2023-12-03T11:40:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2023-12-03T11:40:58.557 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 9%] 2023-12-03T11:40:58.746 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 9%] 2023-12-03T11:40:58.815 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 9%] 2023-12-03T11:40:58.961 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 9%] 2023-12-03T11:40:59.108 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 9%] 2023-12-03T11:40:59.271 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 9%] 2023-12-03T11:40:59.390 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 9%] 2023-12-03T11:40:59.457 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 10%] 2023-12-03T11:40:59.457 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 10%] 2023-12-03T11:40:59.458 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 10%] 2023-12-03T11:40:59.460 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 10%] 2023-12-03T11:40:59.461 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 10%] 2023-12-03T11:40:59.462 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 10%] 2023-12-03T11:40:59.463 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 11%] 2023-12-03T11:40:59.463 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:40:59.465 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:40:59.465 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:40:59.466 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 11%] 2023-12-03T11:40:59.467 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 11%] 2023-12-03T11:40:59.468 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 11%] 2023-12-03T11:40:59.468 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 12%] 2023-12-03T11:40:59.469 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2023-12-03T11:40:59.470 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 12%] 2023-12-03T11:40:59.471 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:40:59.472 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:40:59.473 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:40:59.473 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 12%] 2023-12-03T11:40:59.474 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 13%] 2023-12-03T11:40:59.475 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 13%] 2023-12-03T11:40:59.476 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 13%] 2023-12-03T11:40:59.477 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 13%] 2023-12-03T11:40:59.477 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 13%] 2023-12-03T11:40:59.478 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 13%] 2023-12-03T11:40:59.479 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 14%] 2023-12-03T11:40:59.480 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 14%] 2023-12-03T11:40:59.539 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 14%] 2023-12-03T11:40:59.550 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 14%] 2023-12-03T11:40:59.737 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 14%] 2023-12-03T11:41:03.679 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 14%] 2023-12-03T11:41:03.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 14%] 2023-12-03T11:41:03.965 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 15%] 2023-12-03T11:41:04.133 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 15%] 2023-12-03T11:41:04.300 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 15%] 2023-12-03T11:41:04.469 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 15%] 2023-12-03T11:41:04.582 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 15%] 2023-12-03T11:41:04.750 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 15%] 2023-12-03T11:41:04.942 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 15%] 2023-12-03T11:41:05.098 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 16%] 2023-12-03T11:41:05.209 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 16%] 2023-12-03T11:41:05.315 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 16%] 2023-12-03T11:41:05.419 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 16%] 2023-12-03T11:41:05.459 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 16%] 2023-12-03T11:41:05.572 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 16%] 2023-12-03T11:41:05.735 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 17%] 2023-12-03T11:41:05.894 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 17%] 2023-12-03T11:41:06.037 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 17%] 2023-12-03T11:41:06.149 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 17%] 2023-12-03T11:41:06.257 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 17%] 2023-12-03T11:41:06.369 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 17%] 2023-12-03T11:41:06.480 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 17%] 2023-12-03T11:41:06.583 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 18%] 2023-12-03T11:41:06.688 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 18%] 2023-12-03T11:41:06.728 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 18%] 2023-12-03T11:41:06.766 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 18%] 2023-12-03T11:41:06.842 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 18%] 2023-12-03T11:41:06.881 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 18%] 2023-12-03T11:41:06.920 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 19%] 2023-12-03T11:41:07.032 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 19%] 2023-12-03T11:41:07.071 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 19%] 2023-12-03T11:41:07.117 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 19%] 2023-12-03T11:41:07.259 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 19%] 2023-12-03T11:41:07.397 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 19%] 2023-12-03T11:41:07.436 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 19%] 2023-12-03T11:41:07.575 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 20%] 2023-12-03T11:41:07.749 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 20%] 2023-12-03T11:41:07.980 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 20%] 2023-12-03T11:41:08.073 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 20%] 2023-12-03T11:41:08.209 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 20%] 2023-12-03T11:41:08.344 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 20%] 2023-12-03T11:41:08.671 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 20%] 2023-12-03T11:41:08.812 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:41:08.977 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:41:09.120 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:41:09.457 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:41:09.655 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:41:09.956 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 21%] 2023-12-03T11:41:10.146 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 22%] 2023-12-03T11:41:10.410 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 22%] 2023-12-03T11:41:10.584 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 22%] 2023-12-03T11:41:10.846 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 22%] 2023-12-03T11:41:11.026 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 22%] 2023-12-03T11:41:11.208 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 22%] 2023-12-03T11:41:11.477 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 22%] 2023-12-03T11:41:11.700 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 23%] 2023-12-03T11:41:11.917 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 23%] 2023-12-03T11:41:12.131 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 23%] 2023-12-03T11:41:12.309 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 23%] 2023-12-03T11:41:12.528 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 23%] 2023-12-03T11:41:12.712 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 23%] 2023-12-03T11:41:12.892 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 23%] 2023-12-03T11:41:13.122 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 24%] 2023-12-03T11:41:13.352 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 24%] 2023-12-03T11:41:13.551 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2023-12-03T11:41:13.712 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 24%] 2023-12-03T11:41:13.892 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 24%] 2023-12-03T11:41:14.071 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 24%] 2023-12-03T11:41:14.297 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 25%] 2023-12-03T11:41:14.560 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 25%] 2023-12-03T11:41:14.739 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 25%] 2023-12-03T11:41:14.923 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 25%] 2023-12-03T11:41:15.102 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 25%] 2023-12-03T11:41:15.283 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 25%] 2023-12-03T11:41:15.464 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 25%] 2023-12-03T11:41:15.643 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 26%] 2023-12-03T11:41:15.860 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 26%] 2023-12-03T11:41:16.040 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 26%] 2023-12-03T11:41:16.219 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 26%] 2023-12-03T11:41:16.398 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 26%] 2023-12-03T11:41:16.577 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 26%] 2023-12-03T11:41:16.756 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 26%] 2023-12-03T11:41:16.968 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 27%] 2023-12-03T11:41:17.143 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 27%] 2023-12-03T11:41:17.316 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 27%] 2023-12-03T11:41:17.497 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 27%] 2023-12-03T11:41:17.681 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 27%] 2023-12-03T11:41:25.221 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 27%] 2023-12-03T11:41:25.396 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 28%] 2023-12-03T11:41:25.569 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 28%] 2023-12-03T11:41:25.780 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 28%] 2023-12-03T11:41:25.953 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 28%] 2023-12-03T11:41:26.127 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 28%] 2023-12-03T11:41:26.301 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 28%] 2023-12-03T11:41:26.475 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 28%] 2023-12-03T11:41:26.649 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 29%] 2023-12-03T11:41:26.861 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 29%] 2023-12-03T11:41:27.034 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 29%] 2023-12-03T11:41:27.206 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 29%] 2023-12-03T11:41:27.379 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 29%] 2023-12-03T11:41:27.561 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 29%] 2023-12-03T11:41:27.743 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 30%] 2023-12-03T11:41:27.923 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 30%] 2023-12-03T11:41:28.141 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 30%] 2023-12-03T11:41:28.322 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2023-12-03T11:41:28.502 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 30%] 2023-12-03T11:41:28.682 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2023-12-03T11:41:28.860 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 30%] 2023-12-03T11:41:29.042 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2023-12-03T11:41:29.260 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 31%] 2023-12-03T11:41:29.482 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 31%] 2023-12-03T11:41:29.706 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 31%] 2023-12-03T11:41:29.885 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 31%] 2023-12-03T11:41:30.063 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 31%] 2023-12-03T11:41:30.242 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 31%] 2023-12-03T11:41:30.425 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 32%] 2023-12-03T11:41:30.504 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 32%] 2023-12-03T11:41:30.668 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 32%] 2023-12-03T11:41:31.144 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 32%] 2023-12-03T11:41:31.622 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 32%] 2023-12-03T11:41:31.801 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 32%] 2023-12-03T11:41:31.980 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 33%] 2023-12-03T11:41:32.197 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 33%] 2023-12-03T11:41:32.374 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 33%] 2023-12-03T11:41:32.599 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 33%] 2023-12-03T11:41:32.824 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 33%] 2023-12-03T11:41:33.005 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 33%] 2023-12-03T11:41:33.187 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 33%] 2023-12-03T11:41:33.406 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 34%] 2023-12-03T11:41:33.586 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 34%] 2023-12-03T11:41:33.767 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 34%] 2023-12-03T11:41:33.947 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 34%] 2023-12-03T11:41:34.295 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 34%] 2023-12-03T11:41:34.728 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 34%] 2023-12-03T11:41:34.846 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 34%] 2023-12-03T11:41:35.000 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 35%] 2023-12-03T11:41:35.113 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 35%] 2023-12-03T11:41:35.224 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 35%] 2023-12-03T11:41:35.266 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 35%] 2023-12-03T11:41:35.307 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 35%] 2023-12-03T11:41:35.348 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 35%] 2023-12-03T11:41:35.516 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 36%] 2023-12-03T11:41:35.695 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 36%] 2023-12-03T11:41:35.737 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 36%] 2023-12-03T11:41:35.933 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 36%] 2023-12-03T11:41:36.079 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 36%] 2023-12-03T11:41:36.192 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 36%] 2023-12-03T11:41:36.308 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 36%] 2023-12-03T11:41:36.641 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 37%] 2023-12-03T11:41:36.946 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 37%] 2023-12-03T11:41:37.252 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 37%] 2023-12-03T11:41:44.861 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 37%] 2023-12-03T11:41:52.502 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 37%] 2023-12-03T11:41:52.700 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 37%] 2023-12-03T11:41:52.858 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 38%] 2023-12-03T11:41:53.018 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 38%] 2023-12-03T11:41:53.179 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 38%] 2023-12-03T11:41:53.398 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 38%] 2023-12-03T11:41:53.562 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 38%] 2023-12-03T11:41:53.725 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 38%] 2023-12-03T11:41:53.901 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 38%] 2023-12-03T11:41:54.074 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 39%] 2023-12-03T11:41:54.312 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 39%] 2023-12-03T11:41:54.513 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 39%] 2023-12-03T11:41:54.673 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 39%] 2023-12-03T11:41:54.872 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 39%] 2023-12-03T11:41:54.981 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 39%] 2023-12-03T11:41:55.137 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 39%] 2023-12-03T11:41:55.292 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 40%] 2023-12-03T11:41:55.471 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 40%] 2023-12-03T11:41:55.634 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 40%] 2023-12-03T11:41:55.828 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 40%] 2023-12-03T11:41:55.986 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 40%] 2023-12-03T11:41:56.147 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 40%] 2023-12-03T11:41:56.347 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 41%] 2023-12-03T11:41:56.457 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 41%] 2023-12-03T11:41:56.570 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 41%] 2023-12-03T11:41:56.680 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 41%] 2023-12-03T11:41:56.790 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 41%] 2023-12-03T11:41:56.900 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 41%] 2023-12-03T11:41:57.046 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 41%] 2023-12-03T11:41:57.213 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 42%] 2023-12-03T11:41:57.322 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 42%] 2023-12-03T11:41:57.434 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 42%] 2023-12-03T11:41:57.545 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 42%] 2023-12-03T11:41:57.658 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 42%] 2023-12-03T11:41:57.844 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 42%] 2023-12-03T11:41:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 42%] 2023-12-03T11:41:58.064 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 43%] 2023-12-03T11:41:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 43%] 2023-12-03T11:41:58.324 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 43%] 2023-12-03T11:41:58.437 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 43%] 2023-12-03T11:41:58.547 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 43%] 2023-12-03T11:41:58.659 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 43%] 2023-12-03T11:41:58.853 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 44%] 2023-12-03T11:41:58.966 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 44%] 2023-12-03T11:41:59.169 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 44%] 2023-12-03T11:41:59.371 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 44%] 2023-12-03T11:41:59.572 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 44%] 2023-12-03T11:41:59.776 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 44%] 2023-12-03T11:41:59.978 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 44%] 2023-12-03T11:42:01.160 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 45%] 2023-12-03T11:42:01.373 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 45%] 2023-12-03T11:42:01.580 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 45%] 2023-12-03T11:42:01.842 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 45%] 2023-12-03T11:42:02.133 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 45%] 2023-12-03T11:42:02.429 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 45%] 2023-12-03T11:42:02.628 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 46%] 2023-12-03T11:42:02.880 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 46%] 2023-12-03T11:42:03.174 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 46%] 2023-12-03T11:42:03.386 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 46%] 2023-12-03T11:42:03.680 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 46%] 2023-12-03T11:42:03.844 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 46%] 2023-12-03T11:42:03.928 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 46%] 2023-12-03T11:42:04.050 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 47%] 2023-12-03T11:42:04.178 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 47%] 2023-12-03T11:42:04.292 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 47%] 2023-12-03T11:42:04.333 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 47%] 2023-12-03T11:42:04.524 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 47%] 2023-12-03T11:42:04.685 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 47%] 2023-12-03T11:42:04.846 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 47%] 2023-12-03T11:42:07.306 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 48%] 2023-12-03T11:42:07.471 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 48%] 2023-12-03T11:42:07.638 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 48%] 2023-12-03T11:42:07.802 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 48%] 2023-12-03T11:42:07.965 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 48%] 2023-12-03T11:42:08.089 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 48%] 2023-12-03T11:42:08.256 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 49%] 2023-12-03T11:42:08.420 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 49%] 2023-12-03T11:42:08.585 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 49%] 2023-12-03T11:42:08.790 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 49%] 2023-12-03T11:42:08.953 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 49%] 2023-12-03T11:42:09.115 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 49%] 2023-12-03T11:42:09.286 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 49%] 2023-12-03T11:42:09.459 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 50%] 2023-12-03T11:42:09.623 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 50%] 2023-12-03T11:42:09.787 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 50%] 2023-12-03T11:42:09.831 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 50%] 2023-12-03T11:42:09.913 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 50%] 2023-12-03T11:42:09.955 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 50%] 2023-12-03T11:42:10.066 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 50%] 2023-12-03T11:42:10.174 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 51%] 2023-12-03T11:42:10.282 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 51%] 2023-12-03T11:42:10.389 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 51%] 2023-12-03T11:42:10.541 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 51%] 2023-12-03T11:42:10.585 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 51%] 2023-12-03T11:42:10.626 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 51%] 2023-12-03T11:42:10.735 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 52%] 2023-12-03T11:42:10.777 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 52%] 2023-12-03T11:42:10.818 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 52%] 2023-12-03T11:42:10.860 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 52%] 2023-12-03T11:42:10.902 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 52%] 2023-12-03T11:42:11.018 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 52%] 2023-12-03T11:42:11.168 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 52%] 2023-12-03T11:42:11.283 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 53%] 2023-12-03T11:42:11.435 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 53%] 2023-12-03T11:42:11.623 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 53%] 2023-12-03T11:42:11.735 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 53%] 2023-12-03T11:42:11.885 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 53%] 2023-12-03T11:42:12.080 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 53%] 2023-12-03T11:42:12.229 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 53%] 2023-12-03T11:42:12.380 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 54%] 2023-12-03T11:42:12.584 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 54%] 2023-12-03T11:42:12.786 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 54%] 2023-12-03T11:42:13.038 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 54%] 2023-12-03T11:42:13.239 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 54%] 2023-12-03T11:42:13.481 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 54%] 2023-12-03T11:42:13.734 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 55%] 2023-12-03T11:42:13.990 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 55%] 2023-12-03T11:42:14.206 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 55%] 2023-12-03T11:42:14.381 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 55%] 2023-12-03T11:42:14.493 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 55%] 2023-12-03T11:42:14.743 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 55%] 2023-12-03T11:42:14.996 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 55%] 2023-12-03T11:42:15.288 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 56%] 2023-12-03T11:42:15.537 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 56%] 2023-12-03T11:42:15.793 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 56%] 2023-12-03T11:42:16.035 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 56%] 2023-12-03T11:42:16.227 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 56%] 2023-12-03T11:42:16.416 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 56%] 2023-12-03T11:42:16.657 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 57%] 2023-12-03T11:42:16.888 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 57%] 2023-12-03T11:42:17.009 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 57%] 2023-12-03T11:42:17.238 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_no_grants PASSED [ 57%] 2023-12-03T11:42:17.441 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 57%] 2023-12-03T11:42:17.653 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 57%] 2023-12-03T11:42:17.819 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 57%] 2023-12-03T11:42:17.939 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 58%] 2023-12-03T11:42:18.234 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 58%] 2023-12-03T11:42:18.563 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 58%] 2023-12-03T11:42:18.896 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 58%] 2023-12-03T11:42:19.224 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 58%] 2023-12-03T11:42:19.557 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 58%] 2023-12-03T11:42:19.930 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 58%] 2023-12-03T11:42:20.263 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 59%] 2023-12-03T11:42:20.596 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 59%] 2023-12-03T11:42:20.930 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 59%] 2023-12-03T11:42:21.265 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 59%] 2023-12-03T11:42:21.601 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 59%] 2023-12-03T11:42:21.892 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 59%] 2023-12-03T11:42:22.190 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 60%] 2023-12-03T11:42:22.614 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 60%] 2023-12-03T11:42:23.029 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 60%] 2023-12-03T11:42:23.065 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 60%] 2023-12-03T11:42:23.106 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 60%] 2023-12-03T11:42:23.147 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 60%] 2023-12-03T11:42:23.266 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 60%] 2023-12-03T11:42:23.387 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 61%] 2023-12-03T11:42:23.493 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 61%] 2023-12-03T11:42:23.603 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 61%] 2023-12-03T11:42:23.839 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 61%] 2023-12-03T11:42:24.603 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 61%] 2023-12-03T11:42:24.798 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 61%] 2023-12-03T11:42:25.020 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 61%] 2023-12-03T11:42:25.378 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 62%] 2023-12-03T11:42:25.634 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 62%] 2023-12-03T11:42:25.928 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 62%] 2023-12-03T11:42:26.139 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 62%] 2023-12-03T11:42:26.353 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 62%] 2023-12-03T11:42:26.720 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 62%] 2023-12-03T11:42:26.951 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 63%] 2023-12-03T11:42:27.187 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 63%] 2023-12-03T11:42:27.451 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 63%] 2023-12-03T11:42:27.936 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 63%] 2023-12-03T11:42:28.333 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 63%] 2023-12-03T11:42:28.448 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 63%] 2023-12-03T11:42:28.563 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 63%] 2023-12-03T11:42:29.450 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 64%] 2023-12-03T11:42:29.726 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 64%] 2023-12-03T11:42:31.197 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 64%] 2023-12-03T11:42:31.225 INFO:tasks.rgw.client.0.smithi131.stdout:*** Caught signal (Segmentation fault) ** 2023-12-03T11:42:31.225 INFO:tasks.rgw.client.0.smithi131.stdout: in thread 7f6a0e566640 thread_name:radosgw 2023-12-03T11:42:31.225 INFO:tasks.rgw.client.0.smithi131.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:42:31.225 INFO:tasks.rgw.client.0.smithi131.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f6ac7a54db0] 2023-12-03T11:42:31.225 INFO:tasks.rgw.client.0.smithi131.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x55c7b870f66a] 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x55c7b85a4fb1] 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x55c7b85a8a75] 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: 5: radosgw(+0xc724b0) [0x55c7b8d9c4b0] 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: 6: radosgw(+0x3cf496) [0x55c7b84f9496] 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: 7: make_fcontext() 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout:2023-12-03T11:42:31.224+0000 7f6a0e566640 -1 *** Caught signal (Segmentation fault) ** 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: in thread 7f6a0e566640 thread_name:radosgw 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f6ac7a54db0] 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x55c7b870f66a] 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x55c7b85a4fb1] 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x55c7b85a8a75] 2023-12-03T11:42:31.226 INFO:tasks.rgw.client.0.smithi131.stdout: 5: radosgw(+0xc724b0) [0x55c7b8d9c4b0] 2023-12-03T11:42:31.227 INFO:tasks.rgw.client.0.smithi131.stdout: 6: radosgw(+0x3cf496) [0x55c7b84f9496] 2023-12-03T11:42:31.227 INFO:tasks.rgw.client.0.smithi131.stdout: 7: make_fcontext() 2023-12-03T11:42:31.227 INFO:tasks.rgw.client.0.smithi131.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:42:31.227 INFO:tasks.rgw.client.0.smithi131.stdout: 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: 0> 2023-12-03T11:42:31.224+0000 7f6a0e566640 -1 *** Caught signal (Segmentation fault) ** 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: in thread 7f6a0e566640 thread_name:radosgw 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f6ac7a54db0] 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x55c7b870f66a] 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x55c7b85a4fb1] 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x55c7b85a8a75] 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: 5: radosgw(+0xc724b0) [0x55c7b8d9c4b0] 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: 6: radosgw(+0x3cf496) [0x55c7b84f9496] 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: 7: make_fcontext() 2023-12-03T11:42:31.235 INFO:tasks.rgw.client.0.smithi131.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:42:31.236 INFO:tasks.rgw.client.0.smithi131.stdout: 2023-12-03T11:42:31.246 INFO:tasks.rgw.client.0.smithi131.stdout: 0> 2023-12-03T11:42:31.224+0000 7f6a0e566640 -1 *** Caught signal (Segmentation fault) ** 2023-12-03T11:42:31.246 INFO:tasks.rgw.client.0.smithi131.stdout: in thread 7f6a0e566640 thread_name:radosgw 2023-12-03T11:42:31.246 INFO:tasks.rgw.client.0.smithi131.stdout: 2023-12-03T11:42:31.246 INFO:tasks.rgw.client.0.smithi131.stdout: ceph version 18.0.0-7537-gbcbf278c (bcbf278cf395873c2a482f5a7b2345faf2160319) reef (dev) 2023-12-03T11:42:31.246 INFO:tasks.rgw.client.0.smithi131.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7f6ac7a54db0] 2023-12-03T11:42:31.246 INFO:tasks.rgw.client.0.smithi131.stdout: 2: (RGWCompleteMultipart::complete()+0x4a) [0x55c7b870f66a] 2023-12-03T11:42:31.246 INFO:tasks.rgw.client.0.smithi131.stdout: 3: (rgw_process_authenticated(RGWHandler_REST*, RGWOp*&, RGWRequest*, req_state*, optional_yield, rgw::sal::Driver*, bool)+0xb91) [0x55c7b85a4fb1] 2023-12-03T11:42:31.246 INFO:tasks.rgw.client.0.smithi131.stdout: 4: (process_request(RGWProcessEnv const&, RGWRequest*, std::__cxx11::basic_string, std::allocator > const&, RGWRestfulIO*, optional_yield, rgw::dmclock::Scheduler*, std::__cxx11::basic_string, std::allocator >*, std::chrono::duration >*, int*)+0xf75) [0x55c7b85a8a75] 2023-12-03T11:42:31.246 INFO:tasks.rgw.client.0.smithi131.stdout: 5: radosgw(+0xc724b0) [0x55c7b8d9c4b0] 2023-12-03T11:42:31.247 INFO:tasks.rgw.client.0.smithi131.stdout: 6: radosgw(+0x3cf496) [0x55c7b84f9496] 2023-12-03T11:42:31.247 INFO:tasks.rgw.client.0.smithi131.stdout: 7: make_fcontext() 2023-12-03T11:42:31.247 INFO:tasks.rgw.client.0.smithi131.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-03T11:42:31.247 INFO:tasks.rgw.client.0.smithi131.stdout: 2023-12-03T11:42:31.371 INFO:tasks.rgw.client.0.smithi131.stderr:daemon-helper: command crashed with signal 11 2023-12-03T11:42:37.179 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2023-12-03T11:42:43.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~6s 2023-12-03T11:42:46.956 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty FAILED [ 64%] 2023-12-03T11:42:46.956 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty ERROR [ 64%] 2023-12-03T11:42:49.800 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~13s 2023-12-03T11:42:56.110 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~19s 2023-12-03T11:42:58.415 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small FAILED [ 64%] 2023-12-03T11:42:58.415 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small ERROR [ 64%] 2023-12-03T11:43:02.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~25s 2023-12-03T11:43:08.615 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small FAILED [ 64%] 2023-12-03T11:43:08.616 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small ERROR [ 64%] 2023-12-03T11:43:08.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~32s 2023-12-03T11:43:15.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~38s 2023-12-03T11:43:21.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~44s 2023-12-03T11:43:26.135 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range FAILED [ 65%] 2023-12-03T11:43:26.135 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range ERROR [ 65%] 2023-12-03T11:43:27.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~50s 2023-12-03T11:43:33.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~57s 2023-12-03T11:43:40.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~63s 2023-12-03T11:43:43.281 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range FAILED [ 65%] 2023-12-03T11:43:43.281 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range ERROR [ 65%] 2023-12-03T11:43:46.597 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~69s 2023-12-03T11:43:51.929 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names FAILED [ 65%] 2023-12-03T11:43:51.930 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names ERROR [ 65%] 2023-12-03T11:43:52.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~76s 2023-12-03T11:43:59.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~82s 2023-12-03T11:44:05.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~88s 2023-12-03T11:44:09.712 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload FAILED [ 65%] 2023-12-03T11:44:09.712 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload ERROR [ 65%] 2023-12-03T11:44:11.838 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~95s 2023-12-03T11:44:18.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~101s 2023-12-03T11:44:24.459 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~107s 2023-12-03T11:44:27.631 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned FAILED [ 65%] 2023-12-03T11:44:27.631 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned ERROR [ 65%] 2023-12-03T11:44:30.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~114s 2023-12-03T11:44:37.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~120s 2023-12-03T11:44:43.393 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~126s 2023-12-03T11:44:46.858 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part FAILED [ 65%] 2023-12-03T11:44:46.858 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part ERROR [ 65%] 2023-12-03T11:44:49.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~133s 2023-12-03T11:44:56.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~139s 2023-12-03T11:45:02.323 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~145s 2023-12-03T11:45:08.411 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes FAILED [ 65%] 2023-12-03T11:45:08.411 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes ERROR [ 65%] 2023-12-03T11:45:08.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~151s 2023-12-03T11:45:14.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~158s 2023-12-03T11:45:21.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~164s 2023-12-03T11:45:26.390 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes FAILED [ 66%] 2023-12-03T11:45:26.390 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes ERROR [ 66%] 2023-12-03T11:45:27.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~170s 2023-12-03T11:45:33.872 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~177s 2023-12-03T11:45:40.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~183s 2023-12-03T11:45:44.729 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small FAILED [ 66%] 2023-12-03T11:45:44.729 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small ERROR [ 66%] 2023-12-03T11:45:46.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~189s 2023-12-03T11:45:52.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~196s 2023-12-03T11:45:59.116 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~202s 2023-12-03T11:45:59.717 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents FAILED [ 66%] 2023-12-03T11:45:59.717 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents ERROR [ 66%] 2023-12-03T11:46:05.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~208s 2023-12-03T11:46:10.780 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object FAILED [ 66%] 2023-12-03T11:46:10.781 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object ERROR [ 66%] 2023-12-03T11:46:11.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~215s 2023-12-03T11:46:18.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~221s 2023-12-03T11:46:24.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~227s 2023-12-03T11:46:30.653 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload FAILED [ 66%] 2023-12-03T11:46:30.653 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload ERROR [ 66%] 2023-12-03T11:46:30.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~233s 2023-12-03T11:46:36.980 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~240s 2023-12-03T11:46:43.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~246s 2023-12-03T11:46:45.048 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found FAILED [ 66%] 2023-12-03T11:46:45.048 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found ERROR [ 66%] 2023-12-03T11:46:49.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~252s 2023-12-03T11:46:55.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~259s 2023-12-03T11:47:02.224 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~265s 2023-12-03T11:47:04.959 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload FAILED [ 66%] 2023-12-03T11:47:04.959 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload ERROR [ 66%] 2023-12-03T11:47:08.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~271s 2023-12-03T11:47:14.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~278s 2023-12-03T11:47:21.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~284s 2023-12-03T11:47:24.194 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner FAILED [ 67%] 2023-12-03T11:47:24.194 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner ERROR [ 67%] 2023-12-03T11:47:27.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~290s 2023-12-03T11:47:33.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~297s 2023-12-03T11:47:40.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~303s 2023-12-03T11:47:40.091 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-12-03T11:47:41.400 INFO:tasks.ceph.osd.0:Sent signal 15 2023-12-03T11:47:41.400 INFO:tasks.ceph.osd.1:Sent signal 15 2023-12-03T11:47:41.401 INFO:tasks.ceph.osd.2:Sent signal 15 2023-12-03T11:47:41.401 INFO:tasks.ceph.osd.3:Sent signal 15 2023-12-03T11:47:41.401 INFO:tasks.ceph.osd.4:Sent signal 15 2023-12-03T11:47:41.402 INFO:tasks.ceph.osd.5:Sent signal 15 2023-12-03T11:47:41.402 INFO:tasks.ceph.osd.6:Sent signal 15 2023-12-03T11:47:41.402 INFO:tasks.ceph.osd.7:Sent signal 15 2023-12-03T11:47:41.402 INFO:tasks.ceph.mon.a:Sent signal 15 2023-12-03T11:47:41.403 INFO:tasks.ceph.mon.c:Sent signal 15 2023-12-03T11:47:41.403 INFO:tasks.ceph.mon.b:Sent signal 15 2023-12-03T11:47:41.403 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-12-03T11:47:41.403 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-12-03T11:47:41.404 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-12-03T11:47:41.401+0000 7fe246db0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 83834) UID: 0 2023-12-03T11:47:41.404 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-12-03T11:47:41.401+0000 7fe246db0640 -1 osd.4 256 *** Got signal Terminated *** 2023-12-03T11:47:41.405 INFO:tasks.ceph.osd.4.smithi148.stderr:2023-12-03T11:47:41.401+0000 7fe246db0640 -1 osd.4 256 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:47:41.405 INFO:tasks.ceph.osd.0.smithi131.stderr:2023-12-03T11:47:41.399+0000 7f22f8bd5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 83843) UID: 0 2023-12-03T11:47:41.405 INFO:tasks.ceph.osd.0.smithi131.stderr:2023-12-03T11:47:41.399+0000 7f22f8bd5640 -1 osd.0 256 *** Got signal Terminated *** 2023-12-03T11:47:41.405 INFO:tasks.ceph.osd.0.smithi131.stderr:2023-12-03T11:47:41.399+0000 7f22f8bd5640 -1 osd.0 256 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:47:41.406 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-12-03T11:47:41.401+0000 7f3b2ef46640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 83838) UID: 0 2023-12-03T11:47:41.406 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-12-03T11:47:41.401+0000 7f3b2ef46640 -1 osd.5 256 *** Got signal Terminated *** 2023-12-03T11:47:41.406 INFO:tasks.ceph.osd.5.smithi148.stderr:2023-12-03T11:47:41.401+0000 7f3b2ef46640 -1 osd.5 256 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:47:41.406 INFO:tasks.ceph.osd.1.smithi131.stderr:2023-12-03T11:47:41.399+0000 7fd565c27640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 83847) UID: 0 2023-12-03T11:47:41.407 INFO:tasks.ceph.osd.1.smithi131.stderr:2023-12-03T11:47:41.399+0000 7fd565c27640 -1 osd.1 256 *** Got signal Terminated *** 2023-12-03T11:47:41.407 INFO:tasks.ceph.osd.1.smithi131.stderr:2023-12-03T11:47:41.399+0000 7fd565c27640 -1 osd.1 256 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:47:41.407 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-12-03T11:47:41.401+0000 7f932c362640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 83837) UID: 0 2023-12-03T11:47:41.407 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-12-03T11:47:41.401+0000 7f932c362640 -1 osd.6 256 *** Got signal Terminated *** 2023-12-03T11:47:41.407 INFO:tasks.ceph.osd.6.smithi148.stderr:2023-12-03T11:47:41.401+0000 7f932c362640 -1 osd.6 256 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:47:41.408 INFO:tasks.ceph.osd.2.smithi131.stderr:2023-12-03T11:47:41.399+0000 7f8708671640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 83856) UID: 0 2023-12-03T11:47:41.408 INFO:tasks.ceph.osd.2.smithi131.stderr:2023-12-03T11:47:41.399+0000 7f8708671640 -1 osd.2 256 *** Got signal Terminated *** 2023-12-03T11:47:41.408 INFO:tasks.ceph.osd.2.smithi131.stderr:2023-12-03T11:47:41.399+0000 7f8708671640 -1 osd.2 256 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:47:41.409 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-03T11:47:41.402+0000 7f466fac7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 83841) UID: 0 2023-12-03T11:47:41.409 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-03T11:47:41.402+0000 7f466fac7640 -1 osd.7 256 *** Got signal Terminated *** 2023-12-03T11:47:41.409 INFO:tasks.ceph.osd.7.smithi148.stderr:2023-12-03T11:47:41.402+0000 7f466fac7640 -1 osd.7 256 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:47:41.409 INFO:tasks.ceph.osd.3.smithi131.stderr:2023-12-03T11:47:41.400+0000 7f314d800640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 83861) UID: 0 2023-12-03T11:47:41.410 INFO:tasks.ceph.osd.3.smithi131.stderr:2023-12-03T11:47:41.400+0000 7f314d800640 -1 osd.3 256 *** Got signal Terminated *** 2023-12-03T11:47:41.410 INFO:tasks.ceph.osd.3.smithi131.stderr:2023-12-03T11:47:41.400+0000 7f314d800640 -1 osd.3 256 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-03T11:47:41.410 INFO:tasks.ceph.mon.b.smithi148.stderr:2023-12-03T11:47:41.402+0000 7fc18df59640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 83307) UID: 0 2023-12-03T11:47:41.410 INFO:tasks.ceph.mon.b.smithi148.stderr:2023-12-03T11:47:41.402+0000 7fc18df59640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-03T11:47:41.410 INFO:tasks.ceph.mon.a.smithi131.stderr:2023-12-03T11:47:41.401+0000 7feb9ac22640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 83533) UID: 0 2023-12-03T11:47:41.410 INFO:tasks.ceph.mon.a.smithi131.stderr:2023-12-03T11:47:41.401+0000 7feb9ac22640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-03T11:47:41.411 INFO:tasks.ceph.mon.c.smithi131.stderr:2023-12-03T11:47:41.401+0000 7fcff3a22640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 83535) UID: 0 2023-12-03T11:47:41.411 INFO:tasks.ceph.mon.c.smithi131.stderr:2023-12-03T11:47:41.401+0000 7fcff3a22640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-12-03T11:47:41.605 INFO:tasks.ceph.mgr.y.smithi131.stderr:daemon-helper: command crashed with signal 15 2023-12-03T11:47:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part FAILED [ 67%] 2023-12-03T11:47:42.524 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part ERROR [ 67%] 2023-12-03T11:47:59.036 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag FAILED [ 67%] 2023-12-03T11:47:59.036 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag ERROR [ 67%] 2023-12-03T11:48:14.135 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part FAILED [ 67%] 2023-12-03T11:48:14.135 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part ERROR [ 67%] 2023-12-03T11:48:33.094 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part FAILED [ 67%] 2023-12-03T11:48:33.094 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part ERROR [ 67%] 2023-12-03T11:48:50.500 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue FAILED [ 67%] 2023-12-03T11:48:50.501 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue ERROR [ 67%] 2023-12-03T11:49:08.521 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors FAILED [ 68%] 2023-12-03T11:49:08.521 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors ERROR [ 68%] 2023-12-03T11:49:28.554 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response FAILED [ 68%] 2023-12-03T11:49:28.555 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response ERROR [ 68%] 2023-12-03T11:49:37.596 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard FAILED [ 68%] 2023-12-03T11:49:37.596 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard ERROR [ 68%] 2023-12-03T11:49:56.839 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option FAILED [ 68%] 2023-12-03T11:49:56.839 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option ERROR [ 68%] 2023-12-03T11:50:10.877 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object FAILED [ 68%] 2023-12-03T11:50:10.877 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object ERROR [ 68%] 2023-12-03T11:50:26.238 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant FAILED [ 68%] 2023-12-03T11:50:26.238 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant ERROR [ 68%] 2023-12-03T11:50:48.523 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging FAILED [ 68%] 2023-12-03T11:50:48.523 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging ERROR [ 68%] 2023-12-03T11:51:13.044 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb FAILED [ 69%] 2023-12-03T11:51:13.045 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb ERROR [ 69%] 2023-12-03T11:51:28.485 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb FAILED [ 69%] 2023-12-03T11:51:28.485 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb ERROR [ 69%] 2023-12-03T11:51:35.709 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb FAILED [ 69%] 2023-12-03T11:51:35.709 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb ERROR [ 69%] 2023-12-03T11:51:53.143 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb FAILED [ 69%] 2023-12-03T11:51:53.143 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb ERROR [ 69%] 2023-12-03T11:52:14.117 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb FAILED [ 69%] 2023-12-03T11:52:14.117 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb ERROR [ 69%] 2023-12-03T11:52:31.868 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb FAILED [ 69%] 2023-12-03T11:52:31.868 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb ERROR [ 69%] 2023-12-03T11:52:45.126 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb FAILED [ 69%] 2023-12-03T11:52:45.126 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb ERROR [ 69%] 2023-12-03T11:53:04.735 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb FAILED [ 70%] 2023-12-03T11:53:04.735 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb ERROR [ 70%] 2023-12-03T11:53:20.681 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb FAILED [ 70%] 2023-12-03T11:53:20.681 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb ERROR [ 70%] 2023-12-03T11:53:37.073 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb FAILED [ 70%] 2023-12-03T11:53:37.073 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb ERROR [ 70%] 2023-12-03T11:53:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write FAILED [ 70%] 2023-12-03T11:53:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write ERROR [ 70%] 2023-12-03T11:54:13.271 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last FAILED [ 70%] 2023-12-03T11:54:13.272 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last ERROR [ 70%] 2023-12-03T11:54:29.509 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code FAILED [ 70%] 2023-12-03T11:54:29.509 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code ERROR [ 70%] 2023-12-03T11:54:49.960 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code FAILED [ 71%] 2023-12-03T11:54:49.960 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code ERROR [ 71%] 2023-12-03T11:55:04.880 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code FAILED [ 71%] 2023-12-03T11:55:04.880 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code ERROR [ 71%] 2023-12-03T11:55:19.522 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code FAILED [ 71%] 2023-12-03T11:55:19.523 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code ERROR [ 71%] 2023-12-03T11:55:33.342 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range FAILED [ 71%] 2023-12-03T11:55:33.342 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range ERROR [ 71%] 2023-12-03T11:55:50.492 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object FAILED [ 71%] 2023-12-03T11:55:50.492 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object ERROR [ 71%] 2023-12-03T11:55:57.613 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend FAILED [ 71%] 2023-12-03T11:55:57.613 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend ERROR [ 71%] 2023-12-03T11:56:15.632 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove FAILED [ 71%] 2023-12-03T11:56:15.632 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove ERROR [ 71%] 2023-12-03T11:56:41.473 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head FAILED [ 72%] 2023-12-03T11:56:41.473 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head ERROR [ 72%] 2023-12-03T11:57:03.160 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal FAILED [ 72%] 2023-12-03T11:57:03.160 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal ERROR [ 72%] 2023-12-03T11:57:24.793 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite FAILED [ 72%] 2023-12-03T11:57:24.793 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite ERROR [ 72%] 2023-12-03T11:57:41.556 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended FAILED [ 72%] 2023-12-03T11:57:41.556 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended ERROR [ 72%] 2023-12-03T11:57:49.071 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions FAILED [ 72%] 2023-12-03T11:57:49.071 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions ERROR [ 72%] 2023-12-03T11:58:00.885 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all FAILED [ 72%] 2023-12-03T11:58:00.885 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all ERROR [ 72%] 2023-12-03T11:58:16.752 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names FAILED [ 73%] 2023-12-03T11:58:16.753 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names ERROR [ 73%] 2023-12-03T11:58:27.260 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart FAILED [ 73%] 2023-12-03T11:58:27.260 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart ERROR [ 73%] 2023-12-03T11:58:36.281 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker FAILED [ 73%] 2023-12-03T11:58:36.281 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker ERROR [ 73%] 2023-12-03T11:58:49.853 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version FAILED [ 73%] 2023-12-03T11:58:49.853 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version ERROR [ 73%] 2023-12-03T11:59:02.050 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete FAILED [ 73%] 2023-12-03T11:59:02.050 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete ERROR [ 73%] 2023-12-03T11:59:13.199 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker FAILED [ 73%] 2023-12-03T11:59:13.200 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker ERROR [ 73%] 2023-12-03T11:59:33.452 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create FAILED [ 73%] 2023-12-03T11:59:33.452 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create ERROR [ 73%] 2023-12-03T11:59:48.794 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl FAILED [ 74%] 2023-12-03T11:59:48.794 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl ERROR [ 74%] 2023-12-03T12:00:07.096 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified FAILED [ 74%] 2023-12-03T12:00:07.096 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified ERROR [ 74%] 2023-12-03T12:00:29.987 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove FAILED [ 74%] 2023-12-03T12:00:29.987 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove ERROR [ 74%] 2023-12-03T12:00:46.420 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set FAILED [ 74%] 2023-12-03T12:00:46.420 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set ERROR [ 74%] 2023-12-03T12:00:57.744 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get FAILED [ 74%] 2023-12-03T12:00:57.744 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get ERROR [ 74%] 2023-12-03T12:01:12.792 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id FAILED [ 74%] 2023-12-03T12:01:12.792 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id ERROR [ 74%] 2023-12-03T12:01:22.202 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long FAILED [ 74%] 2023-12-03T12:01:22.202 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long ERROR [ 74%] 2023-12-03T12:01:34.743 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id FAILED [ 75%] 2023-12-03T12:01:34.743 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id ERROR [ 75%] 2023-12-03T12:01:47.752 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status FAILED [ 75%] 2023-12-03T12:01:47.752 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status ERROR [ 75%] 2023-12-03T12:02:07.353 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date FAILED [ 75%] 2023-12-03T12:02:07.353 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date ERROR [ 75%] 2023-12-03T12:02:24.383 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date FAILED [ 75%] 2023-12-03T12:02:24.383 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date ERROR [ 75%] 2023-12-03T12:02:37.856 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent FAILED [ 75%] 2023-12-03T12:02:37.856 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent ERROR [ 75%] 2023-12-03T12:02:45.822 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker FAILED [ 75%] 2023-12-03T12:02:45.822 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker ERROR [ 75%] 2023-12-03T12:02:52.291 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter FAILED [ 76%] 2023-12-03T12:02:52.291 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter ERROR [ 76%] 2023-12-03T12:03:07.787 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter FAILED [ 76%] 2023-12-03T12:03:07.787 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter ERROR [ 76%] 2023-12-03T12:03:25.259 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart FAILED [ 76%] 2023-12-03T12:03:25.259 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart ERROR [ 76%] 2023-12-03T12:03:38.886 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date FAILED [ 76%] 2023-12-03T12:03:38.886 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date ERROR [ 76%] 2023-12-03T12:04:03.644 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b FAILED [ 76%] 2023-12-03T12:04:03.644 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b ERROR [ 76%] 2023-12-03T12:04:13.663 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb FAILED [ 76%] 2023-12-03T12:04:13.663 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb ERROR [ 76%] 2023-12-03T12:04:21.437 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB FAILED [ 76%] 2023-12-03T12:04:21.437 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB ERROR [ 76%] 2023-12-03T12:04:39.339 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b FAILED [ 77%] 2023-12-03T12:04:39.339 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b ERROR [ 77%] 2023-12-03T12:05:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head FAILED [ 77%] 2023-12-03T12:05:00.412 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head ERROR [ 77%] 2023-12-03T12:05:17.667 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present FAILED [ 77%] 2023-12-03T12:05:17.667 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present ERROR [ 77%] 2023-12-03T12:05:34.232 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key FAILED [ 77%] 2023-12-03T12:05:34.232 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key ERROR [ 77%] 2023-12-03T12:05:52.137 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 FAILED [ 77%] 2023-12-03T12:05:52.137 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 ERROR [ 77%] 2023-12-03T12:06:01.049 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 FAILED [ 77%] 2023-12-03T12:06:01.049 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 ERROR [ 77%] 2023-12-03T12:06:14.801 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key FAILED [ 77%] 2023-12-03T12:06:14.801 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key ERROR [ 77%] 2023-12-03T12:06:32.496 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c FAILED [ 78%] 2023-12-03T12:06:32.496 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c ERROR [ 78%] 2023-12-03T12:06:46.996 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload FAILED [ 78%] 2023-12-03T12:06:46.996 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload ERROR [ 78%] 2023-12-03T12:07:03.172 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload FAILED [ 78%] 2023-12-03T12:07:03.172 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload ERROR [ 78%] 2023-12-03T12:07:18.771 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download FAILED [ 78%] 2023-12-03T12:07:18.771 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download ERROR [ 78%] 2023-12-03T12:07:40.457 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request FAILED [ 78%] 2023-12-03T12:07:40.457 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request ERROR [ 78%] 2023-12-03T12:07:55.262 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head FAILED [ 78%] 2023-12-03T12:07:55.262 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head ERROR [ 78%] 2023-12-03T12:08:06.719 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present FAILED [ 79%] 2023-12-03T12:08:06.720 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present ERROR [ 79%] 2023-12-03T12:08:14.246 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key FAILED [ 79%] 2023-12-03T12:08:14.247 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key ERROR [ 79%] 2023-12-03T12:08:30.271 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared FAILED [ 79%] 2023-12-03T12:08:30.271 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared ERROR [ 79%] 2023-12-03T12:08:41.251 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload FAILED [ 79%] 2023-12-03T12:08:41.252 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload ERROR [ 79%] 2023-12-03T12:08:50.773 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 FAILED [ 79%] 2023-12-03T12:08:50.774 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 ERROR [ 79%] 2023-12-03T12:09:05.870 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 FAILED [ 79%] 2023-12-03T12:09:05.871 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 ERROR [ 79%] 2023-12-03T12:09:24.370 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request FAILED [ 79%] 2023-12-03T12:09:24.371 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request ERROR [ 79%] 2023-12-03T12:09:37.495 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b FAILED [ 80%] 2023-12-03T12:09:37.496 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b ERROR [ 80%] 2023-12-03T12:09:51.724 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb FAILED [ 80%] 2023-12-03T12:09:51.724 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb ERROR [ 80%] 2023-12-03T12:10:10.626 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB FAILED [ 80%] 2023-12-03T12:10:10.627 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB ERROR [ 80%] 2023-12-03T12:10:18.022 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b FAILED [ 80%] 2023-12-03T12:10:18.023 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b ERROR [ 80%] 2023-12-03T12:10:32.914 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare FAILED [ 80%] 2023-12-03T12:10:32.914 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare ERROR [ 80%] 2023-12-03T12:10:45.913 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy FAILED [ 80%] 2023-12-03T12:10:45.914 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy ERROR [ 80%] 2023-12-03T12:11:02.127 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy FAILED [ 80%] 2023-12-03T12:11:02.128 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy ERROR [ 80%] 2023-12-03T12:11:17.268 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl FAILED [ 81%] 2023-12-03T12:11:17.269 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl ERROR [ 81%] 2023-12-03T12:11:32.498 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl FAILED [ 81%] 2023-12-03T12:11:32.498 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl ERROR [ 81%] 2023-12-03T12:11:55.205 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket FAILED [ 81%] 2023-12-03T12:11:55.206 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket ERROR [ 81%] 2023-12-03T12:12:16.657 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket FAILED [ 81%] 2023-12-03T12:12:16.658 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket ERROR [ 81%] 2023-12-03T12:12:26.276 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging FAILED [ 81%] 2023-12-03T12:12:26.277 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging ERROR [ 81%] 2023-12-03T12:12:40.921 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging FAILED [ 81%] 2023-12-03T12:12:40.921 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging ERROR [ 81%] 2023-12-03T12:12:55.800 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags FAILED [ 82%] 2023-12-03T12:12:55.800 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags ERROR [ 82%] 2023-12-03T12:13:22.016 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags FAILED [ 82%] 2023-12-03T12:13:22.016 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags ERROR [ 82%] 2023-12-03T12:13:32.936 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags FAILED [ 82%] 2023-12-03T12:13:32.936 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags ERROR [ 82%] 2023-12-03T12:13:51.206 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags FAILED [ 82%] 2023-12-03T12:13:51.207 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags ERROR [ 82%] 2023-12-03T12:14:01.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags FAILED [ 82%] 2023-12-03T12:14:01.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags ERROR [ 82%] 2023-12-03T12:14:25.481 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags FAILED [ 82%] 2023-12-03T12:14:25.482 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags ERROR [ 82%] 2023-12-03T12:14:46.570 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags FAILED [ 82%] 2023-12-03T12:14:46.570 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags ERROR [ 82%] 2023-12-03T12:15:03.305 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request FAILED [ 83%] 2023-12-03T12:15:03.305 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request ERROR [ 83%] 2023-12-03T12:15:20.874 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request FAILED [ 83%] 2023-12-03T12:15:20.874 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request ERROR [ 83%] 2023-12-03T12:15:40.225 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags FAILED [ 83%] 2023-12-03T12:15:40.225 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags ERROR [ 83%] 2023-12-03T12:15:56.117 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public FAILED [ 83%] 2023-12-03T12:15:56.117 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public ERROR [ 83%] 2023-12-03T12:16:09.149 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public FAILED [ 83%] 2023-12-03T12:16:09.149 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public ERROR [ 83%] 2023-12-03T12:16:24.131 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public FAILED [ 83%] 2023-12-03T12:16:24.132 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public ERROR [ 83%] 2023-12-03T12:16:44.022 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id FAILED [ 84%] 2023-12-03T12:16:44.023 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id ERROR [ 84%] 2023-12-03T12:16:57.399 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id FAILED [ 84%] 2023-12-03T12:16:57.399 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id ERROR [ 84%] 2023-12-03T12:17:16.208 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag FAILED [ 84%] 2023-12-03T12:17:16.208 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag ERROR [ 84%] 2023-12-03T12:17:36.798 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag FAILED [ 84%] 2023-12-03T12:17:36.798 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag ERROR [ 84%] 2023-12-03T12:17:47.634 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag FAILED [ 84%] 2023-12-03T12:17:47.635 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag ERROR [ 84%] 2023-12-03T12:18:07.494 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source FAILED [ 84%] 2023-12-03T12:18:07.494 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source ERROR [ 84%] 2023-12-03T12:18:20.328 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta FAILED [ 84%] 2023-12-03T12:18:20.328 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta ERROR [ 84%] 2023-12-03T12:18:38.286 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl FAILED [ 85%] 2023-12-03T12:18:38.286 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl ERROR [ 85%] 2023-12-03T12:18:54.310 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant FAILED [ 85%] 2023-12-03T12:18:54.311 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant ERROR [ 85%] 2023-12-03T12:19:06.255 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 FAILED [ 85%] 2023-12-03T12:19:06.256 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 ERROR [ 85%] 2023-12-03T12:19:24.908 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms FAILED [ 85%] 2023-12-03T12:19:24.908 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms ERROR [ 85%] 2023-12-03T12:19:40.149 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms FAILED [ 85%] 2023-12-03T12:19:40.149 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms ERROR [ 85%] 2023-12-03T12:20:03.131 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms FAILED [ 85%] 2023-12-03T12:20:03.131 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms ERROR [ 85%] 2023-12-03T12:20:17.005 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc FAILED [ 85%] 2023-12-03T12:20:17.005 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc ERROR [ 85%] 2023-12-03T12:20:36.977 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 FAILED [ 86%] 2023-12-03T12:20:36.977 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 ERROR [ 86%] 2023-12-03T12:20:55.590 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag FAILED [ 86%] 2023-12-03T12:20:55.590 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag ERROR [ 86%] 2023-12-03T12:21:12.569 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock FAILED [ 86%] 2023-12-03T12:21:12.569 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock ERROR [ 86%] 2023-12-03T12:21:24.082 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket FAILED [ 86%] 2023-12-03T12:21:24.083 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket ERROR [ 86%] 2023-12-03T12:21:40.153 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years FAILED [ 86%] 2023-12-03T12:21:40.154 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years ERROR [ 86%] 2023-12-03T12:21:51.129 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days FAILED [ 86%] 2023-12-03T12:21:51.129 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days ERROR [ 86%] 2023-12-03T12:22:11.301 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years FAILED [ 87%] 2023-12-03T12:22:11.302 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years ERROR [ 87%] 2023-12-03T12:22:30.491 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode FAILED [ 87%] 2023-12-03T12:22:30.491 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode ERROR [ 87%] 2023-12-03T12:22:49.619 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status FAILED [ 87%] 2023-12-03T12:22:49.619 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status ERROR [ 87%] 2023-12-03T12:23:05.622 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning FAILED [ 87%] 2023-12-03T12:23:05.623 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning ERROR [ 87%] 2023-12-03T12:23:21.079 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock FAILED [ 87%] 2023-12-03T12:23:21.079 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock ERROR [ 87%] 2023-12-03T12:23:42.673 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket FAILED [ 87%] 2023-12-03T12:23:42.674 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket ERROR [ 87%] 2023-12-03T12:24:01.441 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention FAILED [ 87%] 2023-12-03T12:24:01.441 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention ERROR [ 87%] 2023-12-03T12:24:17.605 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket FAILED [ 88%] 2023-12-03T12:24:17.605 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket ERROR [ 88%] 2023-12-03T12:24:33.355 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode FAILED [ 88%] 2023-12-03T12:24:33.356 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode ERROR [ 88%] 2023-12-03T12:24:54.715 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention FAILED [ 88%] 2023-12-03T12:24:54.716 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention ERROR [ 88%] 2023-12-03T12:25:16.436 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 FAILED [ 88%] 2023-12-03T12:25:16.437 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 ERROR [ 88%] 2023-12-03T12:25:34.307 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket FAILED [ 88%] 2023-12-03T12:25:34.307 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket ERROR [ 88%] 2023-12-03T12:25:50.909 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid FAILED [ 88%] 2023-12-03T12:25:50.910 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid ERROR [ 88%] 2023-12-03T12:26:05.811 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention FAILED [ 88%] 2023-12-03T12:26:05.812 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention ERROR [ 88%] 2023-12-03T12:26:17.085 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period FAILED [ 89%] 2023-12-03T12:26:17.085 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period ERROR [ 89%] 2023-12-03T12:26:32.708 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period FAILED [ 89%] 2023-12-03T12:26:32.709 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period ERROR [ 89%] 2023-12-03T12:26:48.226 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass FAILED [ 89%] 2023-12-03T12:26:48.226 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass ERROR [ 89%] 2023-12-03T12:27:09.375 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention FAILED [ 89%] 2023-12-03T12:27:09.375 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention ERROR [ 89%] 2023-12-03T12:27:28.817 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker FAILED [ 89%] 2023-12-03T12:27:28.817 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker ERROR [ 89%] 2023-12-03T12:27:46.325 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention FAILED [ 89%] 2023-12-03T12:27:46.325 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention ERROR [ 89%] 2023-12-03T12:28:06.601 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold FAILED [ 90%] 2023-12-03T12:28:06.601 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold ERROR [ 90%] 2023-12-03T12:28:24.230 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket FAILED [ 90%] 2023-12-03T12:28:24.230 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket ERROR [ 90%] 2023-12-03T12:28:40.583 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status FAILED [ 90%] 2023-12-03T12:28:40.583 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status ERROR [ 90%] 2023-12-03T12:28:54.180 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold FAILED [ 90%] 2023-12-03T12:28:54.180 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold ERROR [ 90%] 2023-12-03T12:29:12.813 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket FAILED [ 90%] 2023-12-03T12:29:12.813 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket ERROR [ 90%] 2023-12-03T12:29:28.924 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on FAILED [ 90%] 2023-12-03T12:29:28.924 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on ERROR [ 90%] 2023-12-03T12:29:40.090 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off FAILED [ 90%] 2023-12-03T12:29:40.090 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off ERROR [ 90%] 2023-12-03T12:29:56.206 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata FAILED [ 91%] 2023-12-03T12:29:56.206 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata ERROR [ 91%] 2023-12-03T12:30:14.424 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj FAILED [ 91%] 2023-12-03T12:30:14.424 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj ERROR [ 91%] 2023-12-03T12:30:32.438 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass FAILED [ 91%] 2023-12-03T12:30:32.439 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass ERROR [ 91%] 2023-12-03T12:30:50.466 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass FAILED [ 91%] 2023-12-03T12:30:50.466 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass ERROR [ 91%] 2023-12-03T12:31:08.499 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance FAILED [ 91%] 2023-12-03T12:31:08.499 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance ERROR [ 91%] 2023-12-03T12:31:27.595 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good FAILED [ 91%] 2023-12-03T12:31:27.595 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good ERROR [ 91%] 2023-12-03T12:31:48.504 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed FAILED [ 92%] 2023-12-03T12:31:48.504 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed ERROR [ 92%] 2023-12-03T12:32:00.247 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status FAILED [ 92%] 2023-12-03T12:32:00.247 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status ERROR [ 92%] 2023-12-03T12:32:14.801 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:32:14.802 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:32:24.879 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:32:24.879 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:32:41.709 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:32:41.709 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:33:03.386 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status FAILED [ 92%] 2023-12-03T12:33:03.387 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status ERROR [ 92%] 2023-12-03T12:33:22.432 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status FAILED [ 92%] 2023-12-03T12:33:22.432 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status ERROR [ 92%] 2023-12-03T12:33:42.244 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_default_public_block FAILED [ 93%] 2023-12-03T12:33:42.244 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_default_public_block ERROR [ 93%] 2023-12-03T12:34:00.767 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block FAILED [ 93%] 2023-12-03T12:34:00.767 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block ERROR [ 93%] 2023-12-03T12:34:16.053 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls FAILED [ 93%] 2023-12-03T12:34:16.054 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls ERROR [ 93%] 2023-12-03T12:34:35.860 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls FAILED [ 93%] 2023-12-03T12:34:35.860 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls ERROR [ 93%] 2023-12-03T12:34:53.526 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy FAILED [ 93%] 2023-12-03T12:34:53.527 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy ERROR [ 93%] 2023-12-03T12:35:02.463 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls FAILED [ 93%] 2023-12-03T12:35:02.463 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls ERROR [ 93%] 2023-12-03T12:35:19.755 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy FAILED [ 93%] 2023-12-03T12:35:19.755 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy ERROR [ 93%] 2023-12-03T12:35:39.648 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms FAILED [ 94%] 2023-12-03T12:35:39.648 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms ERROR [ 94%] 2023-12-03T12:35:46.793 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms FAILED [ 94%] 2023-12-03T12:35:46.793 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms ERROR [ 94%] 2023-12-03T12:36:02.640 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms FAILED [ 94%] 2023-12-03T12:36:02.640 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms ERROR [ 94%] 2023-12-03T12:36:19.416 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request FAILED [ 94%] 2023-12-03T12:36:19.416 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request ERROR [ 94%] 2023-12-03T12:36:41.124 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent FAILED [ 94%] 2023-12-03T12:36:41.124 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent ERROR [ 94%] 2023-12-03T12:36:46.345 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause ERROR [ 94%] 2023-12-03T12:36:46.516 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection ERROR [ 95%] 2023-12-03T12:36:46.762 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation ERROR [ 95%] 2023-12-03T12:36:46.931 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation ERROR [ 95%] 2023-12-03T12:36:47.172 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max ERROR [ 95%] 2023-12-03T12:36:47.425 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions ERROR [ 95%] 2023-12-03T12:36:47.597 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max ERROR [ 95%] 2023-12-03T12:36:47.841 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions ERROR [ 95%] 2023-12-03T12:36:48.011 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions ERROR [ 96%] 2023-12-03T12:36:48.249 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions ERROR [ 96%] 2023-12-03T12:36:48.499 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions ERROR [ 96%] 2023-12-03T12:36:48.667 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions ERROR [ 96%] 2023-12-03T12:36:48.913 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions ERROR [ 96%] 2023-12-03T12:36:49.165 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions ERROR [ 96%] 2023-12-03T12:36:49.337 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions ERROR [ 96%] 2023-12-03T12:36:49.585 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions ERROR [ 97%] 2023-12-03T12:36:49.756 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_alias ERROR [ 97%] 2023-12-03T12:36:49.997 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce ERROR [ 97%] 2023-12-03T12:36:50.248 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime ERROR [ 97%] 2023-12-03T12:36:50.419 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime ERROR [ 97%] 2023-12-03T12:36:50.664 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser ERROR [ 97%] 2023-12-03T12:36:50.834 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition ERROR [ 98%] 2023-12-03T12:36:51.078 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition ERROR [ 98%] 2023-12-03T12:36:51.327 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions ERROR [ 98%] 2023-12-03T12:36:51.497 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions ERROR [ 98%] 2023-12-03T12:36:51.742 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions ERROR [ 98%] 2023-12-03T12:36:51.997 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_version ERROR [ 98%] 2023-12-03T12:36:52.168 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions ERROR [ 98%] 2023-12-03T12:36:52.419 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions ERROR [ 99%] 2023-12-03T12:36:52.589 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions ERROR [ 99%] 2023-12-03T12:36:52.829 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions ERROR [ 99%] 2023-12-03T12:36:53.082 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions ERROR [ 99%] 2023-12-03T12:36:53.251 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions ERROR [ 99%] 2023-12-03T12:36:53.499 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions ERROR [ 99%] 2023-12-03T12:36:53.519 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2023-12-03T12:36:53.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.519 INFO:teuthology.orchestra.run.smithi131.stdout:==================================== ERRORS ==================================== 2023-12-03T12:36:53.519 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_multipart_upload_empty _______________ 2023-12-03T12:36:53.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.519 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.520 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.521 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.522 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.523 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.524 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.525 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.526 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.527 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.528 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.529 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.530 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.531 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.532 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.536 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.537 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.539 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.540 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.541 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.542 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_multipart_upload_small _______________ 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.544 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.545 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.547 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.548 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.549 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.552 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.556 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.559 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.560 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.561 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.562 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_multipart_copy_small ________________ 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.563 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.565 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.566 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.567 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.568 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.570 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.571 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.572 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.573 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.574 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.575 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.576 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.577 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.580 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.581 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.583 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_multipart_copy_invalid_range ____________ 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.584 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.585 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.586 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.588 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.589 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.590 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.591 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.592 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.593 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.594 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.595 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.598 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.600 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.601 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.602 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.603 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_multipart_copy_without_range ____________ 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.604 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.606 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.608 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.609 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.610 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.611 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.617 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.620 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.621 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.622 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.623 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_multipart_copy_special_names ____________ 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.624 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.625 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.626 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.627 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.628 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.630 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.631 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.633 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.634 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.635 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.636 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.637 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.639 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.640 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.641 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.642 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.643 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_multipart_upload __________________ 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.644 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.646 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.647 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.649 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.650 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.651 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.653 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.654 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.655 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.656 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.658 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.659 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.660 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.661 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.662 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.663 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_multipart_copy_versioned ______________ 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.665 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.666 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.667 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.668 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.669 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.670 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.671 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.673 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.674 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.677 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.678 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.680 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.681 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.682 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.684 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_multipart_upload_resend_part ____________ 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.687 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.688 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.690 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.691 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.693 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.695 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.696 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.697 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.698 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.699 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.701 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.702 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.703 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.704 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout:__________ ERROR at teardown of test_multipart_upload_multiple_sizes ___________ 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.705 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.706 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.707 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.708 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.709 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.711 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.712 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.713 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.714 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.715 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.716 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.718 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.718 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.718 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.718 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.718 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.720 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.721 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.722 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.723 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.724 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout:___________ ERROR at teardown of test_multipart_copy_multiple_sizes ____________ 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.725 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.726 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.727 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.728 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.730 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.731 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.732 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.733 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.737 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.738 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.740 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.741 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.742 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.743 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.744 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:__________ ERROR at teardown of test_multipart_upload_size_too_small ___________ 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.746 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.747 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.748 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.749 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.750 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.751 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.753 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.756 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.757 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.758 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.759 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.761 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.763 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.764 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_multipart_upload_contents ______________ 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.765 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.768 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.769 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.770 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.771 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.772 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.774 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.776 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.777 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.778 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.780 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.782 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.783 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.784 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_multipart_upload_overwrite_existing_object _____ 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.785 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.787 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.788 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.790 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.791 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.792 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.793 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.794 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.794 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.794 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.794 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.794 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.794 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.795 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.796 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.797 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.799 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.800 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.801 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.802 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.803 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.805 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_abort_multipart_upload _______________ 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.806 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.807 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.808 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.809 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.810 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.811 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.812 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.813 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.815 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.816 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.817 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.819 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.820 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.822 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.823 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.825 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout:__________ ERROR at teardown of test_abort_multipart_upload_not_found __________ 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.826 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.827 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.828 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.829 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.830 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.832 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.833 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.834 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.835 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.836 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.837 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.839 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.840 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.841 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.842 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.843 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.844 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_list_multipart_upload ________________ 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.845 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.846 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.847 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.848 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.850 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.851 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.852 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.853 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.854 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.855 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.856 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.857 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.858 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.859 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.860 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.861 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.861 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.861 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.861 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.861 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.861 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.861 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.888 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.889 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.890 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.891 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.892 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_list_multipart_upload_owner _____________ 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.893 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.894 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.895 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.896 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.897 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.898 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.899 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.900 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.901 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.902 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.903 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.904 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.906 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.907 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.910 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.911 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.912 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout:___________ ERROR at teardown of test_multipart_upload_missing_part ____________ 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.913 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.914 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.915 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.916 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.917 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.918 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.919 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.920 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.921 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.923 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.924 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.925 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.926 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.928 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.930 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.930 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.930 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.930 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.930 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.930 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.930 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.930 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.930 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.930 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.930 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.931 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout:__________ ERROR at teardown of test_multipart_upload_incorrect_etag ___________ 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.935 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.936 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.937 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.938 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.939 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.940 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.941 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.942 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.943 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.944 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.945 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.946 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.947 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.950 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.952 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at teardown of test_multipart_get_part _________________ 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.955 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.956 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.957 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.959 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.960 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.962 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.963 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.964 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.965 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.968 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.969 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.970 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.971 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.972 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_non_multipart_get_part _______________ 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.974 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.975 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.976 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.977 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.978 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.979 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:53.980 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:53.981 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.983 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:53.984 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.985 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:53.986 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:53.987 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.988 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.989 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:53.990 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.991 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ ERROR at teardown of test_100_continue ____________________ 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.992 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:53.993 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.994 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:53.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:53.996 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:53.998 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:53.999 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.000 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.001 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.002 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.003 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.004 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.005 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.006 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.007 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.008 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.009 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.010 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ ERROR at teardown of test_set_cors ______________________ 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.012 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.014 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.015 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.016 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.017 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.018 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.019 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.020 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.022 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.024 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.025 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.026 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.027 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.028 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.029 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.030 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_cors_origin_response ________________ 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.031 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.032 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.033 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.035 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.037 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.038 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.039 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.040 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.041 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.042 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.043 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.044 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.045 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.046 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.047 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.048 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_cors_origin_wildcard ________________ 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.052 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.054 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.055 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.056 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.057 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.059 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.061 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.062 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.063 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.064 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.066 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.067 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.068 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.069 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at teardown of test_cors_header_option _________________ 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.070 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.072 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.073 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.075 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.076 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.077 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.078 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.080 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.081 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.082 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.084 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.085 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.086 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.087 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.089 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.090 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_cors_presigned_get_object ______________ 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.093 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.094 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.096 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.097 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.098 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.099 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.102 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.104 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.105 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.106 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.107 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.108 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.109 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.110 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout:__________ ERROR at teardown of test_cors_presigned_get_object_tenant __________ 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.111 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.112 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.113 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.114 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.115 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.117 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.118 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.119 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.120 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.123 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.124 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.127 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.128 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.129 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at teardown of test_set_bucket_tagging _________________ 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.131 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.132 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.133 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.134 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.135 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.136 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.137 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.138 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.139 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.143 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.144 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.145 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.146 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.148 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.149 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_atomic_read_1mb ___________________ 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.150 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.152 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.153 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.154 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.156 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.157 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.158 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.159 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.160 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.161 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.162 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.163 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.164 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.166 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.167 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.168 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_atomic_read_4mb ___________________ 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.171 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.172 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.173 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.175 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.176 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.177 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.178 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.179 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.180 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.181 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.182 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.183 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.185 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.186 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.187 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.188 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_atomic_read_8mb ___________________ 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.189 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.191 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.192 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.193 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.194 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.195 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.196 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.198 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.200 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.202 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.203 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.205 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.206 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.207 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.208 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_atomic_write_1mb __________________ 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.209 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.211 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.213 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.215 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.216 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.217 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.218 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.219 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.220 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.221 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.222 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.223 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.224 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.225 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.226 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.227 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_atomic_write_4mb __________________ 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.228 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.229 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.231 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.232 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.233 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.234 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.235 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.236 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.237 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.239 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.241 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.242 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.244 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.246 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.247 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_atomic_write_8mb __________________ 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.248 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.249 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.250 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.251 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.253 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.254 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.255 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.257 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.259 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.260 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.261 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.263 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.264 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.265 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.266 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_atomic_dual_write_1mb ________________ 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.267 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.268 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.269 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.270 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.271 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.272 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.273 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.274 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.277 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.278 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.280 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.284 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.285 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.286 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_atomic_dual_write_4mb ________________ 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.287 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.288 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.289 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.291 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.293 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.294 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.296 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.298 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.299 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.302 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.304 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.306 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.308 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_atomic_dual_write_8mb ________________ 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.309 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.310 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.311 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.312 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.313 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.315 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.316 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.317 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.319 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.320 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.321 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.322 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.323 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.324 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.325 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.326 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.327 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_atomic_conditional_write_1mb ____________ 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.329 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.330 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.331 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.332 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.335 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.336 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.337 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.338 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.339 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.340 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.341 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.342 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.343 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.345 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.346 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.347 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout:___________ ERROR at teardown of test_atomic_multipart_upload_write ____________ 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.348 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.349 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.350 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.351 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.353 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.354 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.355 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.357 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.358 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.359 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.360 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.361 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.362 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.364 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.365 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.365 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.365 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.365 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.365 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.365 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.365 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.365 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.365 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.365 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.365 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.366 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.367 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout:________ ERROR at teardown of test_multipart_resend_first_finishes_last ________ 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.368 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.369 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.370 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.371 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.372 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.373 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.374 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.377 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.380 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.381 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.382 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.384 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.385 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.386 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_ranged_request_response_code ____________ 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.389 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.390 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.391 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.392 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.394 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.395 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.397 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.398 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.399 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.400 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.401 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.403 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.404 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.405 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.406 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.407 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout:__________ ERROR at teardown of test_ranged_big_request_response_code __________ 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.408 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.409 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.410 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.412 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.413 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.414 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.415 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.417 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.418 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.420 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.421 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.422 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.423 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.424 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.425 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.426 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.427 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout:__ ERROR at teardown of test_ranged_request_skip_leading_bytes_response_code ___ 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.429 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.430 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.431 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.433 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.434 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.435 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.438 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.439 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.440 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.441 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.443 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.446 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.447 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.448 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_ranged_request_return_trailing_bytes_response_code _ 2023-12-03T12:36:54.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.450 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.451 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.452 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.453 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.454 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.455 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.456 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.458 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.459 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.460 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.462 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.463 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.464 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.465 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.466 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.467 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.468 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_ranged_request_invalid_range ____________ 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.469 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.470 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.471 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.472 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.473 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.476 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.477 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.479 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.481 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.482 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.483 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.484 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.485 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.486 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.487 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_ranged_request_empty_object _____________ 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.488 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.489 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.490 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.491 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.492 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.493 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.494 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.495 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.496 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.497 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.498 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.499 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.501 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.502 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.503 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.504 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.505 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.506 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout:__________ ERROR at teardown of test_versioning_bucket_create_suspend __________ 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.507 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.508 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.509 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.510 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.512 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.513 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.514 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.517 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.518 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.519 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.520 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.521 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.522 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.523 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.524 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.525 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.526 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout:_________ ERROR at teardown of test_versioning_obj_create_read_remove __________ 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.528 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.529 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.530 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.532 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.533 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.534 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.535 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.536 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.538 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.539 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.540 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.541 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.542 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.543 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.545 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.546 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout:_______ ERROR at teardown of test_versioning_obj_create_read_remove_head _______ 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.547 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.548 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.549 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.551 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.553 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.554 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.555 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.558 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.560 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.562 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.563 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.564 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.565 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.566 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_versioning_obj_plain_null_version_removal ______ 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.567 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.568 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.569 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.571 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.572 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.573 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.574 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.575 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.576 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.577 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.578 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.579 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.580 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.581 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.583 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.584 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.586 INFO:teuthology.orchestra.run.smithi131.stdout:____ ERROR at teardown of test_versioning_obj_plain_null_version_overwrite _____ 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.588 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.589 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.590 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.591 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.592 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.593 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.594 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.595 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.597 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.598 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.599 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.600 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.602 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.603 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.604 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.605 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_versioning_obj_plain_null_version_overwrite_suspended _ 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.607 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.608 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.609 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.610 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.611 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.612 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.613 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.614 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.615 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.616 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.617 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.619 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.620 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.622 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.623 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.624 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout:__________ ERROR at teardown of test_versioning_obj_suspend_versions ___________ 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.626 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.627 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.628 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.629 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.631 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.632 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.634 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.635 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.638 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.639 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.641 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.642 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.644 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_versioning_obj_create_versions_remove_all ______ 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.645 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.647 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.648 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.649 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.650 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.651 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.652 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.656 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.658 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.659 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.660 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.663 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_versioning_obj_create_versions_remove_special_names _ 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.667 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.669 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.671 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.672 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.673 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.674 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.674 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.674 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.674 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.674 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.674 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.674 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.676 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.678 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.681 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.682 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.683 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.684 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_versioning_obj_create_overwrite_multipart ______ 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.685 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.686 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.687 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.688 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.689 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.690 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.691 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.692 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.694 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.695 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.696 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.698 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.699 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.702 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.703 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.704 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.705 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_versioning_obj_list_marker _____________ 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.707 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.707 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.707 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.707 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.707 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.709 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.710 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.711 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.712 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.713 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.714 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.715 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.717 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.718 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.719 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.720 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.721 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.722 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.724 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.725 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.726 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.727 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_versioning_copy_obj_version _____________ 2023-12-03T12:36:54.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.729 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.730 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.731 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.733 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.734 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.735 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.736 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.737 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.738 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.739 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.740 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.742 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.743 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.746 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.747 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.748 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout:___________ ERROR at teardown of test_versioning_multi_object_delete ___________ 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.749 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.750 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.751 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.752 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.753 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.755 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.756 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.757 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.758 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.759 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.760 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.762 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.763 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.764 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.765 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.766 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.767 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_versioning_multi_object_delete_with_marker _____ 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.769 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.770 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.771 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.774 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.775 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.776 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.777 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.778 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.779 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.780 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.781 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.782 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.784 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.785 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.786 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.787 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.788 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_versioning_multi_object_delete_with_marker_create __ 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.791 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.792 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.794 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.795 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.796 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.797 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.798 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.799 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.800 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.801 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.802 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.803 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.805 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.807 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.808 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_versioned_object_acl ________________ 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.809 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.812 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.813 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.815 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.816 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.819 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.820 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.822 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.823 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.825 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.827 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.828 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_versioned_object_acl_no_version_specified ______ 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.829 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.831 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.833 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.834 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.835 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.836 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.839 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.840 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.841 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.842 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.844 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.845 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.846 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.847 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.848 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout:___ ERROR at teardown of test_versioned_concurrent_object_create_and_remove ____ 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.849 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.850 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.851 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.852 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.853 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.854 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.855 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.856 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.857 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.858 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.859 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.860 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.862 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.863 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.864 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.865 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.867 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.868 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ ERROR at teardown of test_lifecycle_set ____________________ 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.869 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.870 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.871 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.872 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.874 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.875 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.876 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.878 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.880 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.881 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.883 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.884 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.885 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.886 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.887 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.888 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ ERROR at teardown of test_lifecycle_get ____________________ 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.889 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.890 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.891 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.892 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.893 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.894 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.895 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.896 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.897 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.898 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.899 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.901 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.902 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.903 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.905 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.906 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.907 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_lifecycle_get_no_id _________________ 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.909 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.911 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.913 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.913 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.913 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.913 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.913 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.913 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.914 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.915 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.916 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.917 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.919 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.921 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.922 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.924 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.925 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.926 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.927 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.928 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.929 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.930 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_lifecycle_id_too_long ________________ 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.931 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.932 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.933 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.934 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.935 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.936 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.937 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.938 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.941 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.942 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.943 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.945 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.946 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.948 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.949 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.950 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.951 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at teardown of test_lifecycle_same_id __________________ 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.953 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.954 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.956 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.957 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.958 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.959 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.961 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.962 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.963 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.964 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.966 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.967 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.968 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.969 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.970 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_lifecycle_invalid_status ______________ 2023-12-03T12:36:54.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.972 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.973 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.974 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.975 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.976 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.977 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.978 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:54.980 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:54.981 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:54.983 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:54.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:54.985 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:54.986 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:54.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.988 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:54.989 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.990 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at teardown of test_lifecycle_set_date _________________ 2023-12-03T12:36:54.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.992 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.993 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:54.994 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:54.994 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:54.994 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:54.994 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:54.994 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.994 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:54.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.994 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:54.994 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.995 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:54.996 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:54.998 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:54.999 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.000 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.001 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.003 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.004 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.005 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.007 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.008 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.009 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.010 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.011 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_lifecycle_set_invalid_date _____________ 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.013 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.014 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.016 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.017 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.018 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.019 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.020 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.021 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.022 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.023 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.024 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.026 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.028 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.029 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.030 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.031 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.032 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_lifecycle_set_noncurrent ______________ 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.033 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.036 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.037 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.039 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.040 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.042 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.043 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.044 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.045 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.049 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.050 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.051 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_lifecycle_set_deletemarker _____________ 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.053 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.055 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.056 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.057 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.058 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.059 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.060 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.062 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.064 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.065 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.066 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.067 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.068 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.069 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.070 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.071 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_lifecycle_set_filter ________________ 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.072 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.074 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.075 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.076 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.077 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.078 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.079 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.080 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.081 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.081 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.081 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.081 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.081 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.081 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.081 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.081 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.081 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.081 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.081 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.082 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.082 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.082 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.082 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.082 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.082 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.082 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.082 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.082 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.083 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.084 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.086 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.087 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.089 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.090 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.091 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.092 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_lifecycle_set_empty_filter _____________ 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.093 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.094 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.095 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.096 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.099 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.100 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.102 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.103 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.106 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.108 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.109 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.110 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.111 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.112 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_lifecycle_set_multipart _______________ 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.113 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.114 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.115 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.117 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.117 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.117 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.117 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.117 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.117 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.117 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.117 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.118 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.119 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.120 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.121 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.122 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.123 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.124 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.125 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.126 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.127 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.128 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.130 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.131 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.133 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout:_______ ERROR at teardown of test_lifecycle_transition_set_invalid_date ________ 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.135 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.137 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.138 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.140 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.141 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.142 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.144 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.145 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.146 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.147 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.148 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.149 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.150 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.151 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.152 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1b ________________ 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.154 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.155 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.156 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.158 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.160 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.161 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.162 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.163 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.164 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.165 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.167 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.170 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.171 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.172 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.173 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1kb _______________ 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.174 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.175 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.176 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.177 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.178 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.180 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.181 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.182 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.183 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.184 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.186 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.187 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.188 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.190 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.191 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.192 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.193 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_encrypted_transfer_1MB _______________ 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.195 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.196 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.198 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.199 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.200 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.201 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.203 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.204 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.205 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.206 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.207 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.208 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.210 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.211 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.212 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.213 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_encrypted_transfer_13b _______________ 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.214 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.216 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.217 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.218 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.220 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.221 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.222 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.223 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.224 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.225 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.227 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.230 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.231 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.232 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_encryption_sse_c_method_head ____________ 2023-12-03T12:36:55.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.235 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.237 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.238 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.239 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.241 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.242 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.243 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.244 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.245 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.246 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.247 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.249 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.250 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.252 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_encryption_sse_c_present ______________ 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.253 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.254 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.255 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.256 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.257 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.258 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.259 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.260 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.262 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.266 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.268 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.269 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.271 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.272 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_encryption_sse_c_other_key _____________ 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.273 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.275 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.276 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.277 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.278 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.279 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.280 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.282 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.286 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.289 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.290 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.291 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.292 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_encryption_sse_c_invalid_md5 ____________ 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.293 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.294 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.295 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.296 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.297 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.299 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.300 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.302 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.303 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.304 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.305 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.306 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.307 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.308 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.309 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.309 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.309 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.309 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.309 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.309 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.309 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.309 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.309 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.309 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.310 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.312 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.313 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_encryption_sse_c_no_md5 _______________ 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.314 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.317 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.319 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.320 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.321 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.322 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.324 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.326 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.327 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.329 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.330 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.331 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.332 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_encryption_sse_c_no_key _______________ 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.336 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.341 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.342 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.343 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.344 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.345 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.346 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.347 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.349 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.350 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.351 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.352 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_encryption_key_no_sse_c _______________ 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.356 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.357 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.358 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.360 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.361 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.362 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.364 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.365 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.366 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.367 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.368 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.370 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.371 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.372 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.373 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.374 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout:_________ ERROR at teardown of test_encryption_sse_c_multipart_upload __________ 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.375 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.377 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.379 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.381 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.382 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.383 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.385 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.386 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.387 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.388 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.389 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.390 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.392 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.393 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout:____ ERROR at teardown of test_encryption_sse_c_unaligned_multipart_upload _____ 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.396 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.397 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.398 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.399 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.401 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.402 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.403 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.405 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.406 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.407 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.408 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.409 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.410 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.412 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.413 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.414 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.415 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout:______ ERROR at teardown of test_encryption_sse_c_multipart_bad_download _______ 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.416 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.418 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.419 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.420 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.421 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.422 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.423 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.425 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.426 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.427 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.429 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.433 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.435 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_encryption_sse_c_post_object_authenticated_request _ 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.436 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.437 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.438 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.439 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.441 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.442 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.443 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.445 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.447 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.448 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.449 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.450 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.451 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.452 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.453 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.454 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.455 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_sse_kms_method_head _________________ 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.457 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.458 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.459 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.460 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.461 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.462 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.463 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.464 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.466 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.467 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.468 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.469 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.470 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.471 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.473 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.474 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.476 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_sse_kms_present ___________________ 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.478 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.479 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.481 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.482 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.483 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.485 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.486 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.487 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.488 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.489 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.490 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.491 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.493 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.494 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.495 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.496 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ ERROR at teardown of test_sse_kms_no_key ___________________ 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.499 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.500 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.502 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.503 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.504 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.505 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.506 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.507 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.508 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.512 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.513 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.514 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.515 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_sse_kms_not_declared ________________ 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.517 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.519 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.520 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.521 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.522 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.523 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.524 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.526 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.527 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.528 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.529 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.529 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.529 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.529 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.529 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.530 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.532 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.533 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.534 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.535 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.536 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_sse_kms_multipart_upload ______________ 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.537 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.538 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.539 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.540 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.541 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.544 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.546 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.547 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.549 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.550 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.551 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.553 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.554 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.555 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.556 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.557 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout:_________ ERROR at teardown of test_sse_kms_multipart_invalid_chunks_1 _________ 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.558 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.559 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.561 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.562 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.564 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.565 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.568 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.569 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.570 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.571 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.572 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.573 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.574 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.575 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout:_________ ERROR at teardown of test_sse_kms_multipart_invalid_chunks_2 _________ 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.578 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.580 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.581 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.583 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.584 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.585 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.587 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.588 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.589 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.590 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.591 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.592 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.594 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.595 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.596 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.597 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_sse_kms_post_object_authenticated_request ______ 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.598 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.599 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.600 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.601 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.602 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.603 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.604 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.605 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.606 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.607 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.608 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.609 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.611 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.613 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.614 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.616 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.617 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1b _________________ 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.618 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.619 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.620 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.621 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.622 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.624 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.625 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.626 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.626 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.626 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.628 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.629 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.631 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.633 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.634 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.635 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.636 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1kb ________________ 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.639 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.641 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.642 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.643 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.644 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.645 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.646 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.647 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.648 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.649 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.650 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.651 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.652 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.655 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.656 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.657 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.658 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_sse_kms_transfer_1MB ________________ 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.659 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.661 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.662 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.663 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.665 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.666 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.667 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.668 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.669 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.670 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.671 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.674 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.675 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.677 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.678 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_sse_kms_transfer_13b ________________ 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.679 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.681 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.682 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.683 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.685 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.686 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.687 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.688 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.689 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.690 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.692 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.693 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.694 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.695 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.696 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.698 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_sse_kms_read_declare ________________ 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.699 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.701 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.702 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.703 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.704 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.705 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.706 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.707 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.708 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.710 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.711 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.712 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.716 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.718 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ ERROR at teardown of test_bucket_policy ____________________ 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.719 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.720 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.723 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.725 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.726 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.726 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.726 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.726 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.726 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.726 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.726 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.726 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.729 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.730 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.731 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.732 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.733 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.734 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.735 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.736 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.737 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.738 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.739 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.740 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.741 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_bucketv2_policy ___________________ 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.742 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.743 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.744 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.745 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.746 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.747 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.748 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.749 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.750 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.751 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.752 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.753 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.755 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.758 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.759 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.760 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.761 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at teardown of test_bucket_policy_acl __________________ 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.762 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.763 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.764 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.765 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.766 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.767 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.768 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.769 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.771 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.772 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.773 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.774 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.775 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.776 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.778 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.779 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.781 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_bucketv2_policy_acl _________________ 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.782 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.783 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.784 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.785 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.786 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.787 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.788 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.789 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.790 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.791 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.792 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.793 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.794 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.798 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.799 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.800 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.801 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_bucket_policy_another_bucket ____________ 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.802 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.803 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.804 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.805 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.806 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.807 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.808 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.809 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.812 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.813 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.814 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.815 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.816 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.818 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.819 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.820 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.821 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout:___________ ERROR at teardown of test_bucketv2_policy_another_bucket ___________ 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.822 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.823 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.824 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.825 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.828 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.829 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.831 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.832 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.833 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.835 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.837 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.838 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.839 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.840 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.841 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_get_obj_tagging ___________________ 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.843 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.844 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.846 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.847 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.848 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.849 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.851 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.854 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.858 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.859 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.860 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_get_obj_head_tagging ________________ 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.863 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.864 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.866 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.867 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.868 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.869 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.870 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.871 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.872 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.873 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.875 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.877 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.878 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.879 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ ERROR at teardown of test_put_max_tags ____________________ 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.884 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.885 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.886 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.887 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.888 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.892 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.894 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.896 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.898 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.899 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.900 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_put_excess_tags ___________________ 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.902 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.903 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.904 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.905 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.906 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.907 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.908 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.910 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.911 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.912 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.913 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.914 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.918 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.919 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.921 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_put_max_kvsize_tags _________________ 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.922 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.924 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.925 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.927 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.931 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.934 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.935 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.938 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.939 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.940 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.941 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.941 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.941 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.941 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.941 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.941 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.941 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.941 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_put_excess_key_tags _________________ 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.942 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.943 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.944 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.947 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.954 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.961 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_put_excess_val_tags _________________ 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.973 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.977 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.978 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.979 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:55.980 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:55.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_put_modify_tags ___________________ 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:55.984 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:55.985 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:55.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.987 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.988 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:55.989 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:55.990 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:55.991 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:55.992 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:55.993 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.994 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:55.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:55.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:55.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:55.998 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:55.999 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_put_delete_tags ___________________ 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.003 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.004 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.005 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.007 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.008 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.009 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.012 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.013 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.018 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.020 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.021 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout:_________ ERROR at teardown of test_post_object_tags_anonymous_request _________ 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.022 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.023 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.024 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.026 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.028 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.029 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.030 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.031 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.032 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.033 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.035 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.036 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.039 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.041 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout:_______ ERROR at teardown of test_post_object_tags_authenticated_request _______ 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.042 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.043 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.045 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.048 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.049 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.051 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.052 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.053 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.055 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.056 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.058 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.060 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.061 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at teardown of test_put_obj_with_tags __________________ 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.062 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.063 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.064 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.065 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.066 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.067 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.068 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.069 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.071 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.074 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.075 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.077 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.078 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.079 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.080 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_get_tags_acl_public _________________ 2023-12-03T12:36:56.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.083 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.084 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.085 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.087 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.088 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.090 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.092 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.093 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.096 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.097 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.098 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.099 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.100 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_put_tags_acl_public _________________ 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.103 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.104 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.105 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.107 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.108 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.110 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.111 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.112 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.113 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.114 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.117 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.118 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.119 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.120 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at teardown of test_delete_tags_obj_public _______________ 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.121 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.122 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.125 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.127 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.128 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.131 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.132 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.134 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.135 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.136 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.137 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.138 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.139 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.140 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_versioning_bucket_atomic_upload_return_version_id __ 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.141 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.142 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.144 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.146 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.147 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.148 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.149 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.150 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.151 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.152 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.154 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.157 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.158 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.159 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.160 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_versioning_bucket_multipart_upload_return_version_id _ 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.161 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.163 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.164 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.165 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.166 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.167 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.168 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.170 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.171 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.172 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.173 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.174 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.176 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.177 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.178 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.179 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.180 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout:_________ ERROR at teardown of test_bucket_policy_get_obj_existing_tag _________ 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.182 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.183 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.184 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.185 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.186 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.187 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.189 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.192 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.193 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.195 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.196 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.197 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.198 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.199 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_bucket_policy_get_obj_tagging_existing_tag _____ 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.200 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.201 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.202 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.205 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.206 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.207 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.209 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.210 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.211 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.212 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.213 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.215 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.216 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.217 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.218 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_bucket_policy_put_obj_tagging_existing_tag _____ 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.221 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.222 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.223 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.224 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.225 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.227 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.228 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.229 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.230 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.231 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.232 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.233 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.235 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.236 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.237 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.238 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout:_________ ERROR at teardown of test_bucket_policy_put_obj_copy_source __________ 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.240 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.241 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.242 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.243 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.244 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.245 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.247 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.248 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.251 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.253 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.253 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.253 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.253 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.253 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.253 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.253 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.253 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.253 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.253 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.253 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.256 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.257 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.258 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout:_______ ERROR at teardown of test_bucket_policy_put_obj_copy_source_meta _______ 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.260 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.261 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.263 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.264 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.265 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.266 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.267 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.268 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.269 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.270 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.271 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.272 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.273 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.274 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.275 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.276 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.277 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.278 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_bucket_policy_put_obj_acl ______________ 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.279 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.280 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.281 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.282 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.283 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.284 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.285 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.286 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.287 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.288 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.289 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.290 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.291 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.292 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.295 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.296 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.297 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.298 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_bucket_policy_put_obj_grant _____________ 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.300 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.304 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.305 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.307 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.308 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.310 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.311 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.313 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.315 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.316 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.317 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_put_obj_enc_conflict_c_s3 ______________ 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.320 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.321 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.322 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.323 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.324 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.325 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.326 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.327 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.329 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.331 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.332 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.335 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.336 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.337 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_put_obj_enc_conflict_c_kms _____________ 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.338 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.339 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.339 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.339 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.339 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.339 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.339 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.341 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.341 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.341 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.341 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.341 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.341 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.341 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.342 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.344 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.345 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.346 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.347 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.348 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.349 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.352 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.353 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.354 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.356 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.357 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.358 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_put_obj_enc_conflict_s3_kms _____________ 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.359 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.360 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.362 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.363 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.366 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.367 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.368 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.369 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.371 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.374 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.375 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.376 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout:__________ ERROR at teardown of test_put_obj_enc_conflict_bad_enc_kms __________ 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.379 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.380 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.382 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.383 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.385 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.386 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.387 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.389 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.390 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.391 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.392 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.395 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.396 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.397 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.398 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout:__________ ERROR at teardown of test_bucket_policy_put_obj_kms_noenc ___________ 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.400 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.401 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.402 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.403 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.404 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.405 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.406 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.407 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.409 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.410 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.412 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.413 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.414 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.415 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.416 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.417 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_bucket_policy_put_obj_kms_s3 ____________ 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.418 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.419 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.420 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.421 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.422 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.423 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.424 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.425 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.426 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.427 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.428 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.429 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.430 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.432 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.433 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.434 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.436 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout:_______ ERROR at teardown of test_bucket_policy_get_obj_acl_existing_tag _______ 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.437 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.438 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.441 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.443 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.444 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.445 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.446 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.447 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.448 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.449 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.450 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.452 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.453 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.454 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.455 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.456 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_object_lock_put_obj_lock ______________ 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.458 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.459 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.461 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.462 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.463 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.464 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.465 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.466 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.467 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.468 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.470 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.474 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.475 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.476 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout:______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_bucket _______ 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.479 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.480 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.481 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.482 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.483 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.484 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.485 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.487 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.488 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.490 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.492 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.493 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.494 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.496 INFO:teuthology.orchestra.run.smithi131.stdout:____ ERROR at teardown of test_object_lock_put_obj_lock_with_days_and_years ____ 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.498 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.499 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.500 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.502 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.503 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.505 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.506 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.507 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.509 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.513 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.514 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.515 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_days ________ 2023-12-03T12:36:56.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.517 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.518 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.519 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.520 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.521 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.522 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.523 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.524 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.525 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.526 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.527 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.529 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.531 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.532 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.534 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.535 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_years _______ 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.538 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.539 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.540 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.542 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.543 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.544 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.545 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.546 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.547 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.548 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.549 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.551 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.552 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.553 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.554 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.555 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout:_______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_mode ________ 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.556 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.560 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.562 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.562 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.562 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.562 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.562 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.562 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.562 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.562 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.562 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.563 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.565 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.566 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.567 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.569 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.570 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.571 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.572 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.573 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.574 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout:______ ERROR at teardown of test_object_lock_put_obj_lock_invalid_status _______ 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.576 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.578 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.579 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.580 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.581 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.582 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.583 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.585 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.586 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.587 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.588 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.589 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.590 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.592 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.593 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.594 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.595 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout:___________ ERROR at teardown of test_object_lock_suspend_versioning ___________ 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.596 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.597 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.598 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.599 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.600 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.601 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.602 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.603 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.604 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.605 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.607 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.608 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.609 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.610 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.612 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.613 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.614 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.615 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_object_lock_get_obj_lock ______________ 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.617 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.618 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.619 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.620 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.621 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.622 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.623 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.624 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.625 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.626 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.628 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.629 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.630 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.631 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.633 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.634 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.635 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout:______ ERROR at teardown of test_object_lock_get_obj_lock_invalid_bucket _______ 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.637 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.638 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.639 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.640 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.641 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.642 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.643 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.644 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.645 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.646 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.647 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.648 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.649 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.650 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.651 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.652 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.653 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.654 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.655 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout:___________ ERROR at teardown of test_object_lock_put_obj_retention ____________ 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.656 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.658 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.660 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.661 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.662 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.663 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.664 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.665 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.667 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.668 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.669 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.670 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.672 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.673 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.674 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.675 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout:____ ERROR at teardown of test_object_lock_put_obj_retention_invalid_bucket ____ 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.676 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.678 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.679 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.680 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.682 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.683 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.684 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.686 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.687 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.688 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.689 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.690 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.691 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.692 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.693 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.694 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.695 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_object_lock_put_obj_retention_invalid_mode _____ 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.698 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.700 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.701 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.702 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.703 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.705 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.706 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.707 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.708 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.710 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.711 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.712 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.713 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.714 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout:___________ ERROR at teardown of test_object_lock_get_obj_retention ____________ 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.715 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.716 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.717 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.719 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.720 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.721 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.722 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.724 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.728 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.729 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.730 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.731 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.732 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.733 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.734 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout:_______ ERROR at teardown of test_object_lock_get_obj_retention_iso8601 ________ 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.735 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.736 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.737 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.738 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.739 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.741 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.742 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.743 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.744 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.745 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.746 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.747 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.748 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.751 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.752 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.753 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout:____ ERROR at teardown of test_object_lock_get_obj_retention_invalid_bucket ____ 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.755 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.756 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.757 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.758 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.759 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.760 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.761 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.764 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.765 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.766 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.767 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.768 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.770 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.771 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.773 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout:______ ERROR at teardown of test_object_lock_put_obj_retention_versionid _______ 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.774 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.775 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.776 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.777 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.778 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.780 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.781 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.782 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.783 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.784 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.785 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.786 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.787 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.788 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.790 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.791 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.792 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.793 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_object_lock_put_obj_retention_override_default_retention _ 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.794 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.795 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.796 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.797 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.798 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.799 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.800 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.801 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.803 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.804 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.805 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.807 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.808 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.809 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.810 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.811 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.812 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.813 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout:___ ERROR at teardown of test_object_lock_put_obj_retention_increase_period ____ 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.814 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.816 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.817 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.819 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.820 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.821 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.824 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.825 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.826 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.827 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.828 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.829 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.830 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.831 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.832 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout:____ ERROR at teardown of test_object_lock_put_obj_retention_shorten_period ____ 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.834 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.835 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.837 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.865 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.866 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.867 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.868 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.869 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.871 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.872 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.873 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.874 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.878 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.879 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.880 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_object_lock_put_obj_retention_shorten_period_bypass _ 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.882 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.883 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.885 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.886 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.887 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.888 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.889 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.890 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.891 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.893 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.896 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.897 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.898 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.900 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout:______ ERROR at teardown of test_object_lock_delete_object_with_retention ______ 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.902 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.903 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.905 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.906 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.907 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.908 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.910 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.913 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.918 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.919 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.920 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.921 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_object_lock_delete_object_with_retention_and_marker _ 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.922 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.923 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.924 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.926 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.928 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.929 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.930 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.931 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.932 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.933 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.934 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.935 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.936 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.938 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.939 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.940 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout:___ ERROR at teardown of test_object_lock_multi_delete_object_with_retention ___ 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.943 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.944 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.945 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.946 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.947 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.948 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.950 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.951 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.952 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.953 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.956 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.958 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.959 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.960 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_object_lock_put_legal_hold _____________ 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.962 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.963 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.964 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.965 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.966 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.967 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.968 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.970 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.973 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.976 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.978 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.979 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:56.980 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_object_lock_put_legal_hold_invalid_bucket ______ 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.982 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:56.983 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:56.985 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.986 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.987 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:56.990 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:56.991 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:56.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:56.993 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.994 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:56.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:56.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:56.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:56.998 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:56.999 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.000 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_object_lock_put_legal_hold_invalid_status ______ 2023-12-03T12:36:57.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.002 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.003 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.004 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.005 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.006 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.007 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.008 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.009 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.010 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.013 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.014 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.015 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.018 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.019 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.020 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.021 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_object_lock_get_legal_hold _____________ 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.022 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.023 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.024 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.025 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.026 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.029 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.030 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.031 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.033 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.034 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.035 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.036 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.037 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.038 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.039 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.040 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_object_lock_get_legal_hold_invalid_bucket ______ 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.041 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.042 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.043 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.044 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.045 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.046 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.047 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.049 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.050 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.053 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.055 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.057 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.058 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.059 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.060 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout:____ ERROR at teardown of test_object_lock_delete_object_with_legal_hold_on ____ 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.061 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.062 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.063 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.064 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.065 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.066 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.067 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.068 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.070 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.071 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.072 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.073 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.074 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.076 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.077 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.078 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.079 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.080 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout:___ ERROR at teardown of test_object_lock_delete_object_with_legal_hold_off ____ 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.084 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.085 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.087 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.088 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.089 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.092 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.093 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.097 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.098 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.099 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.100 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_object_lock_get_obj_metadata ____________ 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.101 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.102 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.103 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.104 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.105 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.106 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.107 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.108 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.109 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.110 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.112 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.114 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.117 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.118 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.119 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.120 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_object_lock_uploading_obj ______________ 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.121 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.122 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.123 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.124 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.126 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.128 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.131 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.132 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.133 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.134 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.135 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.136 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.137 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.138 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.139 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.140 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_object_lock_changing_mode_from_governance_with_bypass _ 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.141 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.143 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.144 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.146 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.147 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.148 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.149 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.150 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.151 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.152 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.154 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.156 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.157 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.158 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.160 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_object_lock_changing_mode_from_governance_without_bypass _ 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.161 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.163 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.164 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.165 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.167 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.169 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.170 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.171 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.172 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.173 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.174 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.175 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.177 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.178 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.179 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_object_lock_changing_mode_from_compliance ______ 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.180 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.181 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.182 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.183 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.185 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.186 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.187 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.188 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.189 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.190 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.192 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.193 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.194 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.196 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.197 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.198 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.199 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_copy_object_ifmatch_good ______________ 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.200 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.201 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.202 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.203 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.205 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.206 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.207 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.208 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.209 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.210 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.211 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.212 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.212 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.212 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.212 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.212 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.213 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.214 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.216 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.217 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.218 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.219 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout:___________ ERROR at teardown of test_copy_object_ifnonematch_failed ___________ 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.220 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.221 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.222 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.223 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.224 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.226 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.227 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.229 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.231 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.232 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.233 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.235 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.236 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.237 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.239 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_get_bucket_policy_status ______________ 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.240 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.241 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.242 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.243 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.246 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.249 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.250 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.251 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.252 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.253 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.254 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.255 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.256 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.257 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.258 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.259 INFO:teuthology.orchestra.run.smithi131.stdout:________ ERROR at teardown of test_get_public_acl_bucket_policy_status _________ 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.261 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.262 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.263 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.264 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.265 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.266 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.267 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.268 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.269 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.270 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.271 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.273 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.274 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.275 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.276 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.277 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.278 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout:______ ERROR at teardown of test_get_authpublic_acl_bucket_policy_status _______ 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.280 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.281 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.282 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.283 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.284 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.285 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.286 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.288 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.290 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.291 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.296 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.297 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.298 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.299 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout:_____ ERROR at teardown of test_get_publicpolicy_acl_bucket_policy_status ______ 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.300 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.301 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.304 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.306 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.307 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.309 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.312 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.313 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.314 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.316 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.317 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.318 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout:____ ERROR at teardown of test_get_nonpublicpolicy_acl_bucket_policy_status ____ 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.322 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.323 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.324 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.325 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.326 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.327 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.328 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.329 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.330 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.332 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.334 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.336 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.337 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.338 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout:___ ERROR at teardown of test_get_nonpublicpolicy_deny_bucket_policy_status ____ 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.339 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.340 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.341 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.342 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.343 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.345 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.346 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.347 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.348 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.350 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.351 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.352 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.353 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.355 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.356 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.357 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.358 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at teardown of test_get_default_public_block ______________ 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.359 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.360 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.361 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.362 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.363 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.365 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.366 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.367 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.369 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.370 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.371 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.374 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.376 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.377 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.378 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.379 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at teardown of test_put_public_block __________________ 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.380 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.381 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.382 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.383 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.384 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.385 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.386 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.387 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.389 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.390 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.391 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.392 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.394 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.395 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.396 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.397 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.399 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_block_public_put_bucket_acls ____________ 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.400 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.401 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.402 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.403 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.405 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.406 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.407 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.408 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.409 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.410 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.411 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.412 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.413 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.414 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.416 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.417 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.418 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.419 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout:__________ ERROR at teardown of test_block_public_object_canned_acls ___________ 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.420 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.421 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.422 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.424 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.426 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.427 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.428 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.429 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.430 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.431 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.432 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.433 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.434 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.436 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.437 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.438 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.439 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at teardown of test_block_public_policy _________________ 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.440 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.441 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.442 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.444 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.445 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.446 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.447 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.448 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.449 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.450 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.451 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.452 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.453 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.454 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.457 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.458 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.459 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.460 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at teardown of test_ignore_public_acls _________________ 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.462 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.463 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.464 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.466 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.467 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.468 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.469 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.470 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.471 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.472 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.473 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.474 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.475 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.477 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.478 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.479 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.480 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout:______ ERROR at teardown of test_multipart_upload_on_a_bucket_with_policy ______ 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.481 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.482 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.483 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.484 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.485 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.487 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.488 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.489 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.490 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.490 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.490 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.490 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.490 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.490 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.490 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.490 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.490 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.490 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.490 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.491 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.492 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.493 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.494 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.495 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.498 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.499 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.500 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_put_bucket_encryption_kms ______________ 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.503 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.504 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.505 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.506 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.507 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.508 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.513 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.514 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.515 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.516 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.517 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.518 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.519 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.520 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ ERROR at teardown of test_get_bucket_encryption_kms ______________ 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.521 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.522 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.523 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.524 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.526 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.526 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.526 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.526 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.526 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.526 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.526 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.526 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.526 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.527 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.528 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.530 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.531 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.532 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.534 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.535 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.536 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.537 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.538 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.539 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.540 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout:____________ ERROR at teardown of test_delete_bucket_encryption_kms ____________ 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.541 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.542 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.543 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.545 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.546 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.547 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.548 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.549 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.550 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.551 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.552 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.553 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.554 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.555 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.556 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.558 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.559 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.560 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout:_ ERROR at teardown of test_sse_kms_default_post_object_authenticated_request __ 2023-12-03T12:36:57.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.562 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.564 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.566 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.568 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.569 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.570 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.571 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.574 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.575 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.577 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.578 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.579 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.580 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.581 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at teardown of test_get_object_torrent _________________ 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.582 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.583 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.584 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.585 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.586 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.587 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.588 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.589 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.590 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.591 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.592 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.593 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.594 INFO:teuthology.orchestra.run.smithi131.stdout:configfile = 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(autouse=True) 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout: def setup_teardown(configfile): 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout: yield 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout:> teardown() 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:315: 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:285: in teardown 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.595 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.597 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.598 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.599 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at setup of test_generate_where_clause _________________ 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.602 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.603 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.604 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.605 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.606 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.608 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.610 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.611 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.612 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.613 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.614 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.615 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.617 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.618 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.619 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.620 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at setup of test_generate_projection __________________ 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.622 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.623 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.625 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.626 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.628 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.629 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.630 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.632 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.633 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.634 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.635 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.636 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.637 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.638 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.639 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.640 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ ERROR at setup of test_count_operation ____________________ 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.643 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.644 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.645 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.647 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.648 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.649 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.650 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.651 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.652 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.654 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.656 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.657 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.658 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.659 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at setup of test_count_json_operation __________________ 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.663 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.664 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.665 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.666 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.667 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.668 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.669 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.670 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.671 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.672 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.673 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.674 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.675 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.676 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.677 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.678 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.679 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at setup of test_json_column_sum_min_max ________________ 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.681 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.682 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.683 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.684 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.687 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.688 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.690 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.692 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.693 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.695 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.696 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.697 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.698 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.699 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at setup of test_json_nullif_expressions ________________ 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.700 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.701 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.702 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.704 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.705 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.706 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.708 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.709 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.714 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.716 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.717 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.718 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.719 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at setup of test_column_sum_min_max ___________________ 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.721 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.722 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.723 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.724 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.725 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.726 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.727 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.728 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.729 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.732 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.735 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.737 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.738 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.739 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.740 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at setup of test_nullif_expressions ___________________ 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.742 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.743 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.745 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.746 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.747 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.748 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.749 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.750 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.751 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.752 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.753 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.755 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.757 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.758 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at setup of test_nulliftrue_expressions _________________ 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.761 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.762 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.763 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.764 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.766 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.767 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.768 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.769 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.770 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.771 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.772 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.774 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.775 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.777 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.779 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.780 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at setup of test_is_not_null_expressions ________________ 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.781 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.783 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.784 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.785 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.786 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.787 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.788 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.789 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.790 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.791 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.792 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.793 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.794 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.797 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at setup of test_lowerupper_expressions _________________ 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.808 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.809 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.810 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.811 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.812 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.813 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.814 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.815 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.816 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.817 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.819 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.820 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ ERROR at setup of test_in_expressions _____________________ 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.821 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.826 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.827 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.828 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.830 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.832 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.833 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.834 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.835 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.837 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.838 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.839 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.840 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at setup of test_true_false_in_expressions _______________ 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.841 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.842 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.843 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.844 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.845 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.847 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.848 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.852 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.854 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.855 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.857 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.858 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.859 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ ERROR at setup of test_like_expressions ____________________ 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.860 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.862 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.864 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.865 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.866 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.867 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.868 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.869 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.870 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.871 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.873 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.874 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.876 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.877 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.878 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at setup of test_truefalselike_expressions _______________ 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.881 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.882 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.883 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.884 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.885 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.886 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.891 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.893 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.895 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.896 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.897 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.898 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at setup of test_complex_expressions __________________ 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.899 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.900 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.901 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.902 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.903 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.904 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.905 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.906 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.909 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.910 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.911 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.912 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.916 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.917 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.918 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ ERROR at setup of test_alias _________________________ 2023-12-03T12:36:57.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.921 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.922 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.924 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.926 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.927 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.929 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.930 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.931 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.936 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.937 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at setup of test_alias_cyclic_refernce _________________ 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.942 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.944 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.946 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.947 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.949 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.950 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.951 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.953 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.954 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.956 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.957 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ ERROR at setup of test_datetime ________________________ 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.962 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.963 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.966 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.967 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.969 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.970 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.971 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.973 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.973 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.973 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.973 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.973 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.973 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.973 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.973 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.974 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.975 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.978 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:57.980 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at setup of test_true_false_datetime __________________ 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.981 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.983 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:57.984 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.987 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.988 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:57.989 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:57.990 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.991 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:57.992 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:57.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:57.997 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:57.999 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.000 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ ERROR at setup of test_csv_parser _______________________ 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.001 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.003 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.004 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.005 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.006 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.007 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.008 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.010 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.012 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.013 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.014 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.015 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.018 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.020 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ ERROR at setup of test_csv_definition _____________________ 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.021 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.022 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.023 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.024 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.025 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.026 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.027 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.028 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.029 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.030 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.034 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.035 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.037 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.038 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.039 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.040 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ ERROR at setup of test_schema_definition ___________________ 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.041 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.042 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.043 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.044 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.045 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.046 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.047 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.048 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.049 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.051 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.052 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.053 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.054 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.056 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.057 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.058 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.059 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.060 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at setup of test_when_then_else_expressions _______________ 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.061 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.062 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.063 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.064 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.065 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.066 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.067 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.068 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.069 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.070 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.071 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.072 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.074 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.075 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.076 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.077 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.078 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at setup of test_coalesce_expressions __________________ 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.080 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.081 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.082 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.083 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.085 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.086 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.087 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.090 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.092 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.093 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.094 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.095 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.096 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.097 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.098 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ ERROR at setup of test_cast_expressions ____________________ 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.099 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.100 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.101 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.102 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.103 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.104 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.105 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.106 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.107 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.108 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.109 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.110 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.112 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.113 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.114 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.115 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.116 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.117 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ ERROR at setup of test_version ________________________ 2023-12-03T12:36:58.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.119 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.120 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.122 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.124 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.125 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.127 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.128 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.132 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.134 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.135 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.136 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ ERROR at setup of test_trim_expressions ____________________ 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.137 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.138 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.139 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.140 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.142 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.143 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.144 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.145 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.146 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.147 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.148 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.149 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.150 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.150 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.150 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.150 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.150 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.150 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.150 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.150 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.150 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.151 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.152 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.153 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.154 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.155 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout:______________ ERROR at setup of test_truefalse_trim_expressions _______________ 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.156 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.157 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.158 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.159 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.161 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.163 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.164 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.165 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.169 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.170 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.172 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.173 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ ERROR at setup of test_escape_expressions ___________________ 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.179 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.180 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.181 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.182 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.183 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.184 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.185 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.186 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.187 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.188 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.189 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.190 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.192 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.194 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout:________________ ERROR at setup of test_case_value_expressions _________________ 2023-12-03T12:36:58.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.196 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.197 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.198 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.199 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.200 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.201 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.203 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.204 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.205 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.206 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.207 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.208 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.209 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.210 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.211 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.212 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.213 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.214 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at setup of test_bool_cast_expressions _________________ 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.216 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.217 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.218 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.219 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.220 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.221 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.223 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.224 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.226 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.227 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.228 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.229 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.230 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.232 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.233 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ ERROR at setup of test_progress_expressions __________________ 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.234 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.235 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.236 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.237 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.238 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.239 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.240 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.241 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.242 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.243 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.248 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.249 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.250 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.252 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ ERROR at setup of test_output_serial_expressions _______________ 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.253 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.254 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.255 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.256 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.257 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.259 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.260 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.261 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.262 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.263 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.264 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.fixture(scope="package") 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: def configfile(): 2023-12-03T12:36:58.265 INFO:teuthology.orchestra.run.smithi131.stdout:> setup() 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:309: 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:272: in setup 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout: nuke_prefixed_buckets(prefix=prefix) 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:145: in nuke_prefixed_buckets 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout: buckets = get_buckets_list(client, prefix) 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:56: in get_buckets_list 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.list_buckets() 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.266 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.269 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.270 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.271 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/" 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout:=================================== FAILURES =================================== 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_multipart_upload_empty __________________________ 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.273 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.274 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.275 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.277 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.278 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.279 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.280 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.281 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.282 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.283 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_upload_empty(): 2023-12-03T12:36:58.284 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout: key1 = "mymultipart" 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout: objlen = 0 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout: (upload_id, data, parts) = _multipart_upload(bucket_name=bucket_name, key=key1, size=objlen) 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout:> e = assert_raises(ClientError, client.complete_multipart_upload,Bucket=bucket_name, Key=key1, UploadId=upload_id) 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5811: 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/utils.py:11: in assert_raises 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout: callableObj(*args, **kwargs) 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.285 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.286 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.287 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.288 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.289 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.290 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-323/mymultipart?uploadId=2~PGNoUm1cr3HwAB47rMOEx3_17c_-IEk" 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_multipart_upload_small __________________________ 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.292 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.293 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.294 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.295 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.296 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.297 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.298 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.301 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.302 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.303 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_upload_small(): 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5818: 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.305 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.306 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.307 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.308 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.309 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-324" 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_multipart_copy_small ___________________________ 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.311 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.312 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.313 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.316 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.317 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.320 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.321 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.322 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_copy_small(): 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout: src_key = 'foo' 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout:> src_bucket_name = _create_key_with_random_content(src_key) 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5894: 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.324 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.325 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.326 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.328 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-325" 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_multipart_copy_invalid_range _______________________ 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.329 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.331 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.332 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.333 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.335 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.337 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.338 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.340 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_copy_invalid_range(): 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: src_key = 'source' 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout:> src_bucket_name = _create_key_with_random_content(src_key, size=5) 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.341 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5911: 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.342 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.344 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.345 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.347 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-326" 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_multipart_copy_without_range _______________________ 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.348 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.349 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.350 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.351 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.352 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.354 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.355 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.356 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.357 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.358 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_copy_without_range(): 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: src_key = 'source' 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout:> src_bucket_name = _create_key_with_random_content(src_key, size=10) 2023-12-03T12:36:58.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5961: 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.361 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.362 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.365 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.366 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-327" 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_multipart_copy_special_names _______________________ 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.367 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.368 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.369 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.370 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.371 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.372 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.373 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.374 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.376 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.378 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.379 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_copy_special_names(): 2023-12-03T12:36:58.381 INFO:teuthology.orchestra.run.smithi131.stdout:> src_bucket_name = get_new_bucket() 2023-12-03T12:36:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.381 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5985: 2023-12-03T12:36:58.381 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.381 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.381 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.384 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.385 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.386 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-328" 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout:____________________________ test_multipart_upload _____________________________ 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.387 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.388 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.389 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.390 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.392 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.393 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.394 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.395 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.398 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.399 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_upload(): 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6019: 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.400 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.403 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.404 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.405 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-329" 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_multipart_copy_versioned _________________________ 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.406 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.407 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.408 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.409 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.410 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.411 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.412 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.413 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.414 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.415 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.416 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.418 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_copy_versioned(): 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout:> src_bucket_name = get_new_bucket() 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6077: 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.419 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.420 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.421 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.422 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.423 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.424 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-330" 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_multipart_upload_resend_part _______________________ 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.425 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.426 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.427 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.428 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.430 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.431 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.432 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.433 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.434 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.435 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.436 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_upload_resend_part(): 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6123: 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.438 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.439 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.440 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.441 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.442 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.443 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-331" 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________ test_multipart_upload_multiple_sizes _____________________ 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.444 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.446 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.447 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.448 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.450 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.451 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.451 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.452 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.453 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.455 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_upload_multiple_sizes(): 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6134: 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.457 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.458 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.459 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.460 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.461 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.462 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-332" 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_multipart_copy_multiple_sizes ______________________ 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.463 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.464 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.465 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.466 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.467 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.468 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.469 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.470 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.471 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.472 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.474 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_copy_multiple_sizes(): 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: src_key = 'foo' 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout:> src_bucket_name = _create_key_with_random_content(src_key, 12*1024*1024) 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6165: 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.476 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.479 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.480 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.481 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-333" 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________ test_multipart_upload_size_too_small _____________________ 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.483 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.484 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.485 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.486 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.487 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.488 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.489 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.490 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.491 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.492 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.493 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.494 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_upload_size_too_small(): 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6202: 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.495 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.496 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.497 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.498 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.499 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.500 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-334" 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_multipart_upload_contents ________________________ 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.501 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.503 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.504 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.505 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.506 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.507 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.509 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.511 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.512 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_upload_contents(): 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.513 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6248: 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.514 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.515 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.516 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.517 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.518 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-335" 2023-12-03T12:36:58.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ test_multipart_upload_overwrite_existing_object ________________ 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.520 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.521 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.522 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.523 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.524 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.525 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.526 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.527 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.528 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.530 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_upload_overwrite_existing_object(): 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6252: 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.532 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.535 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.537 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-336" 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_abort_multipart_upload __________________________ 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.538 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.539 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.540 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.541 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.542 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.543 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.544 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.545 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.546 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.547 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.549 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: def test_abort_multipart_upload(): 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6277: 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.550 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.551 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.552 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.553 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.554 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.555 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-337" 2023-12-03T12:36:58.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ test_abort_multipart_upload_not_found _____________________ 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.559 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.560 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.563 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.564 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.567 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.568 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout: def test_abort_multipart_upload_not_found(): 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6289: 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.569 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.572 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.573 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.574 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-338" 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_list_multipart_upload __________________________ 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.576 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.577 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.578 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.579 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.581 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.582 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.583 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.583 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.583 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.583 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.583 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.585 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.587 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.588 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout: def test_list_multipart_upload(): 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6301: 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.589 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.590 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.591 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.592 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.593 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-339" 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.595 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_list_multipart_upload_owner _______________________ 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.597 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.598 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.599 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.600 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.601 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.602 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.603 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.604 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.606 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout: def test_list_multipart_upload_owner(): 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6332: 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.608 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.609 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.611 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.612 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.613 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-340" 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_multipart_upload_missing_part ______________________ 2023-12-03T12:36:58.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.615 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.616 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.618 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.619 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.620 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.621 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.622 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.623 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.624 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.626 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_upload_missing_part(): 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6377: 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.628 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.629 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.630 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.631 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-341" 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________ test_multipart_upload_incorrect_etag _____________________ 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.635 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.636 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.637 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.639 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.640 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.641 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.642 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.645 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_upload_incorrect_etag(): 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6396: 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.646 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.647 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.648 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.649 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.650 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.651 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-342" 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_multipart_get_part ____________________________ 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.652 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.654 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.655 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.658 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.659 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.660 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.662 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.663 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_get_part(): 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6416: 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.665 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.666 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.667 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.668 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.669 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.670 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-343" 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_non_multipart_get_part __________________________ 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.671 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.672 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.673 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.674 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.676 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.677 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.678 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.679 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.680 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.681 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout: def test_non_multipart_get_part(): 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6458: 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.684 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.685 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.686 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.687 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.688 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.689 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-344" 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout:______________________________ test_100_continue _______________________________ 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.692 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.693 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.694 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.695 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.696 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.698 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.699 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.700 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout: def test_100_continue(): 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:36:58.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6514: 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.704 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.706 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.707 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.709 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-345" 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout:________________________________ test_set_cors _________________________________ 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.710 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.711 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.712 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.714 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.716 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.717 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.718 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.719 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.720 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.721 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout: def test_set_cors(): 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6532: 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.723 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.724 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.725 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.726 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-346" 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_cors_origin_response ___________________________ 2023-12-03T12:36:58.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.729 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.730 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.731 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.732 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.733 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.734 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.735 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.736 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.737 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.738 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.739 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: def test_cors_origin_response(): 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _setup_bucket_acl(bucket_acl='public-read') 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.740 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6567: 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:3245: in _setup_bucket_acl 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.742 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.743 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.744 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.745 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-347" 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.746 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_cors_origin_wildcard ___________________________ 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.747 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.748 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.749 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.750 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.751 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.752 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.753 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.755 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.756 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.757 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.758 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout: def test_cors_origin_wildcard(): 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _setup_bucket_acl(bucket_acl='public-read') 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6642: 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:3245: in _setup_bucket_acl 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.759 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.762 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.763 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-348" 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_cors_header_option ____________________________ 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.766 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.767 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.768 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.770 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.771 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.772 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.775 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout: def test_cors_header_option(): 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _setup_bucket_acl(bucket_acl='public-read') 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6667: 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:3245: in _setup_bucket_acl 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.777 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.778 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.779 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.780 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.781 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.782 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-349" 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_cors_presigned_get_object ________________________ 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.783 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.785 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.786 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.787 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.790 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.791 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.792 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.793 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout: def test_cors_presigned_get_object(): 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_cors_options_presigned_get_object(client=get_client()) 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6716: 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6693: in _test_cors_options_presigned_get_object 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = _setup_bucket_object_acl('public-read', 'public-read', client=client) 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:3234: in _setup_bucket_object_acl 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.796 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.798 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.799 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.800 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-350" 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ test_cors_presigned_get_object_tenant _____________________ 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.801 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.802 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.803 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.804 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.805 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.806 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.807 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.808 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.809 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.811 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.812 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout: def test_cors_presigned_get_object_tenant(): 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_cors_options_presigned_get_object(client=get_tenant_client()) 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6719: 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6693: in _test_cors_options_presigned_get_object 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = _setup_bucket_object_acl('public-read', 'public-read', client=client) 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:3234: in _setup_bucket_object_acl 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(ACL=bucket_acl, Bucket=bucket_name) 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.813 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.814 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.815 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.816 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.817 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.818 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-351" 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_set_bucket_tagging ____________________________ 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.819 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.821 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.823 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.825 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.827 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.829 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.830 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout: def test_set_bucket_tagging(): 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6723: 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.831 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.832 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.834 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.835 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.836 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-352" 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________________ test_atomic_read_1mb _____________________________ 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.837 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.838 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.839 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.840 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.843 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.845 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.846 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.848 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout: def test_atomic_read_1mb(): 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_atomic_read(1024*1024) 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6871: 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6851: in _test_atomic_read 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.849 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.852 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.853 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.854 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-353" 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________________ test_atomic_read_4mb _____________________________ 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.857 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.859 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.861 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.862 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.863 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.864 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.866 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: def test_atomic_read_4mb(): 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_atomic_read(1024*1024*4) 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6874: 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.867 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6851: in _test_atomic_read 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.869 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.870 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.871 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-354" 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________________ test_atomic_read_8mb _____________________________ 2023-12-03T12:36:58.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.874 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.875 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.876 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.877 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.879 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.880 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.882 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.883 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: def test_atomic_read_8mb(): 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_atomic_read(1024*1024*8) 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6877: 2023-12-03T12:36:58.885 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6851: in _test_atomic_read 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.886 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.888 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.889 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.890 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-355" 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout:____________________________ test_atomic_write_1mb _____________________________ 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.891 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.893 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.894 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.895 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.896 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.897 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.898 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.899 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.900 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.902 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: def test_atomic_write_1mb(): 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_atomic_write(1024*1024) 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6912: 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6887: in _test_atomic_write 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.903 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.905 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.906 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.907 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.908 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-356" 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout:____________________________ test_atomic_write_4mb _____________________________ 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.909 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.910 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.911 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.912 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.914 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.915 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.916 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.918 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.919 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: def test_atomic_write_4mb(): 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_atomic_write(1024*1024*4) 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6915: 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.921 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6887: in _test_atomic_write 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.922 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.924 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.925 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.926 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-357" 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout:____________________________ test_atomic_write_8mb _____________________________ 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.928 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.930 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.931 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.933 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.934 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.935 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.936 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.937 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.938 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: def test_atomic_write_8mb(): 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_atomic_write(1024*1024*8) 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6918: 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6887: in _test_atomic_write 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.940 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.941 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.942 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.943 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.944 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-358" 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_atomic_dual_write_1mb __________________________ 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.947 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.948 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.949 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.951 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.952 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.953 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.954 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.956 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: def test_atomic_dual_write_1mb(): 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_atomic_dual_write(1024*1024) 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6945: 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6925: in _test_atomic_dual_write 2023-12-03T12:36:58.957 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.958 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.960 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.961 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.962 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-359" 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_atomic_dual_write_4mb __________________________ 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.964 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.965 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.966 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.967 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.968 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.969 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.970 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.971 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.973 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.974 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: def test_atomic_dual_write_4mb(): 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_atomic_dual_write(1024*1024*4) 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6948: 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6925: in _test_atomic_dual_write 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.975 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.977 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.978 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.979 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:58.980 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-360" 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_atomic_dual_write_8mb __________________________ 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.981 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.982 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:58.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:58.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.986 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.987 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:58.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.990 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.991 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:58.993 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: def test_atomic_dual_write_8mb(): 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_atomic_dual_write(1024*1024*8) 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6951: 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6925: in _test_atomic_dual_write 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:58.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:58.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.997 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:58.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:58.999 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.000 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-361" 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_atomic_conditional_write_1mb _______________________ 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.001 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.002 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.003 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.004 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.009 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.010 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.011 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_aws 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: def test_atomic_conditional_write_1mb(): 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_atomic_conditional_write(1024*1024) 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6984: 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:6961: in _test_atomic_conditional_write 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.013 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.015 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.016 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.017 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.018 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-362" 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_atomic_multipart_upload_write ______________________ 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.019 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.020 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.021 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.022 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.023 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.024 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.025 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.026 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.027 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.028 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.029 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.030 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: def test_atomic_multipart_upload_write(): 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7044: 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.031 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.032 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.034 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.035 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.036 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-363" 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ test_multipart_resend_first_finishes_last ___________________ 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.037 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.038 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.039 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.040 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.041 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.042 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.043 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.044 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.046 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.048 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_resend_first_finishes_last(): 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7082: 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.050 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.053 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.054 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-364" 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_ranged_request_response_code _______________________ 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.057 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.059 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.061 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.062 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.066 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.067 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout: def test_ranged_request_response_code(): 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout: content = 'testcontent' 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7141: 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.071 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.072 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.073 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-365" 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ test_ranged_big_request_response_code _____________________ 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.074 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.075 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.076 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.077 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.078 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.080 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.081 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.082 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.083 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.084 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.085 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout: def test_ranged_big_request_response_code(): 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout: content = _generate_random_string(8*1024*1024) 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.086 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7159: 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.089 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.090 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-366" 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ test_ranged_request_skip_leading_bytes_response_code _____________ 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.092 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.093 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.094 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.095 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.096 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.098 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.099 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.101 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.102 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.103 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: def test_ranged_request_skip_leading_bytes_response_code(): 2023-12-03T12:36:59.104 INFO:teuthology.orchestra.run.smithi131.stdout: content = 'testcontent' 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7174: 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.105 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.106 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.107 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.108 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.110 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-367" 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout:___________ test_ranged_request_return_trailing_bytes_response_code ____________ 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.111 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.112 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.113 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.114 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.115 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.117 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.118 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.119 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.120 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: def test_ranged_request_return_trailing_bytes_response_code(): 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: content = 'testcontent' 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7189: 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.125 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.126 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.127 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.128 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-368" 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.129 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_ranged_request_invalid_range _______________________ 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.131 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.132 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.133 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.134 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.135 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.136 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.138 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.139 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.140 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.141 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout: def test_ranged_request_invalid_range(): 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout: content = 'testcontent' 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7203: 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.142 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.144 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.145 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.146 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.147 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-369" 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_ranged_request_empty_object _______________________ 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.148 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.149 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.151 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.152 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.154 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.155 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.156 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.157 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.158 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout: def test_ranged_request_empty_object(): 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout: content = '' 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.160 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7217: 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.161 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.162 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.163 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.164 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.165 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-370" 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ test_versioning_bucket_create_suspend _____________________ 2023-12-03T12:36:59.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.167 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.168 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.169 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.170 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.171 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.172 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.173 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.174 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.176 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.177 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_bucket_create_suspend(): 2023-12-03T12:36:59.178 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7229: 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.179 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.180 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.181 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.183 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.184 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-371" 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ test_versioning_obj_create_read_remove ____________________ 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.186 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.187 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.188 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.189 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.190 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.192 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.193 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.194 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.195 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_obj_create_read_remove(): 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7312: 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.197 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.199 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.200 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.201 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.202 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-372" 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ test_versioning_obj_create_read_remove_head __________________ 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.203 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.204 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.205 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.206 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.207 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.208 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.209 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.210 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.211 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.212 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.214 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.215 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_obj_create_read_remove_head(): 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7326: 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.218 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.219 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.220 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.221 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-373" 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_versioning_obj_plain_null_version_removal ________________ 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.222 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.223 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.224 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.225 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.226 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.227 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.228 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.229 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.230 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.231 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.232 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_obj_plain_null_version_removal(): 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.233 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7360: 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.234 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.235 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.236 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.237 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.238 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-374" 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ test_versioning_obj_plain_null_version_overwrite _______________ 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.239 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.240 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.241 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.242 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.243 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.244 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.245 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.246 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.247 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.249 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_obj_plain_null_version_overwrite(): 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7380: 2023-12-03T12:36:59.255 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.256 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.258 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.259 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-375" 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.261 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout:__________ test_versioning_obj_plain_null_version_overwrite_suspended __________ 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.262 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.263 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.264 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.265 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.266 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.267 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.268 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.269 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.270 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.271 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.272 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_obj_plain_null_version_overwrite_suspended(): 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7413: 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.275 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.276 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.277 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.278 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-376" 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.279 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________ test_versioning_obj_suspend_versions _____________________ 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.280 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.281 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.282 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.283 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.284 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.285 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.286 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.287 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.288 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_obj_suspend_versions(): 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7478: 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.292 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.293 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.294 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.295 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.296 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.297 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-377" 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_versioning_obj_create_versions_remove_all ________________ 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.298 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.299 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.300 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.301 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.302 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.304 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.305 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.306 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.308 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.309 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_obj_create_versions_remove_all(): 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7510: 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.310 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.311 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.312 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.313 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.314 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.315 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.316 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-378" 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout:___________ test_versioning_obj_create_versions_remove_special_names ___________ 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.317 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.319 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.321 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.322 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.323 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.324 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.325 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.326 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.327 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_obj_create_versions_remove_special_names(): 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7526: 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.330 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.332 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.333 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.334 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-379" 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_versioning_obj_create_overwrite_multipart ________________ 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.335 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.336 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.337 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.338 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.340 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.341 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.342 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.345 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.346 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_obj_create_overwrite_multipart(): 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7544: 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.351 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.352 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.353 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-380" 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_versioning_obj_list_marker ________________________ 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.354 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.356 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.357 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.358 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.359 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.360 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.361 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.362 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.363 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.364 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.365 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_obj_list_marker(): 2023-12-03T12:36:59.366 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7572: 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.367 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.368 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.369 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.371 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.372 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-381" 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_versioning_copy_obj_version _______________________ 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.373 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.375 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.376 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.378 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.379 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.380 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.381 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.382 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_copy_obj_version(): 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7628: 2023-12-03T12:36:59.385 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.386 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.388 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.389 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.390 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.391 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-382" 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________ test_versioning_multi_object_delete ______________________ 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.392 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.394 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.395 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.396 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.397 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.398 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.399 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.401 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.402 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.403 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.404 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_multi_object_delete(): 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7665: 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.405 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.406 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.408 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.409 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.410 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-383" 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.411 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ test_versioning_multi_object_delete_with_marker ________________ 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.412 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.413 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.414 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.415 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.416 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.417 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.418 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.419 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.420 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.421 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.423 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_multi_object_delete_with_marker(): 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7690: 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.424 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.425 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.428 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.429 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-384" 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout:____________ test_versioning_multi_object_delete_with_marker_create ____________ 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.430 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.432 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.433 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.434 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.435 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.436 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.438 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.439 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.440 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.441 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_multi_object_delete_with_marker_create(): 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7723: 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.442 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.443 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.446 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.447 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-385" 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_versioned_object_acl ___________________________ 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.449 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.450 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.451 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.452 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.453 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.454 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.455 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.456 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.458 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.459 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioned_object_acl(): 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7744: 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.460 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.461 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.464 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.465 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-386" 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_versioned_object_acl_no_version_specified ________________ 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.466 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.467 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.468 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.470 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.471 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.472 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.474 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.475 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.476 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.477 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioned_object_acl_no_version_specified(): 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7812: 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.480 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.481 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.482 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.483 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-387" 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout:______________ test_versioned_concurrent_object_create_and_remove ______________ 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.484 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.486 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.487 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.488 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.490 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.491 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.493 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.494 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioned_concurrent_object_create_and_remove(): 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7924: 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.496 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.497 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.499 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.500 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.501 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-388" 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout:______________________________ test_lifecycle_set ______________________________ 2023-12-03T12:36:59.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.504 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.505 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.507 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.508 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.509 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.513 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.514 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_set(): 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7953: 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.516 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.517 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.518 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.519 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.520 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-389" 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout:______________________________ test_lifecycle_get ______________________________ 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.522 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.523 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.524 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.525 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.527 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.528 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.529 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.530 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.531 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.532 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_get(): 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7963: 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.534 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.536 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.537 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.538 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-390" 2023-12-03T12:36:59.539 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_lifecycle_get_no_id ___________________________ 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.540 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.541 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.542 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.543 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.544 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.546 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.548 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.549 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.550 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.551 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_get_no_id(): 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:7974: 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.552 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.553 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.554 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.555 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.556 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.557 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-391" 2023-12-03T12:36:59.558 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_lifecycle_id_too_long __________________________ 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.560 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.561 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.562 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.563 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.564 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.565 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.566 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.567 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.568 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.569 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.570 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_id_too_long(): 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8322: 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.571 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.572 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.574 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.575 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.576 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-392" 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout:____________________________ test_lifecycle_same_id ____________________________ 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.577 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.578 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.579 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.580 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.581 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.582 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.583 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.585 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.586 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.587 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.588 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_same_id(): 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8334: 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.589 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.591 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.592 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.592 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.592 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.592 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.592 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.592 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.592 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.592 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.592 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.592 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.592 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.617 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:36:59.617 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.617 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.617 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.617 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.617 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.617 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.617 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.617 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.618 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-393" 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_lifecycle_invalid_status _________________________ 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.620 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.621 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.622 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.623 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.624 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.625 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.626 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.628 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.629 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.630 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_invalid_status(): 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8347: 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.634 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.635 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.636 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-394" 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.637 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_lifecycle_set_date ____________________________ 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.638 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.639 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.640 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.641 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.643 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.644 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.646 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.647 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.648 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.649 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.650 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_set_date(): 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8375: 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.651 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.652 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.652 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.652 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.652 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.652 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.653 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.654 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.655 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.656 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-395" 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.657 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_lifecycle_set_invalid_date ________________________ 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.659 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.660 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.661 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.662 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.663 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.664 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.666 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.667 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_set_invalid_date(): 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8385: 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.670 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.671 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.674 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.675 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-396" 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_lifecycle_set_noncurrent _________________________ 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.676 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.678 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.681 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.682 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.683 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_set_noncurrent(): 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_objects(keys=['past/foo', 'future/bar']) 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8602: 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_location = bucket.create() 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:36:59.688 INFO:teuthology.orchestra.run.smithi131.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.689 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.690 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.691 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.692 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.693 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-397" 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_lifecycle_set_deletemarker ________________________ 2023-12-03T12:36:59.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.695 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.696 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.697 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.698 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.699 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.700 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.701 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.703 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.704 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.705 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.706 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_set_deletemarker(): 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8641: 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.707 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.708 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.709 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.709 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.709 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.709 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.709 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.709 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.710 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.711 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-398" 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_lifecycle_set_filter ___________________________ 2023-12-03T12:36:59.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.714 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.715 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.716 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.717 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.718 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.719 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.720 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.722 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.723 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.724 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.725 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_set_filter(): 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8650: 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.726 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.730 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.731 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-399" 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_lifecycle_set_empty_filter ________________________ 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.733 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.735 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.736 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.737 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.738 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.741 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.742 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.743 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_set_empty_filter(): 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8659: 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.744 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.746 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.747 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.748 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.749 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-400" 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_lifecycle_set_multipart _________________________ 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.750 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.751 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.752 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.753 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.754 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.756 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.757 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.758 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.759 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.761 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_set_multipart(): 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.762 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8703: 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.763 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.764 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.765 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.766 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-401" 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ test_lifecycle_transition_set_invalid_date __________________ 2023-12-03T12:36:59.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.769 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.770 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.771 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.772 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.774 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.775 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.776 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.777 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.778 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.779 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.lifecycle 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout: def test_lifecycle_transition_set_invalid_date(): 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8752: 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.780 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.782 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.783 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.784 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.785 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-402" 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_encrypted_transfer_1b __________________________ 2023-12-03T12:36:59.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.787 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.788 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.789 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.790 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.792 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.793 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.794 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.797 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encrypted_transfer_1b(): 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_encryption_sse_customer_write(1) 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9326: 2023-12-03T12:36:59.798 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.799 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.801 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.802 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.803 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-403" 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_encrypted_transfer_1kb __________________________ 2023-12-03T12:36:59.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.805 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.806 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.807 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.809 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.810 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.811 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.812 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.813 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.814 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.815 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.816 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encrypted_transfer_1kb(): 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_encryption_sse_customer_write(1024) 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9332: 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.817 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.820 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.821 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.822 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-404" 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_encrypted_transfer_1MB __________________________ 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.823 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.825 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.826 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.827 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.828 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.829 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.833 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.834 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encrypted_transfer_1MB(): 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_encryption_sse_customer_write(1024*1024) 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.835 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9338: 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.836 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.837 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.838 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.839 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.840 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-405" 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_encrypted_transfer_13b __________________________ 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.842 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.843 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.844 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.846 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.850 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.852 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.853 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encrypted_transfer_13b(): 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_encryption_sse_customer_write(13) 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9344: 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:8766: in _test_encryption_sse_customer_write 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:36:59.854 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.856 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.857 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.858 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.859 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-406" 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_encryption_sse_c_method_head _______________________ 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.860 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.861 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.862 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.863 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.864 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.865 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.866 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.867 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.868 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.869 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.870 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.871 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encryption_sse_c_method_head(): 2023-12-03T12:36:59.872 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9349: 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.873 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.874 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.875 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.876 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.877 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.878 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-407" 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_encryption_sse_c_present _________________________ 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.879 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.881 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.882 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.883 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.884 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.885 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.886 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.887 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.888 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.889 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encryption_sse_c_present(): 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9374: 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.891 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.892 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.894 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.895 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.896 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-408" 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_encryption_sse_c_other_key ________________________ 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.897 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.898 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.899 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.900 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.901 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.902 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.904 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.905 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.906 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.907 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.908 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encryption_sse_c_other_key(): 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9394: 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.909 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.910 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.911 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.912 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.913 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.914 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-409" 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_encryption_sse_c_invalid_md5 _______________________ 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.915 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.916 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.917 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.918 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.920 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.921 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.922 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.923 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.924 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.925 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.926 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:36:59.927 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encryption_sse_c_invalid_md5(): 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9421: 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.928 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.930 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.931 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.932 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.933 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-410" 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_encryption_sse_c_no_md5 _________________________ 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.936 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.937 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.938 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.939 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.940 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.941 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.942 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.943 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.944 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encryption_sse_c_no_md5(): 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9439: 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.946 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.947 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.948 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.949 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.950 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.951 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-411" 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_encryption_sse_c_no_key _________________________ 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.952 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.954 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.955 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.956 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.958 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.959 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.961 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.962 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.963 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.964 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encryption_sse_c_no_key(): 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9454: 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.965 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.969 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.970 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-412" 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_encryption_key_no_sse_c _________________________ 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.973 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.974 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.975 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.976 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.977 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.979 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.980 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:36:59.981 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encryption_key_no_sse_c(): 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9468: 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:36:59.983 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:36:59.984 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.985 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.986 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:36:59.987 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.988 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-413" 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ test_encryption_sse_c_multipart_upload ____________________ 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.989 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.990 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:36:59.991 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:36:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.993 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:36:59.994 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:36:59.995 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:36:59.996 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:36:59.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:36:59.998 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:36:59.999 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.000 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encryption_sse_c_multipart_upload(): 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9535: 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.001 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.002 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.005 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.006 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-414" 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ test_encryption_sse_c_unaligned_multipart_upload _______________ 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.007 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.008 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.009 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.010 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.012 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.013 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.014 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.015 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.017 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encryption_sse_c_unaligned_multipart_upload(): 2023-12-03T12:37:00.019 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9581: 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.020 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.022 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.023 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.024 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.025 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-415" 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ test_encryption_sse_c_multipart_bad_download _________________ 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.026 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.027 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.028 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.029 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.031 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.032 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.033 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.034 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.035 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.037 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.038 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encryption_sse_c_multipart_bad_download(): 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9682: 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.040 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.042 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.043 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.044 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-416" 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout:___________ test_encryption_sse_c_post_object_authenticated_request ____________ 2023-12-03T12:37:00.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.046 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.048 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.049 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.050 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.051 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.052 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.053 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.054 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.055 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.056 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout: def test_encryption_sse_c_post_object_authenticated_request(): 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9729: 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.058 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.060 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.061 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.062 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.063 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-417" 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_sse_kms_method_head ___________________________ 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.065 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.066 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.067 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.069 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.070 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.071 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.072 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.075 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_method_head(): 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9813: 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.077 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.078 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.079 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.080 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.081 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.082 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-418" 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________________ test_sse_kms_present _____________________________ 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.083 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.084 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.085 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.086 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.088 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.089 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.091 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.092 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.093 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.094 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_present(): 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9840: 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.095 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.098 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.099 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.100 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-419" 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________________ test_sse_kms_no_key ______________________________ 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.101 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.102 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.103 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.105 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.106 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.107 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.108 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.110 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.111 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_no_key(): 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9859: 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.114 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.115 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.117 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.118 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.119 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-420" 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_sse_kms_not_declared ___________________________ 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.120 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.121 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.122 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.123 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.124 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.125 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.126 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.127 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.130 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_not_declared(): 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9875: 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.132 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.135 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.136 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.137 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-421" 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_sse_kms_multipart_upload _________________________ 2023-12-03T12:37:00.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.139 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.140 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.141 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.142 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.143 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.144 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.145 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.146 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.147 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.148 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.149 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_multipart_upload(): 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9894: 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.152 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.153 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.154 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.155 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.156 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-422" 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ test_sse_kms_multipart_invalid_chunks_1 ____________________ 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.157 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.158 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.159 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.160 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.162 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.163 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.164 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.165 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.166 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.167 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.168 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_multipart_invalid_chunks_1(): 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid2 = get_secondary_kms_keyid() 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9940: 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.169 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.170 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.172 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.173 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.174 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-423" 2023-12-03T12:37:00.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ test_sse_kms_multipart_invalid_chunks_2 ____________________ 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.176 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.178 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.179 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.180 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.181 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.182 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.183 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.185 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.186 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.187 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_multipart_invalid_chunks_2(): 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9966: 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.189 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.190 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.191 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.192 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-424" 2023-12-03T12:37:00.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_sse_kms_post_object_authenticated_request ________________ 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.194 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.196 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.197 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.198 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.199 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.200 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.201 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.202 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.203 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_post_object_authenticated_request(): 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9992: 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.206 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.207 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.208 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.209 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.210 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.211 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-425" 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_sse_kms_transfer_1b ___________________________ 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.212 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.213 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.214 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.215 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.216 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.217 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.218 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.219 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.220 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.221 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.222 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.223 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_transfer_1b(): 2023-12-03T12:37:00.224 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout: if kms_keyid is None: 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_sse_kms_customer_write(1, key_id = kms_keyid) 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10040: 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.225 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.226 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.228 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.230 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-426" 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_sse_kms_transfer_1kb ___________________________ 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.231 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.232 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.233 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.235 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.237 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.238 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.239 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.240 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.241 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.242 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_transfer_1kb(): 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: if kms_keyid is None: 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:37:00.243 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_sse_kms_customer_write(1024, key_id = kms_keyid) 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10049: 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.244 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.245 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.246 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.248 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.249 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-427" 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_sse_kms_transfer_1MB ___________________________ 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.250 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.251 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.252 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.254 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.255 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.258 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.260 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.261 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_transfer_1MB(): 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout: if kms_keyid is None: 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_sse_kms_customer_write(1024*1024, key_id = kms_keyid) 2023-12-03T12:37:00.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10058: 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.263 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.264 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.265 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.266 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.267 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-428" 2023-12-03T12:37:00.268 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_sse_kms_transfer_13b ___________________________ 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.269 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.270 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.271 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.272 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.273 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.274 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.275 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.277 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.278 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.279 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_transfer_13b(): 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout: if kms_keyid is None: 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout:> _test_sse_kms_customer_write(13, key_id = kms_keyid) 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10067: 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:9788: in _test_sse_kms_customer_write 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.281 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.282 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.283 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.284 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.285 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.286 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-429" 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.287 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_sse_kms_read_declare ___________________________ 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.289 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.291 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.292 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.293 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.294 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.296 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.297 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.298 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_read_declare(): 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.299 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10072: 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.300 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.301 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.302 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.303 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-430" 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.305 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout:______________________________ test_bucket_policy ______________________________ 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.307 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.309 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.310 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.311 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.312 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.314 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.315 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.317 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy(): 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10091: 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.319 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.320 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.321 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.322 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.323 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-431" 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________________ test_bucketv2_policy _____________________________ 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.324 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.325 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.326 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.327 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.328 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.329 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.332 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.333 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.335 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.list_objects_v2 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucketv2_policy(): 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10121: 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.336 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.339 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.341 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-432" 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:____________________________ test_bucket_policy_acl ____________________________ 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.342 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.343 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.344 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.345 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.347 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.348 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.349 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.350 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.351 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.352 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_acl(): 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10150: 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.354 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.355 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.356 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.357 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.358 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-433" 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_bucketv2_policy_acl ___________________________ 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.361 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.362 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.364 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.365 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.366 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.368 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.370 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.371 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.list_objects_v2 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucketv2_policy_acl(): 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10186: 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.372 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.373 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.374 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.375 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.376 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.377 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-434" 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_bucket_policy_another_bucket _______________________ 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.379 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.380 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.381 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.382 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.383 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.384 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.385 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.386 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.388 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_another_bucket(): 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10310: 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.390 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.393 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.394 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.395 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-435" 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________ test_bucketv2_policy_another_bucket ______________________ 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.398 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.399 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.400 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.401 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.402 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.403 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.404 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.405 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.406 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.list_objects_v2 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucketv2_policy_another_bucket(): 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10348: 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.408 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.409 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.411 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.412 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.413 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-436" 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________________ test_get_obj_tagging _____________________________ 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.414 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.416 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.417 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.418 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.419 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.420 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.421 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.422 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.424 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.425 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_obj_tagging(): 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputtags' 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10458: 2023-12-03T12:37:00.426 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.427 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.428 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.429 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-437" 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout:__________________________ test_get_obj_head_tagging ___________________________ 2023-12-03T12:37:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.433 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.434 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.436 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.437 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.438 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.439 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.440 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.441 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.442 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.443 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.444 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_obj_head_tagging(): 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputtags' 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10472: 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.446 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.447 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.448 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.450 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-438" 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout:______________________________ test_put_max_tags _______________________________ 2023-12-03T12:37:00.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.452 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.453 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.455 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.456 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.457 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.458 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.459 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.460 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.461 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.462 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.463 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_max_tags(): 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputmaxtags' 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10488: 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.464 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.466 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.467 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.468 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.469 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-439" 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________________ test_put_excess_tags _____________________________ 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.470 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.471 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.472 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.474 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.475 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.476 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.477 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.479 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.480 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.481 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_excess_tags(): 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputmaxtags' 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10501: 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.483 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.484 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.485 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.485 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.485 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.485 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.485 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.487 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.488 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.489 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-440" 2023-12-03T12:37:00.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_put_max_kvsize_tags ___________________________ 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.491 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.493 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.494 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.497 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.498 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.499 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.500 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.502 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_max_kvsize_tags(): 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputmaxkeysize' 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10516: 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.503 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.504 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.506 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.508 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.509 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-441" 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_put_excess_key_tags ___________________________ 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.510 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.511 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.513 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.514 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.515 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.516 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.517 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.518 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.519 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.522 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_excess_key_tags(): 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputexcesskeytags' 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10537: 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.523 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.524 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.525 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.526 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.527 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.528 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-442" 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_put_excess_val_tags ___________________________ 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.531 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.532 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.533 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.535 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.536 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.538 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.541 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_excess_val_tags(): 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputexcesskeytags' 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10559: 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.543 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.544 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.546 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.547 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.548 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-443" 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________________ test_put_modify_tags _____________________________ 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.550 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.551 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.552 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.553 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.554 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.555 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.556 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.557 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.558 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.559 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.560 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.561 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_modify_tags(): 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputmodifytags' 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10582: 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.562 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.563 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.564 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.565 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.566 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.567 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.568 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-444" 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________________ test_put_delete_tags _____________________________ 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.569 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.570 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.571 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.572 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.573 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.574 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.575 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.576 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.578 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.579 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.580 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_delete_tags(): 2023-12-03T12:37:00.581 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputmodifytags' 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10612: 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.582 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.583 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.585 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.586 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-445" 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ test_post_object_tags_anonymous_request ____________________ 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.588 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.589 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.590 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.591 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.592 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.593 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.594 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.595 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.596 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.597 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.598 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: def test_post_object_tags_anonymous_request(): 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:00.600 INFO:teuthology.orchestra.run.smithi131.stdout: url = _get_post_url(bucket_name) 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(ACL='public-read-write', Bucket=bucket_name) 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10634: 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.601 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.602 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.603 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.604 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.605 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.606 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-446" 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ test_post_object_tags_authenticated_request __________________ 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.607 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.608 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.609 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.611 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.613 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.614 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.615 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.616 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.617 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.618 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.619 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout: def test_post_object_tags_authenticated_request(): 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10662: 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.621 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.622 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.623 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.625 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.626 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-447" 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout:____________________________ test_put_obj_with_tags ____________________________ 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.627 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.628 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.630 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.632 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.633 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.634 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.635 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.636 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.638 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.639 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_obj_with_tags(): 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10709: 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.640 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.641 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.642 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.643 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.644 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.645 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.646 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-448" 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_get_tags_acl_public ___________________________ 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.647 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.648 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.651 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.653 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.654 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.655 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.656 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.658 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_tags_acl_public(): 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputtagsacl' 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10743: 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.660 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.661 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.662 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.663 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.664 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.665 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.666 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-449" 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_put_tags_acl_public ___________________________ 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.667 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.668 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.669 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.670 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.672 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.673 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.674 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.675 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.676 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.678 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.679 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_tags_acl_public(): 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputtagsacl' 2023-12-03T12:37:00.680 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10766: 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.681 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.682 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.684 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.685 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.686 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-450" 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout:_________________________ test_delete_tags_obj_public __________________________ 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.688 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.689 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.690 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.691 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.692 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.693 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.694 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.695 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.696 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.698 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.699 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout: def test_delete_tags_obj_public(): 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'testputtagsacl' 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_key_with_random_content(key) 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.700 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10787: 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:5832: in _create_key_with_random_content 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket() 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.701 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.702 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.703 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.704 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.705 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.706 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-451" 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout:____________ test_versioning_bucket_atomic_upload_return_version_id ____________ 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.707 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.708 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.709 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.710 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.712 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.713 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.714 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.715 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.716 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.717 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.718 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.719 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.720 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_bucket_atomic_upload_return_version_id(): 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10809: 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.721 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.722 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.723 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.724 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.725 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-452" 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.727 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout:__________ test_versioning_bucket_multipart_upload_return_version_id ___________ 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.728 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.730 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.731 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.732 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.733 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.734 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.735 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.736 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.737 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.738 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.739 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout: def test_versioning_bucket_multipart_upload_return_version_id(): 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout: content_type='text/bla' 2023-12-03T12:37:00.740 INFO:teuthology.orchestra.run.smithi131.stdout: objlen = 30 * 1024 * 1024 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10841: 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.741 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.742 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.743 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.744 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.745 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-453" 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ test_bucket_policy_get_obj_existing_tag ____________________ 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.749 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.750 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.751 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.752 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.753 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.754 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.755 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.756 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.757 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.758 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_get_obj_existing_tag(): 2023-12-03T12:37:00.760 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10882: 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_location = bucket.create() 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.761 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.762 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.764 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.765 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.766 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-454" 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ test_bucket_policy_get_obj_tagging_existing_tag ________________ 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.767 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.768 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.769 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.770 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.771 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.772 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.773 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.774 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.775 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.776 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.777 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.778 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.779 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_get_obj_tagging_existing_tag(): 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10937: 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.780 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_location = bucket.create() 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.781 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.782 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.783 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.784 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.785 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.786 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-455" 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ test_bucket_policy_put_obj_tagging_existing_tag ________________ 2023-12-03T12:37:00.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.788 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.789 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.790 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.791 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.792 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.793 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.794 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.796 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.797 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.798 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.799 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_put_obj_tagging_existing_tag(): 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.800 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:10999: 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_location = bucket.create() 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.801 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.803 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.804 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.805 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.806 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-456" 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ test_bucket_policy_put_obj_copy_source ____________________ 2023-12-03T12:37:00.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.809 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.810 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.811 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.812 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.813 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.814 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.815 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.816 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.817 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.818 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.820 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_put_obj_copy_source(): 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_objects(keys=['public/foo', 'public/bar', 'private/foo']) 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11068: 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_location = bucket.create() 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.821 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.823 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.824 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.825 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.826 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-457" 2023-12-03T12:37:00.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ test_bucket_policy_put_obj_copy_source_meta __________________ 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.829 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.830 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.831 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.832 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.834 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.835 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.837 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_put_obj_copy_source_meta(): 2023-12-03T12:37:00.840 INFO:teuthology.orchestra.run.smithi131.stdout:> src_bucket_name = _create_objects(keys=['public/foo', 'public/bar']) 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11115: 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_location = bucket.create() 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:37:00.841 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.843 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.844 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.845 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.846 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-458" 2023-12-03T12:37:00.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_bucket_policy_put_obj_acl ________________________ 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.848 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.850 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.851 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.852 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.853 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.854 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.856 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.857 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.858 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.859 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_put_obj_acl(): 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11165: 2023-12-03T12:37:00.860 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.861 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.863 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.864 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.865 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.866 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-459" 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_bucket_policy_put_obj_grant _______________________ 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.868 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.869 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.870 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.871 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.872 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.873 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.874 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.875 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.876 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.877 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.878 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.879 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_put_obj_grant(): 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11206: 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.880 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.881 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.883 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.884 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-460" 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_put_obj_enc_conflict_c_s3 ________________________ 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.886 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.887 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.888 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.890 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.891 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.892 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.893 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.894 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.895 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.896 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.897 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_obj_enc_conflict_c_s3(): 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11267: 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.899 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.900 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.901 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.902 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.903 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.904 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-461" 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_put_obj_enc_conflict_c_kms ________________________ 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.906 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.907 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.908 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.910 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.911 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.912 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.913 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.914 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.915 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.916 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.917 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_obj_enc_conflict_c_kms(): 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout: if kms_keyid is None: 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = 'fool-me-once' 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11293: 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.918 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.919 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.920 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.921 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.922 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.923 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-462" 2023-12-03T12:37:00.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_put_obj_enc_conflict_s3_kms _______________________ 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.927 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.928 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.929 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.930 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.931 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.932 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.933 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.934 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.935 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.936 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_obj_enc_conflict_s3_kms(): 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: if kms_keyid is None: 2023-12-03T12:37:00.937 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = 'fool-me-once' 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11320: 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.938 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.939 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.940 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.941 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.942 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.943 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-463" 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout:____________________ test_put_obj_enc_conflict_bad_enc_kms _____________________ 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.945 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.946 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.947 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.949 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.950 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.951 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.952 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.953 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.954 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.955 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_obj_enc_conflict_bad_enc_kms(): 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout: if kms_keyid is None: 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = 'fool-me-once' 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11344: 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.957 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.958 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.959 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.960 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.961 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.962 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-464" 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.963 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________ test_bucket_policy_put_obj_kms_noenc _____________________ 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.964 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.965 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.966 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.967 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.968 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.969 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.970 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.971 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.972 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.974 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.975 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_put_obj_kms_noenc(): 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout: if kms_keyid is None: 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11469: 2023-12-03T12:37:00.976 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.977 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.978 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.979 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.980 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:00.981 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:00.982 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-465" 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_bucket_policy_put_obj_kms_s3 _______________________ 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:00.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:00.985 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.986 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.987 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.988 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.989 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:00.990 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:00.991 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:00.992 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.993 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:00.994 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_put_obj_kms_s3(): 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11512: 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.995 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:00.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:00.997 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:00.998 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:00.999 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-466" 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.001 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ test_bucket_policy_get_obj_acl_existing_tag __________________ 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.003 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.004 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.005 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.008 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.010 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.011 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.012 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.tagging 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_policy 2023-12-03T12:37:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: def test_bucket_policy_get_obj_acl_existing_tag(): 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = _create_objects(keys=['publictag', 'privatetag', 'invalidtag']) 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11584: 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:116: in _create_objects 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: bucket = get_new_bucket_resource(name=bucket_name) 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:581: in get_new_bucket_resource 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_location = bucket.create() 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/factory.py:580: in do_action 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: response = action(self, *args, **kwargs) 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto3/resources/action.py:88: in __call__ 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: response = getattr(parent.meta.client, operation_name)(*args, **params) 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.016 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.019 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.020 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.021 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-467" 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_object_lock_put_obj_lock _________________________ 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.022 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.023 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.025 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.027 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.028 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.029 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.030 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.031 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.032 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.033 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.034 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_lock(): 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11645: 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.036 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.037 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.038 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.039 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.040 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.041 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-468" 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ test_object_lock_put_obj_lock_invalid_bucket _________________ 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.042 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.043 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.044 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.045 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.046 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.048 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.049 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.050 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.051 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.054 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_lock_invalid_bucket(): 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11677: 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.056 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.057 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.058 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.059 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.060 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-469" 2023-12-03T12:37:01.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout:______________ test_object_lock_put_obj_lock_with_days_and_years _______________ 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.063 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.064 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.065 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.066 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.067 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.068 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.069 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.070 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.071 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.072 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.073 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_lock_with_days_and_years(): 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11695: 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.076 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.077 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.078 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.079 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-470" 2023-12-03T12:37:01.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ test_object_lock_put_obj_lock_invalid_days __________________ 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.083 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.084 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.085 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.088 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.090 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.091 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.092 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.093 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.094 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_lock_invalid_days(): 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11714: 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.095 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.096 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.097 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.098 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.099 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.100 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.101 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-471" 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ test_object_lock_put_obj_lock_invalid_years __________________ 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.102 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.103 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.104 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.105 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.106 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.108 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.109 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.110 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.111 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.113 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.114 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_lock_invalid_years(): 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11732: 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.116 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.117 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.118 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.119 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-472" 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ test_object_lock_put_obj_lock_invalid_mode __________________ 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.123 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.125 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.126 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.127 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.128 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.129 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.130 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.131 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.132 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.133 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.134 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_lock_invalid_mode(): 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11750: 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.135 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.136 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.137 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.138 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.140 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.141 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-473" 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ test_object_lock_put_obj_lock_invalid_status _________________ 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.143 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.144 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.145 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.146 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.147 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.148 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.149 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.150 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.151 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.152 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.153 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.154 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.155 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_lock_invalid_status(): 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11780: 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.156 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.157 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.158 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.159 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.160 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.161 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-474" 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________ test_object_lock_suspend_versioning ______________________ 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.162 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.163 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.164 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.165 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.166 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.167 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.168 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.169 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.170 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.171 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.172 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.173 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.174 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.175 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_suspend_versioning(): 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11798: 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.176 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.177 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.178 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.179 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.180 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.181 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-475" 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.182 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_object_lock_get_obj_lock _________________________ 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.183 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.184 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.185 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.186 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.187 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.188 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.189 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.190 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.191 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.192 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.193 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.194 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.195 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_get_obj_lock(): 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11809: 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.196 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.197 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.198 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.199 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.200 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.201 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.202 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-476" 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ test_object_lock_get_obj_lock_invalid_bucket _________________ 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.203 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.204 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.205 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.206 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.207 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.208 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.209 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.210 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.211 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.212 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.213 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.214 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.215 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_get_obj_lock_invalid_bucket(): 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11827: 2023-12-03T12:37:01.216 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.217 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.218 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.219 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.220 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.221 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.222 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-477" 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_object_lock_put_obj_retention ______________________ 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.223 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.224 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.225 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.226 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.227 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.228 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.229 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.230 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.231 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.232 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.233 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.235 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_retention(): 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11838: 2023-12-03T12:37:01.236 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.237 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.238 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.239 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.240 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.241 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.242 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-478" 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout:______________ test_object_lock_put_obj_retention_invalid_bucket _______________ 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.243 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.244 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.245 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.246 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.247 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.248 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.249 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.250 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.251 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.252 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.253 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.254 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.255 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_retention_invalid_bucket(): 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11854: 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.256 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.257 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.258 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.259 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.260 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.261 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-479" 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.262 INFO:teuthology.orchestra.run.smithi131.stdout:_______________ test_object_lock_put_obj_retention_invalid_mode ________________ 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.263 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.264 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.265 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.266 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.267 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.268 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.269 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.270 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.271 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.272 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.273 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.274 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.275 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_retention_invalid_mode(): 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11868: 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.276 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.277 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.278 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.279 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.280 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.281 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-480" 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.282 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_object_lock_get_obj_retention ______________________ 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.283 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.284 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.285 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.287 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.288 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.289 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.290 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.291 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.292 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.293 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.294 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.295 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_get_obj_retention(): 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11888: 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.296 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.297 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.298 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.299 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.300 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.301 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-481" 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout:__________________ test_object_lock_get_obj_retention_iso8601 __________________ 2023-12-03T12:37:01.302 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.303 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.304 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.305 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.306 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.307 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.308 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.309 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.310 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.311 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.312 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.313 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.314 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_get_obj_retention_iso8601(): 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11903: 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.316 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.317 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.318 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.319 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.320 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.321 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.322 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-482" 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout:______________ test_object_lock_get_obj_retention_invalid_bucket _______________ 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.323 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.324 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.325 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.326 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.327 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.328 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.329 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.330 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.331 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.332 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.334 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.335 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_get_obj_retention_invalid_bucket(): 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11920: 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.336 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.337 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.338 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.339 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.340 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.341 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-483" 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ test_object_lock_put_obj_retention_versionid _________________ 2023-12-03T12:37:01.342 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.343 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.344 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.345 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.346 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.347 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.348 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.349 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.350 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.351 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.352 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.353 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.354 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_retention_versionid(): 2023-12-03T12:37:01.355 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11933: 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.356 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.357 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.358 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.359 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.360 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.361 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-484" 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout:________ test_object_lock_put_obj_retention_override_default_retention _________ 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.362 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.363 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.364 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.365 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.366 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.367 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.368 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.369 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.370 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.371 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.372 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.373 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.374 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_retention_override_default_retention(): 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11949: 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.376 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.377 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.378 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.379 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.380 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.381 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-485" 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout:______________ test_object_lock_put_obj_retention_increase_period ______________ 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.382 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.383 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.384 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.385 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.386 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.387 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.388 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.389 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.390 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.391 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.392 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.393 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.394 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_retention_increase_period(): 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11974: 2023-12-03T12:37:01.395 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.396 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.397 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.398 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.399 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.400 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-486" 2023-12-03T12:37:01.401 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout:______________ test_object_lock_put_obj_retention_shorten_period _______________ 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.402 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.403 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.404 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.405 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.406 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.407 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.408 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.410 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.411 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.412 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.413 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.414 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_retention_shorten_period(): 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:11991: 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.415 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.416 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.417 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.418 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.419 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.420 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-487" 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout:___________ test_object_lock_put_obj_retention_shorten_period_bypass ___________ 2023-12-03T12:37:01.421 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.422 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.423 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.424 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.425 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.427 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.429 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.430 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.431 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.432 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.433 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.434 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_obj_retention_shorten_period_bypass(): 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12009: 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.435 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.436 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.437 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.438 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.439 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.440 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-488" 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_object_lock_delete_object_with_retention _________________ 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.441 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.442 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.443 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.445 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.445 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.445 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.445 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.445 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.445 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.445 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.446 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.447 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.448 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.449 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.450 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.451 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.452 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.453 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.454 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.455 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_delete_object_with_retention(): 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.456 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12026: 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.457 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.459 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.460 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.461 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.462 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-489" 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout:___________ test_object_lock_delete_object_with_retention_and_marker ___________ 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.463 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.464 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.465 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.466 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.467 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.468 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.469 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.470 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.471 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.472 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.473 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.474 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.475 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.476 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_delete_object_with_retention_and_marker(): 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12044: 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.477 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.478 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.479 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.480 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.481 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.482 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-490" 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.483 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout:_____________ test_object_lock_multi_delete_object_with_retention ______________ 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.484 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.485 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.486 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.487 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.490 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.491 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.492 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.493 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.494 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.495 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.496 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_multi_delete_object_with_retention(): 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12069: 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.497 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.498 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.499 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.500 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.501 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.502 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.503 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-491" 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_object_lock_put_legal_hold ________________________ 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.504 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.505 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.506 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.507 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.508 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.509 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.510 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.511 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.512 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.513 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.514 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.515 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.516 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_legal_hold(): 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.517 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12136: 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.518 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.519 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.520 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.521 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.522 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.523 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-492" 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_object_lock_put_legal_hold_invalid_bucket ________________ 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.524 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.525 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.526 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.527 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.528 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.529 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.531 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.532 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.533 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.534 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.535 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.536 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_legal_hold_invalid_bucket(): 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.537 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12149: 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.538 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.539 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.540 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.541 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.542 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.543 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-493" 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_object_lock_put_legal_hold_invalid_status ________________ 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.544 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.545 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.546 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.547 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.548 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.549 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.550 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.551 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.552 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.553 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.554 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.555 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.556 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_put_legal_hold_invalid_status(): 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12163: 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.558 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.559 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.560 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.562 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.563 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-494" 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout:_______________________ test_object_lock_get_legal_hold ________________________ 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.564 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.565 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.566 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.567 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.568 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.569 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.570 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.571 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.572 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.573 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.574 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.575 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.576 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_get_legal_hold(): 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12177: 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.577 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.578 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.579 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.580 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.581 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.582 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.583 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-495" 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_object_lock_get_legal_hold_invalid_bucket ________________ 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.584 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.585 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.586 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.587 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.588 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.589 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.590 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.591 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.592 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.594 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.595 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.596 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_get_legal_hold_invalid_bucket(): 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name) 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12193: 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.597 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.598 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.599 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.600 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.601 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.602 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.603 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-496" 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout:______________ test_object_lock_delete_object_with_legal_hold_on _______________ 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.604 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.605 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.606 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.607 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.608 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.609 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.610 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.611 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.612 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.613 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.614 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.615 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.616 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_delete_object_with_legal_hold_on(): 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12206: 2023-12-03T12:37:01.617 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.618 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.619 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.620 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.621 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.622 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.623 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-497" 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout:______________ test_object_lock_delete_object_with_legal_hold_off ______________ 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.624 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.626 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.627 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.628 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.629 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.630 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.631 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.632 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.633 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.634 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.635 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.636 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_delete_object_with_legal_hold_off(): 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12221: 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.637 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.638 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.639 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.640 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.641 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.642 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.643 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-498" 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_object_lock_get_obj_metadata _______________________ 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.644 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.645 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.646 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.647 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.648 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.649 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.650 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.651 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.652 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.653 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.654 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.655 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.656 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_get_obj_metadata(): 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12233: 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.657 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.658 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.659 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.660 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.661 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-499" 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.663 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_object_lock_uploading_obj ________________________ 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.664 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.665 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.666 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.667 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.668 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.669 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.670 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.671 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.672 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.673 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.674 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.675 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.676 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_uploading_obj(): 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12253: 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.677 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.678 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.679 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.680 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.681 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.682 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-500" 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout:__________ test_object_lock_changing_mode_from_governance_with_bypass __________ 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.683 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.684 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.685 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.686 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.687 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.688 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.689 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.690 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.691 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.692 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.693 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.694 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.695 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_changing_mode_from_governance_with_bypass(): 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.696 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'file1' 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12270: 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.697 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.698 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.699 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.700 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.701 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.702 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-501" 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout:________ test_object_lock_changing_mode_from_governance_without_bypass _________ 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.703 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.704 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.705 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.706 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.707 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.708 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.709 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.710 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.711 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.712 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.713 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.714 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.715 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.716 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_changing_mode_from_governance_without_bypass(): 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'file1' 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12284: 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.717 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.718 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.719 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.720 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.721 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.722 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-502" 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.723 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_object_lock_changing_mode_from_compliance ________________ 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.724 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.725 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.726 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.727 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.728 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.729 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.730 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.731 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.732 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.733 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.734 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.735 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.736 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout: def test_object_lock_changing_mode_from_compliance(): 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout: bucket_name = get_new_bucket_name() 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout: key = 'file1' 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout:> client.create_bucket(Bucket=bucket_name, ObjectLockEnabledForBucket=True) 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12301: 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.737 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.738 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.739 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.740 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.741 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.742 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-503" 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.743 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_copy_object_ifmatch_good _________________________ 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.744 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.745 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.746 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.747 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.748 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.749 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.750 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.751 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.752 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.753 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.754 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.755 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout: def test_copy_object_ifmatch_good(): 2023-12-03T12:37:01.756 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12315: 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.757 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.758 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.759 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.760 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.761 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.762 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-504" 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________ test_copy_object_ifnonematch_failed ______________________ 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.764 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.765 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.766 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.768 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.769 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.770 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.771 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.772 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.773 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.774 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout: def test_copy_object_ifnonematch_failed(): 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.776 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12350: 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.777 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.778 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.779 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.780 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.781 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.782 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-505" 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_get_bucket_policy_status _________________________ 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.783 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.784 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.785 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.786 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.787 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.789 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.790 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.791 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.792 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.793 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.794 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.795 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_bucket_policy_status(): 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12370: 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.796 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.797 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.798 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.799 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.800 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.801 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-506" 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.802 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout:___________________ test_get_public_acl_bucket_policy_status ___________________ 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.803 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.804 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.805 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.806 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.807 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.808 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.809 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.810 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.811 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.812 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.813 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.814 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.815 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_public_acl_bucket_policy_status(): 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12376: 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.816 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.817 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.818 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.819 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.820 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.821 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-507" 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.822 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout:_________________ test_get_authpublic_acl_bucket_policy_status _________________ 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.823 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.824 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.825 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.826 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.827 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.828 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.829 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.830 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.831 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.832 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.833 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.834 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_authpublic_acl_bucket_policy_status(): 2023-12-03T12:37:01.835 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12383: 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.836 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.837 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.838 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.839 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.840 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-508" 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_get_publicpolicy_acl_bucket_policy_status ________________ 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.842 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.843 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.844 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.845 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.846 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.847 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.848 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.849 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.850 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.851 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.852 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.853 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.854 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_publicpolicy_acl_bucket_policy_status(): 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12391: 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.855 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.856 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.857 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.858 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.859 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.860 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-509" 2023-12-03T12:37:01.861 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout:______________ test_get_nonpublicpolicy_acl_bucket_policy_status _______________ 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.862 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.863 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.864 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.865 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.866 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.867 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.868 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.869 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.870 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.871 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.872 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.873 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_nonpublicpolicy_acl_bucket_policy_status(): 2023-12-03T12:37:01.874 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12419: 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.875 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.876 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.877 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.878 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.879 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.880 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-510" 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout:______________ test_get_nonpublicpolicy_deny_bucket_policy_status ______________ 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.881 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.882 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.883 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.884 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.885 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.886 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.887 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.888 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.889 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.890 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.891 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.892 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.893 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_nonpublicpolicy_deny_bucket_policy_status(): 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12451: 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.894 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.895 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.896 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.897 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.898 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.899 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.900 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-511" 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_get_default_public_block _________________________ 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.901 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.902 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.903 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.904 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.905 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.906 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.907 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.908 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.909 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.910 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.911 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.912 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_default_public_block(): 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12479: 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.914 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.915 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.916 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.917 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.918 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.919 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-512" 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout:____________________________ test_put_public_block _____________________________ 2023-12-03T12:37:01.920 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.921 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.922 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.923 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.924 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.925 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.926 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.927 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.928 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.929 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.930 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.931 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.932 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.933 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_public_block(): 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12490: 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.934 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.935 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.936 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.937 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.938 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.939 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-513" 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.940 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_block_public_put_bucket_acls _______________________ 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.941 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.943 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.944 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.945 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.946 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.947 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.948 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.949 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.950 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.951 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.952 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout: def test_block_public_put_bucket_acls(): 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout: #client = get_svc_client(svc='s3control', client_config=Config(s3={'addressing_style': 'path'})) 2023-12-03T12:37:01.953 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12509: 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.955 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.956 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.957 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.958 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.959 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-514" 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout:_____________________ test_block_public_object_canned_acls _____________________ 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.960 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.961 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.962 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.963 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.964 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.965 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.966 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.967 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.968 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.970 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.971 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.972 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout: def test_block_public_object_canned_acls(): 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12537: 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.973 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.974 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.975 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.976 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.977 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.978 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.979 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-515" 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_block_public_policy ___________________________ 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.980 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.981 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:01.982 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:01.983 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:01.984 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.985 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.986 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.987 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:01.988 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:01.989 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:01.990 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.991 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.992 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout: def test_block_public_policy(): 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12566: 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:01.993 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:01.994 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:01.995 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:01.996 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:01.997 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:01.998 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-516" 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_ignore_public_acls ____________________________ 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:01.999 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.000 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:02.001 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:02.002 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.003 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.004 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.005 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.006 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.007 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:02.008 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:02.009 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.010 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.011 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout: def test_ignore_public_acls(): 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:02.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12583: 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:02.013 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:02.014 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.015 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.016 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.017 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:02.018 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-517" 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout:________________ test_multipart_upload_on_a_bucket_with_policy _________________ 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.019 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.020 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:02.021 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:02.022 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:02.023 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.024 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.025 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.026 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.027 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:02.028 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:02.029 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.030 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:02.031 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.032 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout: def test_multipart_upload_on_a_bucket_with_policy(): 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12610: 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:02.033 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:02.034 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.035 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.036 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.037 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:02.038 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-518" 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_put_bucket_encryption_kms ________________________ 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.039 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.040 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:02.041 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:02.044 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.045 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.046 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.047 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:02.048 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.049 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.050 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.051 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout: def test_put_bucket_encryption_kms(): 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.052 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12679: 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:02.053 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:02.054 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.055 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.056 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.058 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-519" 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout:________________________ test_get_bucket_encryption_kms ________________________ 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.059 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.060 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:02.061 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.062 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:02.063 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:02.064 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.065 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.066 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:02.067 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:02.068 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.069 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.070 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:02.071 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_bucket_encryption_kms(): 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout: if kms_keyid is None: 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = 'fool-me-again' 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12709: 2023-12-03T12:37:02.072 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:02.073 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:02.074 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.075 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.076 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:02.077 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:02.078 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-520" 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout:______________________ test_delete_bucket_encryption_kms _______________________ 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.079 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:02.080 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:02.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:02.082 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.083 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:02.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.085 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.086 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:02.087 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:02.088 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.089 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.090 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.091 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout: def test_delete_bucket_encryption_kms(): 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12752: 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:02.092 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:02.093 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:02.094 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.095 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:02.096 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:02.097 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:02.098 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-521" 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout:____________ test_sse_kms_default_post_object_authenticated_request ____________ 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.099 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:02.101 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:02.102 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:02.104 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.105 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.106 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:02.107 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:02.108 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.109 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:02.110 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.111 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.encryption 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.bucket_encryption 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.fails_on_dbstore 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout: def test_sse_kms_default_post_object_authenticated_request(): 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout: kms_keyid = get_main_kms_keyid() 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout: if kms_keyid is None: 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout: pytest.skip('[s3 main] section missing kms_keyid') 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:12996: 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:02.112 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:02.113 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:02.114 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.115 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.116 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:02.117 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.118 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-522" 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________ test_get_object_torrent ____________________________ 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.119 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout:> conn = connection.create_connection( 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:174: 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:95: in create_connection 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout: raise err 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.120 INFO:teuthology.orchestra.run.smithi131.stdout:address = ('smithi131.front.sepia.ceph.com', 80), timeout = 60 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout:source_address = None, socket_options = [(6, 1, 1)] 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: def create_connection( 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: address, 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: timeout=socket._GLOBAL_DEFAULT_TIMEOUT, 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: source_address=None, 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: socket_options=None, 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: """Connect to *address* and return the socket object. 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: Convenience function. Connect to *address* (a 2-tuple ``(host, 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: port)``) and return the socket object. Passing the optional 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: *timeout* parameter will set the timeout on the socket instance 2023-12-03T12:37:02.121 INFO:teuthology.orchestra.run.smithi131.stdout: before attempting to connect. If no *timeout* is supplied, the 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: global default timeout setting returned by :func:`socket.getdefaulttimeout` 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: is used. If *source_address* is set it must be a tuple of (host, port) 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: for the socket to bind as a source address before making the connection. 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: An host of '' or port 0 tells the OS to use the default. 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: host, port = address 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: if host.startswith("["): 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: host = host.strip("[]") 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: err = None 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: # Using the value from allowed_gai_family() in the context of getaddrinfo lets 2023-12-03T12:37:02.122 INFO:teuthology.orchestra.run.smithi131.stdout: # us select whether to work with IPv4 DNS records, IPv6 records, or both. 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: # The original create_connection function always returns all records. 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: family = allowed_gai_family() 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: host.encode("idna") 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: except UnicodeError: 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: return six.raise_from( 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: LocationParseError(u"'%s', label empty or too long" % host), None 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: af, socktype, proto, canonname, sa = res 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: sock = None 2023-12-03T12:37:02.123 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout: sock = socket.socket(af, socktype, proto) 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout: # If provided, set socket level options before connecting. 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout: _set_socket_options(sock, socket_options) 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout: if timeout is not socket._GLOBAL_DEFAULT_TIMEOUT: 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout: sock.settimeout(timeout) 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout: if source_address: 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout: sock.bind(source_address) 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout:> sock.connect(sa) 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout:E ConnectionRefusedError: [Errno 111] Connection refused 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/connection.py:85: ConnectionRefusedError 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.124 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.125 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout:> urllib_response = conn.urlopen( 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.126 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:455: 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:799: in urlopen 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout: retries = retries.increment( 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/util/retry.py:525: in increment 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout: raise six.reraise(type(error), error, _stacktrace) 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/packages/six.py:770: in reraise 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout: raise value 2023-12-03T12:37:02.127 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:715: in urlopen 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout: httplib_response = self._make_request( 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:416: in _make_request 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout: conn.request(method, url, **httplib_request_kw) 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:244: in request 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout: super(HTTPConnection, self).request(method, url, body=body, headers=headers) 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1285: in request 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_request(method, url, body, headers, encode_chunked) 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:94: in _send_request 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout: rval = super()._send_request( 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1331: in _send_request 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout: self.endheaders(body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:1280: in endheaders 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout: self._send_output(message_body, encode_chunked=encode_chunked) 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:123: in _send_output 2023-12-03T12:37:02.128 INFO:teuthology.orchestra.run.smithi131.stdout: self.send(msg) 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/awsrequest.py:218: in send 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout: return super().send(str) 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib64/python3.9/http/client.py:980: in send 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout: self.connect() 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:205: in connect 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout: conn = self._new_conn() 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout: def _new_conn(self): 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout: """Establish a socket connection and set nodelay settings on it. 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout: :return: New socket connection. 2023-12-03T12:37:02.129 INFO:teuthology.orchestra.run.smithi131.stdout: """ 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw = {} 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: if self.source_address: 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["source_address"] = self.source_address 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: if self.socket_options: 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: extra_kw["socket_options"] = self.socket_options 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: conn = connection.create_connection( 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: (self._dns_host, self.port), self.timeout, **extra_kw 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketTimeout: 2023-12-03T12:37:02.130 INFO:teuthology.orchestra.run.smithi131.stdout: raise ConnectTimeoutError( 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout: self, 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout: "Connection to %s timed out. (connect timeout=%s)" 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout: % (self.host, self.timeout), 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout: except SocketError as e: 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout:> raise NewConnectionError( 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout: self, "Failed to establish a new connection: %s" % e 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout:E urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 111] Connection refused 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/urllib3/connection.py:186: NewConnectionError 2023-12-03T12:37:02.131 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout:During handling of the above exception, another exception occurred: 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout: def test_get_object_torrent(): 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout: client = get_client() 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout:> bucket_name = get_new_bucket() 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:13081: 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/__init__.py:596: in get_new_bucket 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout: client.create_bucket(Bucket=name) 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:514: in _api_call 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout: return self._make_api_call(operation_name, kwargs) 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:921: in _make_api_call 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout: http, parsed_response = self._make_request( 2023-12-03T12:37:02.132 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/client.py:944: in _make_request 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout: return self._endpoint.make_request(operation_model, request_dict) 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:119: in make_request 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout: return self._send_request(request_dict, operation_model) 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:202: in _send_request 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout: while self._needs_retry( 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:354: in _needs_retry 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout: responses = self._event_emitter.emit( 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:412: in emit 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emitter.emit(aliased_event_name, **kwargs) 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:256: in emit 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout: return self._emit(event_name, kwargs) 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/hooks.py:239: in _emit 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout: response = handler(**kwargs) 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:207: in __call__ 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout: if self._checker(**checker_kwargs): 2023-12-03T12:37:02.133 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:284: in __call__ 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout: should_retry = self._should_retry( 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:320: in _should_retry 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout: return self._checker(attempt_number, response, caught_exception) 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:363: in __call__ 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout: checker_response = checker( 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:247: in __call__ 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout: return self._check_caught_exception( 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/retryhandler.py:416: in _check_caught_exception 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout: raise caught_exception 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:281: in _do_get_response 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = self._send(request) 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/endpoint.py:377: in _send 2023-12-03T12:37:02.134 INFO:teuthology.orchestra.run.smithi131.stdout: return self.http_session.send(request) 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout:self = 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout:request = 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout: def send(self, request): 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout: try: 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout: proxy_url = self._proxy_config.proxy_url_for(request.url) 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout: manager = self._get_connection_manager(request.url, proxy_url) 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout: conn = manager.connection_from_url(request.url) 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout: self._setup_ssl_cert(conn, request.url, self._verify) 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout: if ensure_boolean( 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout: os.environ.get('BOTO_EXPERIMENTAL__ADD_PROXY_HOST_HEADER', '') 2023-12-03T12:37:02.135 INFO:teuthology.orchestra.run.smithi131.stdout: ): 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: # This is currently an "experimental" feature which provides 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: # no guarantees of backwards compatibility. It may be subject 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: # to change or removal in any patch version. Anyone opting in 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: # to this feature should strictly pin botocore. 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: host = urlparse(request.url).hostname 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: conn.proxy_headers['host'] = host 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: request_target = self._get_request_target(request.url, proxy_url) 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response = conn.urlopen( 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: method=request.method, 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: url=request_target, 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: body=request.body, 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: headers=request.headers, 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: retries=Retry(False), 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: assert_same_host=False, 2023-12-03T12:37:02.136 INFO:teuthology.orchestra.run.smithi131.stdout: preload_content=False, 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: decode_content=False, 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: chunked=self._chunked(request.headers), 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: http_response = botocore.awsrequest.AWSResponse( 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: request.url, 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.status, 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response.headers, 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: urllib_response, 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: ) 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: if not request.stream_output: 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: # Cause the raw stream to be exhausted immediately. We do it 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: # this way instead of using preload_content because 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: # preload_content will never buffer chunked responses 2023-12-03T12:37:02.137 INFO:teuthology.orchestra.run.smithi131.stdout: http_response.content 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout: return http_response 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout: except URLLib3SSLError as e: 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout: raise SSLError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout: except (NewConnectionError, socket.gaierror) as e: 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout:> raise EndpointConnectionError(endpoint_url=request.url, error=e) 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout:E botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "http://smithi131.front.sepia.ceph.com:80/test-client.0-iegqwmspbbn7eo0-523" 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/botocore/httpsession.py:484: EndpointConnectionError 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout:=============================== warnings summary =============================== 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2023-12-03T12:37:02.138 INFO:teuthology.orchestra.run.smithi131.stdout: import imp 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py:124 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout: if boto_type is 'S3Connection': 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_headers.py:129 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:129: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout: elif boto_type is 'HTTPRequest': 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3.py:359 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py:176 2023-12-03T12:37:02.139 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: if k is 'BucketName': 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py:253 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.timeout(10) 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests/functional/test_s3_website.py:1077 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: @pytest.mark.s3website_routing_rules 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:2212 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2212: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.140 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:2227 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2227: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:2233 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2233: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:2290 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2290: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:2305 2023-12-03T12:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2305: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:2323 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2323: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:2338 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2338: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:2356 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2356: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.142 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:2371 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2371: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:2421 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2421: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout:s3tests_boto3/functional/test_s3.py:2453 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2453: DeprecationWarning: invalid escape sequence \$ 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout: ["starts-with", "$key", "\$foo"],\ 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout:=========================== short test summary info ============================ 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty - bot... 2023-12-03T12:37:02.143 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_small - bot... 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_small - botoc... 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload - botocore.... 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned - b... 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents - ... 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload - bot... 2023-12-03T12:37:02.144 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_list_multipart_upload - boto... 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_get_part - botocor... 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part - bot... 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_100_continue - botocore.exce... 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_set_cors - botocore.exceptio... 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_origin_response - botoc... 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard - botoc... 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_header_option - botocor... 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object - ... 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging - botocor... 2023-12-03T12:37:02.145 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb - botocore.e... 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb - botocore.e... 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb - botocore.e... 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb - botocore.... 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb - botocore.... 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb - botocore.... 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb - boto... 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb - boto... 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb - boto... 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code 2023-12-03T12:37:02.146 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all 2023-12-03T12:37:02.147 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_object_acl - botoc... 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set - botocore.exc... 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_get - botocore.exc... 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id - botoco... 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long - boto... 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id - botocore... 2023-12-03T12:37:02.148 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status - b... 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date - botocor... 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent - b... 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter - botoc... 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart - bo... 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b - boto... 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb - bot... 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB - bot... 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b - bot... 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head 2023-12-03T12:37:02.149 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present - b... 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 - bo... 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key - bo... 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c - bo... 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head - botoco... 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_present - botocore.e... 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key - botocore.ex... 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared - botoc... 2023-12-03T12:37:02.150 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - b... 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b - botoco... 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb - botoc... 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB - botoc... 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b - botoc... 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare - botoc... 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy - botocore.exc... 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy - botocore.e... 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl - botocore... 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl - botoco... 2023-12-03T12:37:02.151 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_obj_tagging - botocore.e... 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging - botoc... 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_max_tags - botocore.exce... 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_tags - botocore.e... 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags - botoco... 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags - botoco... 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags - botoco... 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_modify_tags - botocore.e... 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_delete_tags - botocore.e... 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags - botocore... 2023-12-03T12:37:02.152 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public - botoco... 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public - botoco... 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public - bot... 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl - ... 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 - ... 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms 2023-12-03T12:37:02.153 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock - b... 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock - b... 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket 2023-12-03T12:37:02.154 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention 2023-12-03T12:37:02.155 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj - ... 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good - b... 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status - b... 2023-12-03T12:37:02.156 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_default_public_block - b... 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_public_block - botocore.... 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_block_public_policy - botoco... 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_ignore_public_acls - botocor... 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms - ... 2023-12-03T12:37:02.157 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms - ... 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:FAILED s3tests_boto3/functional/test_s3.py::test_get_object_torrent - botocor... 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty - boto... 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_small - boto... 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_small - botoco... 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload - botocore.e... 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned - bo... 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes 2023-12-03T12:37:02.158 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents - b... 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload - boto... 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_multipart_upload - botoc... 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_get_part - botocore... 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part - boto... 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_100_continue - botocore.excep... 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_set_cors - botocore.exception... 2023-12-03T12:37:02.159 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_origin_response - botoco... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard - botoco... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_header_option - botocore... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object - b... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging - botocore... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb - botocore.ex... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb - botocore.ex... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb - botocore.ex... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb - botocore.e... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb - botocore.e... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb - botocore.e... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb - botoc... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb - botoc... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb - botoc... 2023-12-03T12:37:02.160 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite 2023-12-03T12:37:02.161 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker - ... 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl - botoco... 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove 2023-12-03T12:37:02.162 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set - botocore.exce... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get - botocore.exce... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id - botocor... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long - botoc... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id - botocore.... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status - bo... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date - botocore... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date - ... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent - bo... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker - ... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter - botoco... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter - ... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart - bot... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b - botoc... 2023-12-03T12:37:02.163 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb - boto... 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB - boto... 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b - boto... 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present - bo... 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key - ... 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 - bot... 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key - bot... 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c - bot... 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request 2023-12-03T12:37:02.164 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head - botocor... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_present - botocore.ex... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key - botocore.exc... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared - botoco... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload - bo... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b - botocor... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb - botoco... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB - botoco... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b - botoco... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare - botoco... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy - botocore.exce... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy - botocore.ex... 2023-12-03T12:37:02.165 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl - botocore.... 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl - botocor... 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_tagging - botocore.ex... 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging - botoco... 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_tags - botocore.excep... 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_tags - botocore.ex... 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags - botocor... 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags - botocor... 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags - botocor... 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_modify_tags - botocore.ex... 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_delete_tags - botocore.ex... 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request 2023-12-03T12:37:02.166 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags - botocore.... 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public - botocor... 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public - botocor... 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public - boto... 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl - b... 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 - b... 2023-12-03T12:37:02.167 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms - ... 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock - bo... 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock - bo... 2023-12-03T12:37:02.168 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker 2023-12-03T12:37:02.169 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold - ... 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold - ... 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj - b... 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good - bo... 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed 2023-12-03T12:37:02.170 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status - bo... 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_default_public_block - bo... 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_public_block - botocore.e... 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_block_public_policy - botocor... 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_ignore_public_acls - botocore... 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms - b... 2023-12-03T12:37:02.171 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms - b... 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3.py::test_get_object_torrent - botocore... 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_generate_where_clause 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_generate_projection - b... 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_count_operation - botoc... 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_count_json_operation - ... 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max - bo... 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_nullif_expressions - bo... 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions 2023-12-03T12:37:02.172 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_in_expressions - botoco... 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_like_expressions - boto... 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_complex_expressions - b... 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_alias - botocore.except... 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_datetime - botocore.exc... 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_true_false_datetime - b... 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_csv_parser - botocore.e... 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_csv_definition - botoco... 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_schema_definition - bot... 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions 2023-12-03T12:37:02.173 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions - ... 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_cast_expressions - boto... 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_version - botocore.exce... 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_trim_expressions - boto... 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_escape_expressions - bo... 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_case_value_expressions 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_progress_expressions - ... 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:= 201 failed, 362 passed, 65 skipped, 124 deselected, 1 xfailed, 18 warnings, 235 errors in 3370.99s (0:56:10) = 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: InvocationError for command /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' (exited with code 1) 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:___________________________________ summary ____________________________________ 2023-12-03T12:37:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:ERROR: py: commands failed 2023-12-03T12:37:02.175 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 437, in run_tests File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 380, in toxvenv_sh File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi131 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2023-12-03T12:37:02.176 INFO:tasks.s3tests:Cleaning up boto... 2023-12-03T12:37:02.177 DEBUG:teuthology.orchestra.run.smithi131:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2023-12-03T12:37:02.211 INFO:tasks.s3tests:Removing s3-tests... 2023-12-03T12:37:02.211 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2023-12-03T12:37:02.403 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 703, in task File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 61, in download File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 437, in run_tests File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 380, in toxvenv_sh File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi131 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2023-12-03T12:37:02.477 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=cbbbdd1457714b5a9343f00530b0fe31 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 703, in task File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 61, in download File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 437, in run_tests File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests.py", line 380, in toxvenv_sh File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi131 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2023-12-03T12:37:02.480 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2023-12-03T12:37:02.491 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2023-12-03T12:37:02.514 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2023-12-03T12:37:02.514 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2023-12-03T12:37:02.514 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2023-12-03T12:37:02.579 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2023-12-03T12:37:02.580 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2023-12-03T12:37:02.635 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T12:37:02.635 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T12:42:02.637 INFO:teuthology.orchestra.run.smithi131.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-12-03T12:42:02.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:42:02.640 ERROR:teuthology.run_tasks:Manager failed: s3tests-java Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T12:42:02.646 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2023-12-03T12:42:02.658 DEBUG:teuthology.run_tasks:Unwinding manager tox 2023-12-03T12:42:02.674 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/tox-venv 2023-12-03T12:42:02.738 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2023-12-03T12:42:02.748 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 473, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T12:42:02.750 DEBUG:tasks.rgw.client.0:waiting for process to exit 2023-12-03T12:42:02.750 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:42:02.750 INFO:tasks.rgw.client.0:Stopped 2023-12-03T12:42:02.751 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2023-12-03T12:42:02.780 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/vault-root-token 2023-12-03T12:42:02.865 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2023-12-03T12:42:02.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2023-12-03T12:42:02.865 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2023-12-03T12:42:02.920 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setuser ceph since I am not root 2023-12-03T12:42:02.921 INFO:teuthology.orchestra.run.smithi131.stderr:ignoring --setgroup ceph since I am not root 2023-12-03T12:47:02.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:47:02.925 INFO:teuthology.orchestra.run.smithi131.stderr:2023-12-03T12:47:02.921+0000 7fd2cc412800 0 monclient(hunting): authenticate timed out after 300 2023-12-03T12:47:02.925 INFO:teuthology.orchestra.run.smithi131.stderr:failed to fetch mon config (--no-mon-config to skip) 2023-12-03T12:47:02.927 ERROR:teuthology.run_tasks:Manager failed: rgw Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 226, in start_rgw File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 473, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 473, in task File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 300, in create_pools File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/rgw.py", line 242, in start_rgw File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/util/rgw.py", line 34, in rgwadmin File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all' 2023-12-03T12:47:02.941 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2023-12-03T12:47:02.954 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-03T12:47:02.989 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-03T12:47:02.989 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-03T12:49:03.048 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-03T12:49:03.049 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1918, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-12-03T12:49:03.060 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-03T12:49:03.061 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-03T12:49:03.061 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-03T12:49:03.061 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.064 INFO:tasks.ceph.osd.0:Stopped 2023-12-03T12:49:03.064 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-03T12:49:03.064 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.065 INFO:tasks.ceph.osd.1:Stopped 2023-12-03T12:49:03.065 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-03T12:49:03.065 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.065 INFO:tasks.ceph.osd.2:Stopped 2023-12-03T12:49:03.065 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-03T12:49:03.065 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.066 INFO:tasks.ceph.osd.3:Stopped 2023-12-03T12:49:03.066 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-03T12:49:03.066 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.066 INFO:tasks.ceph.osd.4:Stopped 2023-12-03T12:49:03.066 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-03T12:49:03.066 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.067 INFO:tasks.ceph.osd.5:Stopped 2023-12-03T12:49:03.067 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-03T12:49:03.067 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.067 INFO:tasks.ceph.osd.6:Stopped 2023-12-03T12:49:03.067 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-03T12:49:03.067 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.068 INFO:tasks.ceph.osd.7:Stopped 2023-12-03T12:49:03.068 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-03T12:49:03.068 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-03T12:49:03.068 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:49:03.068 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1918, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1447, in run_daemon File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-12-03T12:49:03.080 INFO:tasks.ceph.mgr.y:Stopped 2023-12-03T12:49:03.080 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-03T12:49:03.080 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.081 INFO:tasks.ceph.mgr.x:Stopped 2023-12-03T12:49:03.081 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-03T12:49:03.081 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-03T12:49:03.081 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.082 INFO:tasks.ceph.mon.a:Stopped 2023-12-03T12:49:03.082 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-03T12:49:03.082 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.082 INFO:tasks.ceph.mon.c:Stopped 2023-12-03T12:49:03.082 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-03T12:49:03.082 INFO:teuthology.orchestra.run:waiting for 300 2023-12-03T12:49:03.082 INFO:tasks.ceph.mon.b:Stopped 2023-12-03T12:49:03.083 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-03T12:49:03.083 DEBUG:teuthology.orchestra.run.smithi131:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2023-12-03T12:49:03.134 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T12:49:03.134 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-03T12:49:03.325 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T12:49:03.326 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-03T12:49:03.411 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T12:49:03.412 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-03T12:49:03.492 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T12:49:03.492 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-03T12:49:03.575 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T12:49:03.575 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-03T12:49:03.652 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T12:49:03.653 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-03T12:49:03.716 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T12:49:03.716 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-03T12:49:03.781 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T12:49:03.781 DEBUG:teuthology.orchestra.run.smithi148:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-03T12:49:03.857 INFO:tasks.ceph:Archiving mon data... 2023-12-03T12:49:03.859 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132/data/mon.a.tgz 2023-12-03T12:49:03.859 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2023-12-03T12:49:03.888 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.7HYgBR2A0k 2023-12-03T12:49:03.889 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.7HYgBR2A0k 2023-12-03T12:49:04.073 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.7HYgBR2A0k 2023-12-03T12:49:04.183 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.7HYgBR2A0k is 351KB 2023-12-03T12:49:04.280 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.7HYgBR2A0k 2023-12-03T12:49:04.307 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132/data/mon.c.tgz 2023-12-03T12:49:04.307 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2023-12-03T12:49:04.374 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.td2WujZg3W 2023-12-03T12:49:04.374 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.td2WujZg3W 2023-12-03T12:49:04.531 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.td2WujZg3W 2023-12-03T12:49:04.642 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.td2WujZg3W is 353KB 2023-12-03T12:49:04.721 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.td2WujZg3W 2023-12-03T12:49:04.748 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132/data/mon.b.tgz 2023-12-03T12:49:04.748 DEBUG:teuthology.orchestra.run.smithi148:> mktemp 2023-12-03T12:49:04.763 INFO:teuthology.orchestra.run.smithi148.stdout:/tmp/tmp.XV83wKZOod 2023-12-03T12:49:04.763 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.XV83wKZOod 2023-12-03T12:49:04.926 DEBUG:teuthology.orchestra.run.smithi148:> sudo chmod 0666 /tmp/tmp.XV83wKZOod 2023-12-03T12:49:05.010 DEBUG:teuthology.orchestra.remote:smithi148:/tmp/tmp.XV83wKZOod is 353KB 2023-12-03T12:49:05.108 DEBUG:teuthology.orchestra.run.smithi148:> rm -fr /tmp/tmp.XV83wKZOod 2023-12-03T12:49:05.122 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-03T12:49:05.123 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-03T12:49:05.125 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-03T12:49:05.258 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-03T12:49:05.272 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-03T12:49:05.273 INFO:tasks.ceph:Archiving crash dumps... 2023-12-03T12:49:05.275 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132/remote/smithi131/crash 2023-12-03T12:49:05.275 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-03T12:49:05.375 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/lib/ceph/crash to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132/remote/smithi148/crash 2023-12-03T12:49:05.375 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-03T12:49:05.401 INFO:tasks.ceph:Compressing logs... 2023-12-03T12:49:05.402 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-03T12:49:05.404 DEBUG:teuthology.orchestra.run.smithi148:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-03T12:49:05.484 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83624.log 2023-12-03T12:49:05.484 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-03T12:49:05.485 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83704.log 2023-12-03T12:49:05.485 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.83624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83624.log.gz 2023-12-03T12:49:05.485 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83504.log 2023-12-03T12:49:05.485 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.83704.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-03T12:49:05.485 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83704.log.gz 2023-12-03T12:49:05.485 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.83504.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-03T12:49:05.485 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83504.log.gz 2023-12-03T12:49:05.485 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83584.log 2023-12-03T12:49:05.485 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83464.log 2023-12-03T12:49:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.83584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83584.log.gz 2023-12-03T12:49:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83744.log 2023-12-03T12:49:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-03T12:49:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.83464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83464.log.gz 2023-12-03T12:49:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.83744.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-03T12:49:05.486 INFO:teuthology.orchestra.run.smithi148.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83744.log.gz 2023-12-03T12:49:05.486 INFO:teuthology.orchestra.run.smithi148.stderr: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-03T12:49:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-03T12:49:05.486 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-03T12:49:05.487 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-03T12:49:05.487 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83544.log 2023-12-03T12:49:05.487 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83664.log 2023-12-03T12:49:05.487 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.83544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83544.log.gz 2023-12-03T12:49:05.487 INFO:teuthology.orchestra.run.smithi148.stderr:/var/log/ceph/ceph-client.admin.83664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83664.log.gz 2023-12-03T12:49:05.487 INFO:teuthology.orchestra.run.smithi148.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-03T12:49:05.543 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91776.log 2023-12-03T12:49:05.543 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90518.log 2023-12-03T12:49:05.543 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.91776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92242.log 2023-12-03T12:49:05.543 INFO:teuthology.orchestra.run.smithi131.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.91776.log.gz 2023-12-03T12:49:05.543 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99295.log 2023-12-03T12:49:05.543 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90518.log.gz 2023-12-03T12:49:05.543 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.92242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97495.log 2023-12-03T12:49:05.544 INFO:teuthology.orchestra.run.smithi131.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.92242.log.gz 2023-12-03T12:49:05.544 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.99295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103232.log 2023-12-03T12:49:05.544 INFO:teuthology.orchestra.run.smithi131.stderr: 25.7% -- replaced with /var/log/ceph/ceph-client.admin.99295.log.gz 2023-12-03T12:49:05.544 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.97495.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-03T12:49:05.544 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.103232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104874.log 2023-12-03T12:49:05.544 INFO:teuthology.orchestra.run.smithi131.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.97495.log.gz 2023-12-03T12:49:05.544 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91083.log 2023-12-03T12:49:05.544 INFO:teuthology.orchestra.run.smithi131.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.103232.log.gz 2023-12-03T12:49:05.544 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.104874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91223.log 2023-12-03T12:49:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91083.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.104874.log.gz 2023-12-03T12:49:05.545 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91083.log.gz 2023-12-03T12:49:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102248.log 2023-12-03T12:49:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101592.log 2023-12-03T12:49:05.545 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91223.log.gz 2023-12-03T12:49:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.102248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98875.log 2023-12-03T12:49:05.545 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.102248.log.gz 2023-12-03T12:49:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93268.log 2023-12-03T12:49:05.545 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.98875.log: 85.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.101592.log.gz 2023-12-03T12:49:05.546 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96369.log 2023-12-03T12:49:05.546 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.98875.log.gz 2023-12-03T12:49:05.546 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.93268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106222.log 2023-12-03T12:49:05.546 INFO:teuthology.orchestra.run.smithi131.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.93268.log.gz 2023-12-03T12:49:05.546 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.96369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103150.log 2023-12-03T12:49:05.546 INFO:teuthology.orchestra.run.smithi131.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96369.log.gz 2023-12-03T12:49:05.546 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.106222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112243.log 2023-12-03T12:49:05.546 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.103150.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106222.log.gz 2023-12-03T12:49:05.546 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104628.log 2023-12-03T12:49:05.547 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103150.log.gz 2023-12-03T12:49:05.547 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90529.log 2023-12-03T12:49:05.547 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.112243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112243.log.gz 2023-12-03T12:49:05.547 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.104628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi131.112275.log 2023-12-03T12:49:05.547 INFO:teuthology.orchestra.run.smithi131.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104628.log.gz 2023-12-03T12:49:05.547 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90193.log 0.0% 2023-12-03T12:49:05.547 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.90529.log.gz 2023-12-03T12:49:05.547 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.crash.smithi131.112275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91399.log 2023-12-03T12:49:05.547 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi131.112275.log.gz 2023-12-03T12:49:05.548 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112380.log 2023-12-03T12:49:05.548 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90193.log.gz 2023-12-03T12:49:05.548 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91399.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.91399.log.gz 2023-12-03T12:49:05.548 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.112511.log 2023-12-03T12:49:05.548 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.112380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93596.log 2023-12-03T12:49:05.548 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112380.log.gz 2023-12-03T12:49:05.548 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.112511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112642.log 2023-12-03T12:49:05.548 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112511.log.gz 2023-12-03T12:49:05.548 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.93596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83866.log 2023-12-03T12:49:05.549 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93596.log.gz 2023-12-03T12:49:05.549 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.112642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83987.log 2023-12-03T12:49:05.549 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112642.log.gz 2023-12-03T12:49:05.549 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97193.log 2023-12-03T12:49:05.549 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83866.log.gz 2023-12-03T12:49:05.549 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99778.log 2023-12-03T12:49:05.549 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83987.log.gz 2023-12-03T12:49:05.549 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.97193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100608.log 2023-12-03T12:49:05.549 INFO:teuthology.orchestra.run.smithi131.stderr: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.97193.log.gz 2023-12-03T12:49:05.549 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.99778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93972.log 2023-12-03T12:49:05.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.100608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104956.log 2023-12-03T12:49:05.550 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.100608.log.gz 2023-12-03T12:49:05.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.93972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93972.log.gz 2023-12-03T12:49:05.550 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104054.log 2023-12-03T12:49:05.550 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99726.log 2023-12-03T12:49:05.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.104956.log: /var/log/ceph/ceph-client.admin.104054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95134.log 2023-12-03T12:49:05.550 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.104956.log.gz 2023-12-03T12:49:05.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.99726.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.104054.log.gz 2023-12-03T12:49:05.551 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99440.log 2023-12-03T12:49:05.551 INFO:teuthology.orchestra.run.smithi131.stderr: 50.5% -- replaced with /var/log/ceph/ceph-client.admin.99726.log.gz 2023-12-03T12:49:05.551 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93726.log 2023-12-03T12:49:05.551 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.95134.log: /var/log/ceph/ceph-client.0.99440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi131.112654.log 2023-12-03T12:49:05.551 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.95134.log.gz 2023-12-03T12:49:05.551 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.93726.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.99440.log.gz 2023-12-03T12:49:05.551 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102084.log 2023-12-03T12:49:05.551 INFO:teuthology.orchestra.run.smithi131.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.99778.log.gz 2023-12-03T12:49:05.551 INFO:teuthology.orchestra.run.smithi131.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.93726.log.gz 2023-12-03T12:49:05.551 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103889.log 2023-12-03T12:49:05.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.crash.smithi131.112654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi131.112654.log.gz 2023-12-03T12:49:05.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.102084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105202.log 2023-12-03T12:49:05.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.103889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90527.log 2023-12-03T12:49:05.552 INFO:teuthology.orchestra.run.smithi131.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.102084.log.gz 2023-12-03T12:49:05.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105552.log 2023-12-03T12:49:05.552 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.105202.log.gz 2023-12-03T12:49:05.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90527.log.gz 2023-12-03T12:49:05.552 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103068.log 2023-12-03T12:49:05.552 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110727.log 2023-12-03T12:49:05.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105552.log: gzip/var/log/ceph/ceph-client.admin.103068.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95346.log 2023-12-03T12:49:05.553 INFO:teuthology.orchestra.run.smithi131.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.105552.log.gz 2023-12-03T12:49:05.553 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103068.log.gz 2023-12-03T12:49:05.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.110727.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.103889.log.gz 2023-12-03T12:49:05.553 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105470.log 2023-12-03T12:49:05.553 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.110727.log.gz 2023-12-03T12:49:05.553 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102658.log 2023-12-03T12:49:05.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.95346.log: /var/log/ceph/ceph-client.admin.105470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92150.log 2023-12-03T12:49:05.553 INFO:teuthology.orchestra.run.smithi131.stderr: 85.8% 82.0% -- replaced with /var/log/ceph/ceph-client.admin.105470.log.gz -- replaced with /var/log/ceph/ceph-client.admin.95346.log.gz 2023-12-03T12:49:05.554 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-12-03T12:49:05.554 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101838.log 2023-12-03T12:49:05.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.102658.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.102658.log.gz 2023-12-03T12:49:05.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.92150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91565.log 2023-12-03T12:49:05.554 INFO:teuthology.orchestra.run.smithi131.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.92150.log.gz 2023-12-03T12:49:05.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90013.log 2023-12-03T12:49:05.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100690.log 2023-12-03T12:49:05.555 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91565.log.gz 2023-12-03T12:49:05.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90013.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.90013.log.gz -5 2023-12-03T12:49:05.555 INFO:teuthology.orchestra.run.smithi131.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93620.log 2023-12-03T12:49:05.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.100690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95216.log 2023-12-03T12:49:05.555 INFO:teuthology.orchestra.run.smithi131.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.101838.log.gz 2023-12-03T12:49:05.555 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.100690.log.gz 2023-12-03T12:49:05.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.93620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96559.log 2023-12-03T12:49:05.556 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93620.log.gz 2023-12-03T12:49:05.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.95216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90887.log 2023-12-03T12:49:05.556 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95216.log.gz 2023-12-03T12:49:05.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.96559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91221.log 2023-12-03T12:49:05.556 INFO:teuthology.orchestra.run.smithi131.stderr: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.96559.log.gz 2023-12-03T12:49:05.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98156.log 2023-12-03T12:49:05.556 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90887.log.gz 2023-12-03T12:49:05.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110626.log 2023-12-03T12:49:05.556 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91221.log.gz 2023-12-03T12:49:05.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.98156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106092.log 2023-12-03T12:49:05.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.110626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92058.log 2023-12-03T12:49:05.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.106092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90884.log 2023-12-03T12:49:05.557 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106092.log.gz 2023-12-03T12:49:05.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.92058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91244.log 2023-12-03T12:49:05.558 INFO:teuthology.orchestra.run.smithi131.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.92058.log.gz 2023-12-03T12:49:05.558 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106198.log 2023-12-03T12:49:05.558 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90884.log.gz 2023-12-03T12:49:05.558 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.110626.log.gz 2023-12-03T12:49:05.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93890.log 2023-12-03T12:49:05.559 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91244.log.gz 2023-12-03T12:49:05.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.106198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94184.log 2023-12-03T12:49:05.559 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106198.log.gz 2023-12-03T12:49:05.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.93890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94758.log 2023-12-03T12:49:05.560 INFO:teuthology.orchestra.run.smithi131.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.93890.log.gz 2023-12-03T12:49:05.560 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.94184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97936.log 2023-12-03T12:49:05.560 INFO:teuthology.orchestra.run.smithi131.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.94184.log.gz 2023-12-03T12:49:05.560 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.94758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90727.log 2023-12-03T12:49:05.560 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.94758.log.gz 2023-12-03T12:49:05.560 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-03T12:49:05.560 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.97936.log: /var/log/ceph/ceph-client.admin.90727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111269.log 2023-12-03T12:49:05.561 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90727.log.gz 2023-12-03T12:49:05.561 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102904.log 2023-12-03T12:49:05.561 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.111269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99211.log 2023-12-03T12:49:05.561 INFO:teuthology.orchestra.run.smithi131.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.0.111269.log.gz 2023-12-03T12:49:05.562 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.102904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100772.log 2023-12-03T12:49:05.562 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.102904.log.gz 2023-12-03T12:49:05.562 INFO:teuthology.orchestra.run.smithi131.stderr:gzip/var/log/ceph/ceph-client.admin.99211.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.90186.log 2023-12-03T12:49:05.562 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97936.log.gz 2023-12-03T12:49:05.562 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.100772.log: 83.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101428.log 2023-12-03T12:49:05.562 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.99211.log.gz 2023-12-03T12:49:05.562 INFO:teuthology.orchestra.run.smithi131.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.100772.log.gz 2023-12-03T12:49:05.562 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90747.log 2023-12-03T12:49:05.562 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90186.log.gz 2023-12-03T12:49:05.563 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91523.log 2023-12-03T12:49:05.563 INFO:teuthology.orchestra.run.smithi131.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.101428.log.gz 2023-12-03T12:49:05.563 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.112499.log 2023-12-03T12:49:05.563 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90747.log.gz 2023-12-03T12:49:05.563 INFO:teuthology.orchestra.run.smithi131.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-03T12:49:05.563 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105880.log 2023-12-03T12:49:05.563 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91523.log.gz 2023-12-03T12:49:05.563 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.crash.112499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104382.log 2023-12-03T12:49:05.563 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112499.log.gz 2023-12-03T12:49:05.563 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91143.log 2023-12-03T12:49:05.564 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105880.log.gz 2023-12-03T12:49:05.564 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.104382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105449.log 2023-12-03T12:49:05.564 INFO:teuthology.orchestra.run.smithi131.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.104382.log.gz 2023-12-03T12:49:05.564 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95428.log 2023-12-03T12:49:05.564 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91143.log.gz 2023-12-03T12:49:05.564 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104136.log 2023-12-03T12:49:05.564 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105449.log.gz 2023-12-03T12:49:05.564 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.95428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93996.log 2023-12-03T12:49:05.564 INFO:teuthology.orchestra.run.smithi131.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.95428.log.gz 2023-12-03T12:49:05.565 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.104136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105038.log 2023-12-03T12:49:05.565 INFO:teuthology.orchestra.run.smithi131.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104136.log.gz 2023-12-03T12:49:05.565 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99127.log 2023-12-03T12:49:05.565 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.93996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.93996.log.gz 2023-12-03T12:49:05.565 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106304.log 2023-12-03T12:49:05.565 INFO:teuthology.orchestra.run.smithi131.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.105038.log.gz 2023-12-03T12:49:05.565 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.99127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90881.log 2023-12-03T12:49:05.565 INFO:teuthology.orchestra.run.smithi131.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.99127.log.gz 2023-12-03T12:49:05.565 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89845.log 2023-12-03T12:49:05.565 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.106304.log: /var/log/ceph/ceph-client.admin.90881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90881.log.gzgzip 2023-12-03T12:49:05.566 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.101018.log 2023-12-03T12:49:05.566 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.106304.log.gz 2023-12-03T12:49:05.566 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.89845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83576.log 2023-12-03T12:49:05.566 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89845.log.gz 2023-12-03T12:49:05.566 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94102.log 2023-12-03T12:49:05.566 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101018.log.gz 2023-12-03T12:49:05.566 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.83576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96041.log 2023-12-03T12:49:05.566 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.83576.log.gz 2023-12-03T12:49:05.566 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101100.log 2023-12-03T12:49:05.567 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.94102.log: /var/log/ceph/ceph-client.admin.96041.log: 85.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.94102.log.gz 2023-12-03T12:49:05.567 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.100280.log 2023-12-03T12:49:05.567 INFO:teuthology.orchestra.run.smithi131.stderr: 59.1% -- replaced with /var/log/ceph/ceph-client.admin.96041.log.gz 2023-12-03T12:49:05.567 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91441.log 2023-12-03T12:49:05.567 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.100280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111065.log 2023-12-03T12:49:05.567 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101100.log.gz 2023-12-03T12:49:05.567 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8%/var/log/ceph/ceph-client.admin.91441.log: -- replaced with /var/log/ceph/ceph-client.admin.100280.log.gz 2023-12-03T12:49:05.567 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91441.log.gz 2023-12-03T12:49:05.567 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90531.log 2023-12-03T12:49:05.567 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.111065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112588.log 2023-12-03T12:49:05.568 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.111065.log.gz 2023-12-03T12:49:05.568 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90531.log.gz 2023-12-03T12:49:05.568 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109043.log 2023-12-03T12:49:05.568 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.112588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95052.log 2023-12-03T12:49:05.568 INFO:teuthology.orchestra.run.smithi131.stderr: 9.2% -- replaced with /var/log/ceph/ceph-client.0.112588.log.gz 2023-12-03T12:49:05.568 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.109043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90194.log 2023-12-03T12:49:05.568 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.95052.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.109043.log.gz 2023-12-03T12:49:05.568 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.112368.log 2023-12-03T12:49:05.568 INFO:teuthology.orchestra.run.smithi131.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.95052.log.gz 2023-12-03T12:49:05.569 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91966.log 2023-12-03T12:49:05.569 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90194.log.gz 2023-12-03T12:49:05.569 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.crash.112368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102412.log 2023-12-03T12:49:05.569 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112368.log.gz 2023-12-03T12:49:05.569 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.91966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109972.log 2023-12-03T12:49:05.569 INFO:teuthology.orchestra.run.smithi131.stderr: 43.2% -- replaced with /var/log/ceph/ceph-client.0.91966.log.gz 2023-12-03T12:49:05.569 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.102412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93644.log 2023-12-03T12:49:05.569 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.102412.log.gz 2023-12-03T12:49:05.569 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.109972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95775.log 2023-12-03T12:49:05.569 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105716.log 2023-12-03T12:49:05.570 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.93644.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.109972.log.gz 2023-12-03T12:49:05.570 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.95775.log: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.93644.log.gz 2023-12-03T12:49:05.570 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94840.log 2023-12-03T12:49:05.570 INFO:teuthology.orchestra.run.smithi131.stderr: 62.0% -- replaced with /var/log/ceph/ceph-client.admin.95775.log.gz 2023-12-03T12:49:05.570 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110174.log 2023-12-03T12:49:05.570 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105716.log: /var/log/ceph/ceph-client.admin.94840.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-03T12:49:05.570 INFO:teuthology.orchestra.run.smithi131.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.105716.log.gz 2023-12-03T12:49:05.570 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.94840.log.gz 2023-12-03T12:49:05.570 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.110174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.112231.log 2023-12-03T12:49:05.570 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.1.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.110174.log.gz 2023-12-03T12:49:05.571 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112469.log 2023-12-03T12:49:05.571 INFO:teuthology.orchestra.run.smithi131.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.98156.log.gz 2023-12-03T12:49:05.571 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.crash.112231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105366.log 2023-12-03T12:49:05.571 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112231.log.gz 2023-12-03T12:49:05.571 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.112469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101920.log 2023-12-03T12:49:05.571 INFO:teuthology.orchestra.run.smithi131.stderr: 8.2% -- replaced with /var/log/ceph/ceph-client.0.112469.log.gz 2023-12-03T12:49:05.571 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103396.log 2023-12-03T12:49:05.571 INFO:teuthology.orchestra.run.smithi131.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.105366.log.gz 2023-12-03T12:49:05.571 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98957.log 2023-12-03T12:49:05.572 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.101920.log.gz 2023-12-03T12:49:05.572 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91647.log 2023-12-03T12:49:05.572 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.103396.log: /var/log/ceph/ceph-client.admin.98957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100362.log 2023-12-03T12:49:05.572 INFO:teuthology.orchestra.run.smithi131.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.103396.log.gz 2023-12-03T12:49:05.572 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91647.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.98957.log.gz 2023-12-03T12:49:05.572 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91647.log.gz 2023-12-03T12:49:05.572 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109636.log 2023-12-03T12:49:05.572 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90188.log 2023-12-03T12:49:05.572 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.100362.log: /var/log/ceph/ceph-client.admin.109636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90189.log 2023-12-03T12:49:05.573 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.100362.log.gz 2023-12-03T12:49:05.573 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90188.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.90188.log.gz /var/log/ceph/ceph-client.crash.smithi131.112316.log 2023-12-03T12:49:05.573 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-12-03T12:49:05.573 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.109636.log.gz 2023-12-03T12:49:05.573 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi131.112219.log 2023-12-03T12:49:05.573 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90189.log.gz 2023-12-03T12:49:05.573 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.crash.smithi131.112316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103724.log 2023-12-03T12:49:05.573 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi131.112316.log.gz 2023-12-03T12:49:05.573 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.crash.smithi131.112219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91142.log 2023-12-03T12:49:05.573 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi131.112219.log.gz 2023-12-03T12:49:05.574 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.103724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110859.log 2023-12-03T12:49:05.574 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103724.log.gz 2023-12-03T12:49:05.574 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91142.log.gz 2023-12-03T12:49:05.574 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97303.log 2023-12-03T12:49:05.574 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.110859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102166.log 2023-12-03T12:49:05.574 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.97303.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.110859.log.gz 2023-12-03T12:49:05.574 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90530.log 2023-12-03T12:49:05.574 INFO:teuthology.orchestra.run.smithi131.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.97303.log.gz 2023-12-03T12:49:05.575 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89929.log 2023-12-03T12:49:05.575 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.102166.log: /var/log/ceph/ceph-client.admin.90530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104792.log 2023-12-03T12:49:05.575 INFO:teuthology.orchestra.run.smithi131.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.102166.log.gz 2023-12-03T12:49:05.575 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90530.log.gz 2023-12-03T12:49:05.575 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.89929.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.89929.log.gz 2023-12-03T12:49:05.575 INFO:teuthology.orchestra.run.smithi131.stderr: /var/log/ceph/ceph-client.admin.105284.log 2023-12-03T12:49:05.575 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.104792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101264.log 2023-12-03T12:49:05.575 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105284.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.104792.log.gz 2023-12-03T12:49:05.575 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110275.log 2023-12-03T12:49:05.575 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105284.log.gz 2023-12-03T12:49:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102822.log 2023-12-03T12:49:05.576 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101264.log.gz 2023-12-03T12:49:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.110275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104218.log 2023-12-03T12:49:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.102822.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.110275.log.gz 2023-12-03T12:49:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96499.log 2023-12-03T12:49:05.576 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.102822.log.gz 2023-12-03T12:49:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.104218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111575.log 2023-12-03T12:49:05.576 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.104218.log.gz 2023-12-03T12:49:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.96499.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-03T12:49:05.576 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98046.log 2023-12-03T12:49:05.577 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.111575.log: /var/log/ceph/ceph-osd.3.log: 79.9% -- replaced with /var/log/ceph/ceph-client.0.111575.log.gz 2023-12-03T12:49:05.577 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100198.log 2023-12-03T12:49:05.577 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.98046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104710.log 2023-12-03T12:49:05.577 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.100198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89699.log 2023-12-03T12:49:05.577 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.104710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104546.log 2023-12-03T12:49:05.577 INFO:teuthology.orchestra.run.smithi131.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.100198.log.gz 2023-12-03T12:49:05.577 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.89699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89699.log.gz 2023-12-03T12:49:05.577 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98376.log 2023-12-03T12:49:05.577 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.104546.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98046.log.gz 2023-12-03T12:49:05.578 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102986.log 2023-12-03T12:49:05.578 INFO:teuthology.orchestra.run.smithi131.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.104546.log.gz 2023-12-03T12:49:05.578 INFO:teuthology.orchestra.run.smithi131.stderr:gzip/var/log/ceph/ceph-client.admin.98376.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.103478.log 2023-12-03T12:49:05.578 INFO:teuthology.orchestra.run.smithi131.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.104710.log.gz 2023-12-03T12:49:05.578 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.102986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95240.log 2023-12-03T12:49:05.578 INFO:teuthology.orchestra.run.smithi131.stderr: 85.1%/var/log/ceph/ceph-client.admin.103478.log: -- replaced with /var/log/ceph/ceph-client.admin.102986.log.gz 2023-12-03T12:49:05.578 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100936.log 2023-12-03T12:49:05.578 INFO:teuthology.orchestra.run.smithi131.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103478.log.gz 2023-12-03T12:49:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101510.log 2023-12-03T12:49:05.579 INFO:teuthology.orchestra.run.smithi131.stderr: 86.5%/var/log/ceph/ceph-client.admin.95240.log: -- replaced with /var/log/ceph/ceph-client.admin.98376.log.gz 2023-12-03T12:49:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.100936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.95240.log.gz 2023-12-03T12:49:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111167.log 2023-12-03T12:49:05.579 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96617.log 2023-12-03T12:49:05.579 INFO:teuthology.orchestra.run.smithi131.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.100936.log.gz 2023-12-03T12:49:05.579 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101510.log.gz 2023-12-03T12:49:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99876.log 2023-12-03T12:49:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.111167.log: /var/log/ceph/ceph-client.admin.96617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90195.log 2023-12-03T12:49:05.580 INFO:teuthology.orchestra.run.smithi131.stderr: 91.2% 79.8% -- replaced with /var/log/ceph/ceph-client.0.111167.log.gz 2023-12-03T12:49:05.580 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.96617.log.gz 2023-12-03T12:49:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.99876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90525.log 2023-12-03T12:49:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90195.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.99876.log.gz 2023-12-03T12:49:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100526.log 2023-12-03T12:49:05.580 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90195.log.gz 2023-12-03T12:49:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90885.log 2023-12-03T12:49:05.580 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90525.log.gz 2023-12-03T12:49:05.581 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.100526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94512.log 2023-12-03T12:49:05.581 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90885.log: 86.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.110961.log 2023-12-03T12:49:05.581 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100526.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90885.log.gz 2023-12-03T12:49:05.581 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-12-03T12:49:05.581 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.94512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105634.log 2023-12-03T12:49:05.581 INFO:teuthology.orchestra.run.smithi131.stderr: 82.3%/var/log/ceph/ceph-client.0.110961.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.94512.log.gz 2023-12-03T12:49:05.581 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.103314.log 2023-12-03T12:49:05.581 INFO:teuthology.orchestra.run.smithi131.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.110961.log.gz 2023-12-03T12:49:05.581 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105634.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2023-12-03T12:49:05.582 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.105634.log.gz 2023-12-03T12:49:05.582 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.103314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102740.log 2023-12-03T12:49:05.582 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.103314.log.gz 2023-12-03T12:49:05.582 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109434.log 2023-12-03T12:49:05.582 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.102740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98486.log 2023-12-03T12:49:05.582 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.109434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111677.log 2023-12-03T12:49:05.582 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.98486.log: 93.4% 85.9% -- replaced with /var/log/ceph/ceph-client.admin.102740.log.gz 2023-12-03T12:49:05.582 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109434.log.gz 2023-12-03T12:49:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.98486.log.gz 2023-12-03T12:49:05.583 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-12-03T12:49:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.111677.log: gzip -5 --verbose -- 80.1% /var/log/ceph/ceph-client.admin.105120.log 2023-12-03T12:49:05.583 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.0.111677.log.gz 2023-12-03T12:49:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93514.log 2023-12-03T12:49:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi131.112398.log 2023-12-03T12:49:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105120.log: /var/log/ceph/ceph-client.admin.93514.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.105120.log.gz 2023-12-03T12:49:05.583 INFO:teuthology.orchestra.run.smithi131.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.93514.log.gz 2023-12-03T12:49:05.583 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91868.log 2023-12-03T12:49:05.583 INFO:teuthology.orchestra.run.smithi131.stderr: 94.4% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2023-12-03T12:49:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94676.log 2023-12-03T12:49:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.crash.smithi131.112398.log: /var/log/ceph/ceph-client.0.91868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101674.log 2023-12-03T12:49:05.584 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi131.112398.log.gz 2023-12-03T12:49:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.94676.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.91868.log.gz 2023-12-03T12:49:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102330.log 2023-12-03T12:49:05.584 INFO:teuthology.orchestra.run.smithi131.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.94676.log.gz 2023-12-03T12:49:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94266.log 2023-12-03T12:49:05.584 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96499.log.gz 2023-12-03T12:49:05.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101674.log: /var/log/ceph/ceph-client.admin.102330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101346.log 2023-12-03T12:49:05.584 INFO:teuthology.orchestra.run.smithi131.stderr: 82.0%/var/log/ceph/ceph-client.admin.94266.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.102330.log.gz 2023-12-03T12:49:05.585 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101674.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97826.log 2023-12-03T12:49:05.585 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-12-03T12:49:05.585 INFO:teuthology.orchestra.run.smithi131.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.94266.log.gz 2023-12-03T12:49:05.585 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109737.log 2023-12-03T12:49:05.585 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101346.log: /var/log/ceph/ceph-client.admin.97826.log: gzip 85.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.100444.log 2023-12-03T12:49:05.585 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101346.log.gz 2023-12-03T12:49:05.585 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.109737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110073.log 2023-12-03T12:49:05.585 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90391.log 2023-12-03T12:49:05.585 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.109737.log.gz 2023-12-03T12:49:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.100444.log: /var/log/ceph/ceph-client.admin.110073.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.100444.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102576.log 2023-12-03T12:49:05.586 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-12-03T12:49:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90391.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.110073.log.gz 2023-12-03T12:49:05.586 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90391.log.gz 2023-12-03T12:49:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111779.log 2023-12-03T12:49:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:gzip/var/log/ceph/ceph-client.admin.102576.log: -5 --verbose -- /var/log/ceph/ceph-client.crash.112666.log 2023-12-03T12:49:05.586 INFO:teuthology.orchestra.run.smithi131.stderr: 81.9%/var/log/ceph/ceph-client.0.111779.log: -- replaced with /var/log/ceph/ceph-client.admin.102576.log.gz 2023-12-03T12:49:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91605.log 2023-12-03T12:49:05.586 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.111779.log.gz 2023-12-03T12:49:05.586 INFO:teuthology.orchestra.run.smithi131.stderr:gzip/var/log/ceph/ceph-client.crash.112666.log: -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112666.log.gz 2023-12-03T12:49:05.587 INFO:teuthology.orchestra.run.smithi131.stderr: -- /var/log/ceph/ceph-client.admin.105904.log 2023-12-03T12:49:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91605.log.gz 2023-12-03T12:49:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93808.log 2023-12-03T12:49:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105904.log.gz 2023-12-03T12:49:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103560.log 2023-12-03T12:49:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5/var/log/ceph/ceph-client.admin.93808.log: --verbose -- /var/log/ceph/ceph-client.admin.106010.log 2023-12-03T12:49:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.103560.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.93808.log.gz 2023-12-03T12:49:05.587 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90886.log 2023-12-03T12:49:05.588 INFO:teuthology.orchestra.run.smithi131.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.103560.log.gz 2023-12-03T12:49:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94888.log 2023-12-03T12:49:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.106010.log: 93.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.97826.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.112341.log 2023-12-03T12:49:05.588 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-12-03T12:49:05.588 INFO:teuthology.orchestra.run.smithi131.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106010.log.gz 2023-12-03T12:49:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90886.log: /var/log/ceph/ceph-client.admin.94888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90886.log.gz 2023-12-03T12:49:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94864.log 2023-12-03T12:49:05.588 INFO:teuthology.orchestra.run.smithi131.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.94888.log.gz 2023-12-03T12:49:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.112341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112341.log.gz 2023-12-03T12:49:05.588 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-03T12:49:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95264.log 2023-12-03T12:49:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.94864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.94864.log.gz 2023-12-03T12:49:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.smithi131.112356.log 2023-12-03T12:49:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.95264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109535.log 2023-12-03T12:49:05.589 INFO:teuthology.orchestra.run.smithi131.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.95264.log.gz/var/log/ceph/ceph-client.crash.smithi131.112356.log: 2023-12-03T12:49:05.589 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.smithi131.112356.log.gz 2023-12-03T12:49:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2023-12-03T12:49:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.109535.log: -- /var/log/ceph/ceph-client.admin.103642.log 2023-12-03T12:49:05.589 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- 92.2% /var/log/ceph/ceph.tmp-client.admin.77711.log 2023-12-03T12:49:05.589 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109535.log.gz 2023-12-03T12:49:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111473.log 2023-12-03T12:49:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.103642.log: /var/log/ceph/ceph.tmp-client.admin.77711.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.77711.log.gz 2023-12-03T12:49:05.590 INFO:teuthology.orchestra.run.smithi131.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.103642.log.gz 2023-12-03T12:49:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108799.log 2023-12-03T12:49:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94594.log 2023-12-03T12:49:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.111473.log: /var/log/ceph/ceph-client.0.108799.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.111473.log.gz 2023-12-03T12:49:05.590 INFO:teuthology.orchestra.run.smithi131.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.108799.log.gz 2023-12-03T12:49:05.590 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-03T12:49:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93432.log 2023-12-03T12:49:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.94594.log: /var/log/ceph/ceph.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.94594.log.gz 2023-12-03T12:49:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94970.log 2023-12-03T12:49:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.93432.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.93432.log.gz 2023-12-03T12:49:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-03T12:49:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.94970.log: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.94970.log.gz 2023-12-03T12:49:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90192.log 2023-12-03T12:49:05.591 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.2.log: 93.7% 94.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-03T12:49:05.592 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2023-12-03T12:49:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.99538.log 2023-12-03T12:49:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91670.log 2023-12-03T12:49:05.592 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90192.log.gz 2023-12-03T12:49:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.99538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89887.log 2023-12-03T12:49:05.592 INFO:teuthology.orchestra.run.smithi131.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.99538.log.gz 2023-12-03T12:49:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.91670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89789.log 2023-12-03T12:49:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.89887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89887.log.gz 2023-12-03T12:49:05.592 INFO:teuthology.orchestra.run.smithi131.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.0.91670.log.gz 2023-12-03T12:49:05.592 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104300.log 2023-12-03T12:49:05.593 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.89789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106174.log 2023-12-03T12:49:05.593 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89789.log.gz 2023-12-03T12:49:05.593 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.104300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96443.log 2023-12-03T12:49:05.593 INFO:teuthology.orchestra.run.smithi131.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.104300.log.gz 2023-12-03T12:49:05.593 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.106174.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2023-12-03T12:49:05.593 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.96443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106174.log.gz 2023-12-03T12:49:05.593 INFO:teuthology.orchestra.run.smithi131.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96443.log.gz 2023-12-03T12:49:05.593 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103971.log 2023-12-03T12:49:05.593 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106386.log 2023-12-03T12:49:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.103971.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.103971.log.gz 2023-12-03T12:49:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108942.log 2023-12-03T12:49:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.106386.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.106386.log.gz 2023-12-03T12:49:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93350.log 2023-12-03T12:49:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.108942.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.108942.log.gz 2023-12-03T12:49:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105928.log 2023-12-03T12:49:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.93350.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.93350.log.gz 2023-12-03T12:49:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94348.log 2023-12-03T12:49:05.594 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105928.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.105928.log.gz 2023-12-03T12:49:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91222.log 2023-12-03T12:49:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.94348.log: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.94348.log.gz 2023-12-03T12:49:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102494.log 2023-12-03T12:49:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91222.log.gz 2023-12-03T12:49:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103806.log 2023-12-03T12:49:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.102494.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.102494.log.gz 2023-12-03T12:49:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89971.log 2023-12-03T12:49:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.103806.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.103806.log.gz 2023-12-03T12:49:05.595 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90880.log 2023-12-03T12:49:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.89971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.89971.log.gz 2023-12-03T12:49:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90517.log 2023-12-03T12:49:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90880.log.gz 2023-12-03T12:49:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98266.log 2023-12-03T12:49:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90517.log.gz 2023-12-03T12:49:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.111371.log 2023-12-03T12:49:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.98266.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.98266.log.gz 2023-12-03T12:49:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101182.log 2023-12-03T12:49:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.111371.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.111371.log.gz 2023-12-03T12:49:05.596 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104464.log 2023-12-03T12:49:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101182.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.101182.log.gz 2023-12-03T12:49:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.112287.log 2023-12-03T12:49:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.104464.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.104464.log.gz 2023-12-03T12:49:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105798.log 2023-12-03T12:49:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.crash.112287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112287.log.gz 2023-12-03T12:49:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91063.log 2023-12-03T12:49:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.105798.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.105798.log.gz 2023-12-03T12:49:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97605.log 2023-12-03T12:49:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91063.log.gz 2023-12-03T12:49:05.597 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96151.log 2023-12-03T12:49:05.598 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.97605.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.97605.log.gz 2023-12-03T12:49:05.598 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97715.log 2023-12-03T12:49:05.598 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.96151.log: 47.3% -- replaced with /var/log/ceph/ceph-client.admin.96151.log.gz 2023-12-03T12:49:05.598 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97385.log 2023-12-03T12:49:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.97715.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.97715.log.gz 2023-12-03T12:49:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94430.log 2023-12-03T12:49:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.97385.log: 93.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112299.log 2023-12-03T12:49:05.606 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.94430.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.94430.log.gz 2023-12-03T12:49:05.607 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97385.log.gz 2023-12-03T12:49:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102002.log 2023-12-03T12:49:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.112299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112299.log.gz 2023-12-03T12:49:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100854.log 2023-12-03T12:49:05.607 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.102002.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.102002.log.gz 2023-12-03T12:49:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90190.log 2023-12-03T12:49:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.100854.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.100854.log.gz 2023-12-03T12:49:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91483.log 2023-12-03T12:49:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.90190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.90190.log.gz 2023-12-03T12:49:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.crash.112329.log 2023-12-03T12:49:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.91483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.91483.log.gz 2023-12-03T12:49:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94020.log 2023-12-03T12:49:05.608 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.crash.112329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.crash.112329.log.gz 2023-12-03T12:49:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101756.log 2023-12-03T12:49:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.94020.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.94020.log.gz 2023-12-03T12:49:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-03T12:49:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.101756.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101756.log.gz 2023-12-03T12:49:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99044.log 2023-12-03T12:49:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mon.c.log: 94.9% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2023-12-03T12:49:05.609 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.99044.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.99044.log.gz 2023-12-03T12:49:05.742 INFO:teuthology.orchestra.run.smithi148.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-03T12:49:06.153 INFO:teuthology.orchestra.run.smithi131.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-03T12:49:06.155 INFO:teuthology.orchestra.run.smithi148.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-03T12:49:06.930 INFO:teuthology.orchestra.run.smithi131.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-03T12:49:07.583 INFO:teuthology.orchestra.run.smithi131.stderr: 92.7% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2023-12-03T12:49:08.927 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-03T12:49:09.625 INFO:teuthology.orchestra.run.smithi131.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-03T12:49:09.940 INFO:teuthology.orchestra.run.smithi148.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-03T12:49:10.898 INFO:teuthology.orchestra.run.smithi148.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-03T12:49:11.345 INFO:teuthology.orchestra.run.smithi148.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-03T12:49:12.846 INFO:teuthology.orchestra.run.smithi131.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-03T12:49:13.226 INFO:teuthology.orchestra.run.smithi148.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-03T12:49:13.228 INFO:teuthology.orchestra.run.smithi148.stderr: 2023-12-03T12:49:13.228 INFO:teuthology.orchestra.run.smithi148.stderr:real 0m7.766s 2023-12-03T12:49:13.228 INFO:teuthology.orchestra.run.smithi148.stderr:user 0m23.587s 2023-12-03T12:49:13.228 INFO:teuthology.orchestra.run.smithi148.stderr:sys 0m0.845s 2023-12-03T12:49:19.132 INFO:teuthology.orchestra.run.smithi131.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-03T12:49:19.134 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-12-03T12:49:19.134 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m13.705s 2023-12-03T12:49:19.134 INFO:teuthology.orchestra.run.smithi131.stderr:user 0m31.743s 2023-12-03T12:49:19.134 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m1.293s 2023-12-03T12:49:19.135 INFO:tasks.ceph:Archiving logs... 2023-12-03T12:49:19.135 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132/remote/smithi131/log 2023-12-03T12:49:19.136 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-03T12:49:23.239 DEBUG:teuthology.misc:Transferring archived files from smithi148:/var/log/ceph to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132/remote/smithi148/log 2023-12-03T12:49:23.239 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-03T12:49:26.335 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1918, in task File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph.py", line 1928, in task File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2758, in wait_for_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2590, in get_num_active_clean File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 2356, in get_pg_stats File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1611, in raw_cluster_cmd File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/ceph_manager.py", line 1602, in run_cluster_cmd File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-12-03T12:49:26.346 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-03T12:49:26.359 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 101, in end File "/home/teuthworker/src/git.ceph.com_ceph-c_bcbf278cf395873c2a482f5a7b2345faf2160319/qa/tasks/s3tests_java.py", line 386, in delete_users File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T12:49:26.369 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-03T12:49:26.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-03T12:49:26.375 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-03T12:49:26.467 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-03T12:49:26.478 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-03T12:49:26.478 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T12:49:26.481 DEBUG:teuthology.orchestra.run.smithi148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-03T12:49:26.497 INFO:teuthology.orchestra.run.smithi148.stderr:bash: line 1: ntpq: command not found 2023-12-03T12:49:26.502 INFO:teuthology.orchestra.run.smithi148.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T12:49:26.502 INFO:teuthology.orchestra.run.smithi148.stdout:=============================================================================== 2023-12-03T12:49:26.502 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 +2197us[+2183us] +/- 75ms 2023-12-03T12:49:26.502 INFO:teuthology.orchestra.run.smithi148.stdout:^* hv02.front.sepia.ceph.com 3 7 377 2 -1214us[-1227us] +/- 56ms 2023-12-03T12:49:26.502 INFO:teuthology.orchestra.run.smithi148.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -348us[ -363us] +/- 77ms 2023-12-03T12:49:26.502 INFO:teuthology.orchestra.run.smithi148.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T12:49:26.508 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2023-12-03T12:49:26.512 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-03T12:49:26.512 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2023-12-03T12:49:26.513 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 4 +2210us[+2192us] +/- 75ms 2023-12-03T12:49:26.513 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv02.front.sepia.ceph.com 3 7 377 2 -1197us[-1214us] +/- 56ms 2023-12-03T12:49:26.513 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -357us[ -375us] +/- 77ms 2023-12-03T12:49:26.513 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-03T12:49:26.514 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-03T12:49:26.523 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-03T12:49:26.524 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-03T12:49:26.533 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-03T12:49:26.666 DEBUG:teuthology.orchestra.run.smithi148:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-03T12:49:26.765 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T12:49:26.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:49:26.811 DEBUG:teuthology.orchestra.run.smithi148:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-03T12:49:26.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:49:26.845 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-03T12:49:26.856 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-03T12:49:26.878 INFO:teuthology.task.internal:Duration was 5728.532355 seconds 2023-12-03T12:49:26.878 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-03T12:49:26.888 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-03T12:49:26.888 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-03T12:49:26.890 DEBUG:teuthology.orchestra.run.smithi148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-03T12:49:26.935 INFO:teuthology.orchestra.run.smithi148.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T12:49:26.944 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-03T12:49:27.280 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-03T12:49:27.280 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2023-12-03T12:49:27.281 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-03T12:49:27.312 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi148.front.sepia.ceph.com 2023-12-03T12:49:27.312 DEBUG:teuthology.orchestra.run.smithi148:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-03T12:49:27.340 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-03T12:49:27.341 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-03T12:49:27.354 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-03T12:49:27.409 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-03T12:49:27.409 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-03T12:49:27.435 DEBUG:teuthology.orchestra.run.smithi148:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-03T12:49:27.544 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-03T12:49:27.555 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-03T12:49:27.556 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-03T12:49:27.595 DEBUG:teuthology.orchestra.run.smithi148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-03T12:49:27.622 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-03T12:49:27.633 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-03T12:49:27.638 DEBUG:teuthology.orchestra.run.smithi148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-03T12:49:27.674 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2023-12-03T12:49:27.688 INFO:teuthology.orchestra.run.smithi148.stdout:kernel.core_pattern = core 2023-12-03T12:49:27.730 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-03T12:49:27.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:49:27.757 DEBUG:teuthology.orchestra.run.smithi148:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-03T12:49:27.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-03T12:49:27.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-03T12:49:27.796 INFO:teuthology.task.internal:Transferring archived files... 2023-12-03T12:49:27.797 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132/remote/smithi131 2023-12-03T12:49:27.797 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-03T12:49:27.849 DEBUG:teuthology.misc:Transferring archived files from smithi148:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132/remote/smithi148 2023-12-03T12:49:27.849 DEBUG:teuthology.orchestra.run.smithi148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-03T12:49:27.884 INFO:teuthology.task.internal:Removing archive directory... 2023-12-03T12:49:27.884 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-03T12:49:27.887 DEBUG:teuthology.orchestra.run.smithi148:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-03T12:49:27.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-03T12:49:27.946 INFO:teuthology.task.internal:Not uploading archives. 2023-12-03T12:49:27.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-03T12:49:27.957 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-03T12:49:27.958 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-03T12:49:27.960 DEBUG:teuthology.orchestra.run.smithi148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-03T12:49:27.984 INFO:teuthology.orchestra.run.smithi131.stdout: 265982 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 3 12:49 /home/ubuntu/cephtest 2023-12-03T12:49:27.988 INFO:teuthology.orchestra.run.smithi148.stdout: 266007 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 3 12:49 /home/ubuntu/cephtest 2023-12-03T12:49:27.989 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-03T12:49:28.001 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-03T12:49:28.012 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi131 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph' 2023-12-03T12:49:28.012 INFO:teuthology.nuke:Checking targets against current locks 2023-12-03T12:49:28.038 DEBUG:teuthology.nuke:shortname: smithi131 2023-12-03T12:49:28.038 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-03T12:49:28.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:05:57.938681', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIGLLW5lEyD0TqrX0qfEz3d7YenSQguKT7RX2V4Cd/HtIAFDdBRn/bpxGTkfdJyYd38ELFEvaftd5NYZdYM044A='} 2023-12-03T12:49:28.064 DEBUG:teuthology.nuke:shortname: smithi148 2023-12-03T12:49:28.065 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-03T12:49:28.092 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-03_11:04:43-rgw-wip-alimasa-multi-pubsub-etag-distro-default-smithi/7476132', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-03 11:05:57.937608', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJHR3bUn7kJuWNVa0JRRD0ch+Afsiy1VnVp8T2hvJIth26m2xDoKxdhmbZ4lfk5vkD+hkQifXIIl0tzjS8Trhzw='} 2023-12-03T12:49:28.117 INFO:teuthology.orchestra.console.smithi131:Power off 2023-12-03T12:49:28.117 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-03T12:49:28.140 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-12-03T12:49:28.140 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:49:28.155 INFO:teuthology.orchestra.console.smithi148:Power off 2023-12-03T12:49:28.156 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-03T12:49:28.164 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-12-03T12:49:28.178 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-12-03T12:49:28.179 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:49:28.200 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-12-03T12:49:32.165 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:49:32.201 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:49:32.278 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-12-03T12:49:32.312 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-12-03T12:49:36.284 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:49:36.313 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-03T12:49:36.394 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-12-03T12:49:36.421 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-12-03T12:49:36.495 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-12-03T12:49:36.522 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-12-03T12:49:39.687 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 5728.532355070114 failure_reason: 'Command failed (s3 tests against rgw) on smithi131 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m ''not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3''"' flavor: default owner: scheduled_alimasa@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=cbbbdd1457714b5a9343f00530b0fe31 status: fail success: false 2023-12-03T12:49:39.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-03T12:49:39.766 INFO:teuthology.run:FAIL